-- Logs begin at Thu 2022-07-14 08:56:28 UTC, end at Thu 2022-07-14 10:34:17 UTC. -- Jul 14 09:28:55.591101 dv-cinder-825492-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 09:28:55.600191 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 09:28:55 2022] *** Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: nodename: dv-cinder-825492-26-iscsi Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: machine: x86_64 Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: clock source: unix Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: pcre jit disabled Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: detected number of CPU cores: 4 Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: current working directory: / Jul 14 09:28:55.603262 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: detected binary path: /usr/bin/uwsgi-core Jul 14 09:28:55.603975 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: your processes number limit is 47680 Jul 14 09:28:55.603975 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: your memory page size is 4096 bytes Jul 14 09:28:55.603975 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: detected max file descriptor number: 2048 Jul 14 09:28:55.603975 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: lock engine: pthread robust mutexes Jul 14 09:28:55.603975 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: thunder lock: enabled Jul 14 09:28:55.603975 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 09:28:55.603975 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 09:28:55.647014 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: Python main interpreter initialized at 0x55c2ae18b9c0 Jul 14 09:28:55.647014 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: python threads support enabled Jul 14 09:28:55.647014 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: your server socket listen backlog is limited to 100 connections Jul 14 09:28:55.647014 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: your mercy for graceful operations on workers is 90 seconds Jul 14 09:28:55.647336 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 09:28:55.647408 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: *** Operational MODE: preforking *** Jul 14 09:28:55.647673 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: *** uWSGI is running in multiple interpreter mode *** Jul 14 09:28:55.647673 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: spawned uWSGI master process (pid: 103390) Jul 14 09:28:55.647863 dv-cinder-825492-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 09:28:55.648408 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: spawned uWSGI worker 1 (pid: 103391, cores: 1) Jul 14 09:28:55.648743 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: spawned uWSGI worker 2 (pid: 103392, cores: 1) Jul 14 09:28:55.648907 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 09:28:56.304346 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 09:28:56.304973 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 09:28:57.421745 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:28:57.421745 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: from cryptography.utils import int_from_bytes Jul 14 09:28:57.422494 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:28:57.422494 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: from cryptography.utils import int_from_bytes Jul 14 09:28:57.431706 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:28:57.431706 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: from cryptography.utils import int_from_bytes Jul 14 09:28:57.432118 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:28:57.432118 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: from cryptography.utils import int_from_bytes Jul 14 09:28:59.893068 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 09:28:59.893688 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 09:28:59.893688 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 09:28:59.894103 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 09:28:59.894207 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 09:28:59.894306 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 09:28:59.894376 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 09:28:59.894443 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 09:28:59.894521 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 09:28:59.894595 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 09:28:59.894719 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.894866 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.895037 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.895145 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.895352 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.895446 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.895663 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.895750 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.895986 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.896070 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.896290 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.896383 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.896604 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.896689 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.896917 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.897018 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.897240 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.897344 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.897496 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.897592 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.898358 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.898456 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.898678 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-26-iscsi {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.898766 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-26-iscsi {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.898996 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.899096 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.899298 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.899391 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.899604 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.899689 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.899918 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.900003 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.900216 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.900300 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.900532 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.900618 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.900832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.900916 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.901322 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.901718 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.901718 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.901959 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.902081 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.902232 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.902356 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.902475 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.902674 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.902824 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.902971 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.903095 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.903276 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.903405 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.903591 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.903717 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.903892 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.904025 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.904208 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.904342 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.904509 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.904636 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.904900 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-26-iscsi {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.905037 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-26-iscsi {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.905212 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.905346 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.905524 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.905652 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.905835 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.905962 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.906263 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.906427 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.906564 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.906688 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.906868 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.906997 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.907185 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.907320 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.907554 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.907689 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.907823 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.907958 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.908116 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.908252 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.908472 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.908616 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.908750 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.908884 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.909044 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.909183 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.909341 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.909471 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.909647 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.909787 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.909948 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.910075 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.910285 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.910434 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.910577 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.910702 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.910874 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.911003 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.911128 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.911258 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.911395 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.911521 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.911707 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.911836 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.912023 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.912161 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.912339 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.912471 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.912599 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.912742 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.912869 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.913003 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.913131 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.913265 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.913959 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.914100 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.914288 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.914418 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.914594 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.914737 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.914893 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.915019 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.915194 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.915323 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.915485 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.915610 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.915780 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.915909 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.916079 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.916219 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.916379 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.916507 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.916690 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.916819 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.916999 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.917126 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.917312 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.917440 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.917611 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.917752 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.917922 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.918060 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.918334 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.918478 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.918624 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.918829 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.918958 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.919088 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.919220 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.919353 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.919499 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.919638 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.919802 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.919930 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.920112 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.920239 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.920426 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.920568 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.920726 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.920860 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.921026 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.921154 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.921365 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.921501 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.921681 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.921817 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.922008 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.922138 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.922335 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.922466 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.922603 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.922737 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.922869 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.922995 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.923154 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.923291 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.923466 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.923593 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.923764 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.923898 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.924062 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.924200 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.924359 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.924487 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.924652 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.924779 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.924949 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.925077 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.925246 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.925379 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.925543 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.925680 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.925825 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.925949 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.926126 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.926291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.926435 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.926570 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.926734 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.926871 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.927031 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.927158 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.927330 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.927466 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.927641 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.927776 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.927954 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.928082 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.928252 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.928388 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.928549 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.928677 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.928847 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.928990 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.929169 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.929310 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.929483 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.929612 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.929784 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.929920 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.930082 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.930247 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.930425 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.930561 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.930724 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.930851 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.931022 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.931159 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.931332 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.931464 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.931632 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.931759 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.931929 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.932069 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.932239 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.932373 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.932536 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.932673 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.932837 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.932967 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.933147 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.933274 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.933446 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.933575 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.933744 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.933872 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.934038 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.934165 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.934343 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.934480 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.934647 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.934778 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.934944 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.935071 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.935238 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.935365 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.935534 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.935670 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.935826 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.935961 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.936137 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.936273 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.936449 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.936578 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.936753 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.936882 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.937055 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.937193 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.937356 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.937492 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.937668 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.937799 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:28:59.937996 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.938135 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.938346 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.938476 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.938683 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.938824 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.938993 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.939136 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.939321 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.939450 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.939655 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.939783 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.939968 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.940095 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.940276 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.940403 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.940584 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.940711 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.940903 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.941039 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.941208 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.941336 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.941515 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.941650 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.941822 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.941950 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.942132 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.942316 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.942471 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.942624 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.942792 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.942921 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.943103 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.943231 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.943415 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.943537 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.943726 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.943860 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.944031 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.944175 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.944341 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.944478 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.944687 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.944823 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.945006 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.945138 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.945311 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.945448 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.945645 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.945773 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.945984 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.946111 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.946314 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.946456 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.946638 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.946767 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.946954 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.947084 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.947263 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.947403 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.947571 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.947701 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.947878 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.948007 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.948193 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.948329 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.948515 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.948643 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.948824 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.948963 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.949137 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.949265 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.949443 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.949572 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.949747 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.949883 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.950053 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.950182 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.950385 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.950523 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.950691 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.950819 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.951019 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.951154 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.951329 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.951458 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.951637 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.951764 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.951943 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.952080 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.952259 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.952389 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.952567 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.952705 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.952875 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.953012 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.953183 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.953320 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.953484 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.953623 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.953784 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.953916 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.954085 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.954256 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.954416 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.954556 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.954718 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.954847 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.955036 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.955165 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.955357 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.955493 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.955657 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.955784 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.955980 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.956107 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.956280 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.956409 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.956584 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.956713 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.956888 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.957016 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.957191 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.957319 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.957490 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.957626 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.957795 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.957922 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.958097 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.958268 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.958413 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.958546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.958730 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.958865 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.959035 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.959233 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.959345 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.959449 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.959638 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.959783 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.959941 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.960077 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.960762 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.960902 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.961075 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.961212 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.961381 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.961519 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.961690 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.961819 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.961997 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.962139 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.962327 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.962459 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.962648 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.962778 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.962954 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.963093 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.963260 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.963388 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.963588 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.963717 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.963912 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.964027 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.964210 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.964346 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.964527 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.964655 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.964845 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.964975 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.965152 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.965281 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.965449 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.965576 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.965754 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.965888 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.966050 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.966244 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.966384 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.966511 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.966645 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.966772 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.966950 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.967079 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.967247 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.967383 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.967546 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.967674 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.967844 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.967981 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.968142 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.968348 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.968475 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.968601 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.968747 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.968876 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.969050 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.969189 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.969351 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.969672 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.969807 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.969997 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.970127 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.970360 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.970493 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.970666 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.970803 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.971000 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.971139 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.971329 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.971467 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.971643 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.971784 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.971963 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.972101 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.972272 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.972403 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.972578 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.972705 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.972883 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.973021 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.973192 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.973326 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.973497 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.973625 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.973801 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.973941 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.974111 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.974268 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.974441 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.974569 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.974752 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.974893 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.975059 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.975187 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.975366 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.975493 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.975670 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.975817 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.976558 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.976700 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.976866 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.976995 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.977179 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.977309 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.977517 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.977649 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.977848 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.977970 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.978160 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.978313 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.978510 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.978625 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.978823 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.978979 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.979131 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.979275 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.979612 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.979747 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.980185 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.980324 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.980628 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.980757 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.981055 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.981315 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.981493 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.981732 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.981946 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.982159 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.982412 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.982679 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.982841 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.983016 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.983016 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.983312 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.983466 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.983637 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.983798 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.984200 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.984348 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.985089 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.985222 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.985424 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.985660 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.985802 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.986068 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.986222 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.986409 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.986547 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.986738 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.986875 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.987054 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.987190 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.987362 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.987503 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.987671 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.987806 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.987978 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.988117 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.988281 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.988416 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.988587 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.988715 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.988890 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.989026 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.989195 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.989331 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.989501 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.989630 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.989804 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.989935 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.990106 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.990265 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.990450 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.990590 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.990752 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.990887 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.991056 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.991201 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.991360 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.991517 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.991688 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.991825 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.991989 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.992127 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.992295 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.992435 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.992613 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.992751 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.992912 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.993055 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.993215 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.993351 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.993530 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.993664 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.993831 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.993968 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.994129 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.994312 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.994450 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.994577 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.994745 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.994882 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.995051 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.995184 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.995352 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.995492 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.995655 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.995784 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.995964 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.996092 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.996281 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.996420 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.996566 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.996696 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.996875 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.997010 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.997180 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.997320 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.997482 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.997611 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.997794 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.997930 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.998099 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.998257 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.998427 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.998556 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.998737 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.998877 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.999045 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.999184 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.999352 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.999533 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.999670 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.999849 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:28:59.999988 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.000191 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.000324 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.000451 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.000585 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.000755 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.000893 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.001077 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.001207 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.001383 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.001519 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.001691 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.001830 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.001996 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.002296 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.002445 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.002616 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.002744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.002925 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.003063 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.003241 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.003475 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.003596 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.003802 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.003941 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.004113 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.004252 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.004429 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.004570 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.004745 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.004876 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.005059 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.005198 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.005370 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.005498 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.005671 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.005813 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.005972 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.006108 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.006301 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.006445 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.006603 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.006734 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.006901 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.007547 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.007742 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.007884 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.008018 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.008153 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.008283 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.008419 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.008581 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.008719 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.008881 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.009019 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.009179 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.009314 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.009477 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.009615 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.009775 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.009909 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.010071 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.010254 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.010397 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.010530 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.010702 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.010829 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.011003 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.011133 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.011299 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.011432 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.011597 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.011736 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.011893 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.012021 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.012228 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.012359 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.012530 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.012673 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.012861 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.012992 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.013160 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.013288 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.013499 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.013637 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.013798 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.013932 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.014101 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.014258 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.014451 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.014598 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.014753 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.014914 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.015043 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.015220 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.015362 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.015544 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.015685 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.015845 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.015974 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.016146 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.016285 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.016448 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.016578 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.016750 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.016879 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.017055 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.017193 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.017360 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.017489 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.017659 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.017788 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.017962 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.018101 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.018277 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.018397 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.018582 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.018721 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.018885 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.019013 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.019181 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.019309 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.019478 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.019617 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.019756 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.019887 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.020069 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.020208 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.020364 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.020498 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.020661 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.020802 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.020956 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.021085 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.021260 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.021387 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.021556 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.021697 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.021853 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.021990 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.022148 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.022318 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.022453 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.022577 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.023292 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.023434 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.023595 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.023735 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.023892 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.024019 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.024191 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.024320 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.024494 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.024700 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.024829 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.024960 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.025085 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.025208 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.025372 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.025512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.025674 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.025808 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.025972 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.026099 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.026301 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.026439 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.026610 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.026746 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.026909 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.027037 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.027208 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.027342 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.027505 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.027643 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.027806 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.027936 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.028106 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.028246 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.028404 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.028537 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.028700 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.028828 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.028998 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.029126 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.029293 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.029420 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.029591 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.029727 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.029886 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.030014 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.030200 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.030330 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.030521 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.030663 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.030824 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.030961 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.031125 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.031254 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.031425 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.031567 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.031763 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.031899 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.032063 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.032193 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.032383 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.032524 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.032667 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.032793 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.032969 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.033099 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.033302 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.033440 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.033600 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.033734 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.033903 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.034038 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.034242 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.034387 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.034549 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.034685 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.034860 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.034989 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.035164 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.035302 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.035469 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.035596 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.035767 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.035894 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.036067 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.036203 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.036376 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.036510 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.036679 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.036820 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.036983 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.037113 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.037279 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.037407 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.037580 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.037717 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.037896 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.038035 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.038223 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.038373 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.038595 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.038740 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.038908 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.039044 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.039213 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.039343 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.039518 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.039656 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.039823 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.039952 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.040126 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.040256 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.040430 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.040567 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.040738 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.040866 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.041040 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.041167 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.041344 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.041472 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.041644 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.041780 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.041948 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.042074 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.042272 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.042414 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.042578 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.042708 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.042879 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.043007 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.043181 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.043310 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.043479 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.043606 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.043781 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.043918 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.044078 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.044213 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.044384 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.044520 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.044683 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.044821 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.044979 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.045105 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.045393 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.045546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.045763 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.045911 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.046038 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.046163 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.046340 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.046466 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.046601 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.046738 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.046909 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.047039 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.047220 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.047355 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.047519 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.047661 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.047893 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.048028 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.048201 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.048329 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.048511 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.048647 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.048813 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.048949 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.049110 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.049237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.049407 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.049543 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.049711 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.049840 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.050026 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.050162 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.050350 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.050489 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.050658 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.050787 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.050959 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.051089 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.051275 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.051405 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.051576 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.051706 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.051873 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.052010 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.052175 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.052304 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.052475 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.052609 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.052790 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.052994 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.053130 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.053256 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.053386 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.053552 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.053784 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.053944 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.054137 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.054312 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.054468 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.054609 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.054877 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.055007 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.055175 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.055311 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.055479 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.055614 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.055781 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.055916 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.056097 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.056238 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.056412 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.056548 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.056709 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.056838 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.057015 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.057150 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.057316 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.057447 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.057630 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.057757 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.057945 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.058081 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.058272 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.058402 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.058584 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.058713 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.058886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.059017 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.059203 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.059332 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.059518 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.059656 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.059826 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.059955 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.060141 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.060270 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.060484 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.060621 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.060790 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.060927 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.061095 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.061225 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.061397 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.061536 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.061774 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.061904 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.062096 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.062276 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.062431 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.062571 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.062739 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.062869 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.063039 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.063174 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.063373 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.063501 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.063628 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.063758 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.063915 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.064045 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.064224 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.064352 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.064522 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.064652 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.064823 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.064950 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.065123 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.065259 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.065423 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.065553 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.065739 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.065868 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.066036 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.066165 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.066376 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.066507 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.066683 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.066814 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.066983 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.067114 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.067281 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.067418 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.067581 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.067723 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.067895 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.068024 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.068200 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.068328 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.068499 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.068640 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.068797 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.068920 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.069097 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.069227 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.069422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.070082 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.070293 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.070431 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.070615 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.070745 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.070927 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.071064 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.071242 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.071372 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.071549 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.071677 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.071846 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.071977 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.072146 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.072284 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.072452 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.072581 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.072751 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.072889 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.073050 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.073181 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.073350 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.073481 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.073652 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.073790 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.073949 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.074080 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.074270 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.074408 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.074570 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.074699 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.074867 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.075002 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.075169 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.075310 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.075464 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.075592 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.075763 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.075892 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.076058 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.076193 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.076356 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.076486 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.076783 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.076964 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.077104 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.077268 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.077401 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.077568 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.077698 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.077864 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.077995 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.078161 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.078341 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.078521 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.078651 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.078819 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.078949 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.079145 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.079274 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.079455 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.079584 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.079771 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.079908 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.080084 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.080218 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.080386 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.080514 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.080698 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.080833 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.081009 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.081145 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.081316 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.081452 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.081620 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.081748 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.081925 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.082059 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.082253 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.082395 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.082564 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.082691 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.082874 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.083080 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.083210 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.083408 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.083541 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.083722 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.083852 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.084033 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.084171 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.084345 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.084574 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.084704 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.084901 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.085031 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.085257 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.085879 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.086059 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.086202 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.086397 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.086528 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.086710 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.086848 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.087024 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.087154 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.087337 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.087473 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.087648 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.087781 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.087957 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.088086 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.088265 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.088407 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.088588 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.088724 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.088897 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.089026 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.089207 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.089345 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.089560 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.089694 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.089869 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.089997 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.090170 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.090316 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.090501 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.090639 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.090815 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.090943 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.091123 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.091252 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.091429 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.091566 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.091736 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.091867 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.092047 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.092178 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.092357 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.092494 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.092664 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.092869 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.092998 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.093134 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.093261 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.093385 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.093560 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.093698 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.093872 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.094009 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.094179 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.094346 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.094509 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.094649 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.094820 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.094958 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.095130 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.095259 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.095450 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.095580 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.095782 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.095996 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.096126 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.096311 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.096449 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.096642 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.096771 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.096966 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.097102 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.097288 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.097491 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.097621 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.097803 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.097933 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.098132 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.098293 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.098479 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.098608 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.098800 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.098929 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.099108 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.099246 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.099416 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.099546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.099718 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.099847 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.100036 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.100179 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.100343 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.100480 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.100651 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.100798 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.100993 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.101135 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.101298 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.101435 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.101618 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.101818 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.101962 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.102161 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.102346 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.102502 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.102644 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.102825 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.102964 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.103146 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.103343 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.103474 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.103686 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.103822 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.103999 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.104129 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.104322 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.104458 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.104635 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.104771 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.104946 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.105074 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.105250 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.105378 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.105552 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.105691 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.105852 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.105981 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.106150 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.106310 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.106477 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.106615 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.106779 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.106917 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.107085 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.107214 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.107386 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.107528 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.107708 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.107839 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.108009 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.108146 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.108308 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.108448 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.108616 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.108754 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.108917 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.109053 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.109239 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.109380 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.109787 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.109922 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.110094 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.110292 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.110439 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.110573 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.110722 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.110854 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.111021 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.111149 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.111323 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.111453 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.111622 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.111750 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.111918 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.112055 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.112217 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.112352 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.112512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.112647 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.112817 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.112956 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.113119 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.113249 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.113425 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.113562 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.113725 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.113863 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.114031 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.114162 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.114360 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.114489 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.114679 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.114818 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.114987 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.115124 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.115285 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.115413 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.115602 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.115746 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.115900 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.116031 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.116219 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.116454 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.116590 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.116787 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.116925 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.117101 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.117238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.117429 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.117573 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.117756 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.117976 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.118106 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.118331 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.118462 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.118648 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.118779 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.118967 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.119095 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.119275 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.119411 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.119580 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.119709 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.119882 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.120011 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.120184 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.120322 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.120487 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.120616 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.120797 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.120926 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.121099 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.121239 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.121401 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.121530 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.121705 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.121835 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.122008 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.122231 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.122363 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.122487 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.122612 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.122737 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.122915 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.123046 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.123216 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.123344 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.123521 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.123657 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.123826 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.123956 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.124131 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.124260 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.124438 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.124614 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.124827 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.125018 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.125227 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.125380 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.125493 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.125614 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.125749 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.125859 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.126018 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.126150 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.126366 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.126510 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.126675 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.126805 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.126983 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.127113 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.127289 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.127428 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.127594 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.127766 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.127905 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.128074 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.128204 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.128389 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.128520 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.128706 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.128835 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.129014 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.129193 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.129324 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.129501 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.129623 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.129817 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.129947 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.130133 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.130301 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.130469 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.130599 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.130788 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.130918 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.131106 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.131249 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.131414 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.131551 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.131729 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.131868 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.132545 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.132682 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.132881 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.133012 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.133189 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.133327 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.133498 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.133633 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.133814 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.133946 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.134120 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.134283 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.134447 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.134576 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.134746 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.134874 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.135052 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.135181 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.135351 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.135479 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.135654 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.135784 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.135951 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.136080 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.136250 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.136379 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.136550 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.136677 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.136847 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.136976 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.137144 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.137272 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.137441 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.137570 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.137737 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.137865 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.138033 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.138162 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.138339 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.138476 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.138640 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.138770 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.138937 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.139065 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.139234 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.139375 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.139532 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.139660 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.139827 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.139956 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.140124 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.140263 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.140420 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.140547 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.140723 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.140853 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.141023 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.141162 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.141323 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.141451 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.141621 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.141750 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.141946 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.142083 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.142277 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.142408 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.142597 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.142724 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.142912 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.143041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.143257 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.143393 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.143520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.143651 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.143822 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.143950 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.144127 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.144256 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.144436 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.144576 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.144742 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.144879 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.145042 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.145169 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.145345 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.145483 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.145653 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.145782 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.145959 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.146086 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.146289 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.146435 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.146596 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.146724 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.146901 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.147036 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.147207 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.147346 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.147521 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.147668 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.148368 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.148508 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.148672 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.148801 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.148996 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.149125 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.149305 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.149435 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.149613 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.149751 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.149920 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.150058 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.150248 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.150379 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.150557 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.150688 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.150871 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.151001 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.151177 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.151381 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.151510 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.151636 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.151761 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.151885 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.152072 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.152216 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.152384 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.152513 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.152690 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.152821 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.152995 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.153134 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.153308 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.153437 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.153620 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.153748 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.153943 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.154081 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.154278 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.154408 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.154587 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.154714 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.154910 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.155041 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.155227 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.155363 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.155569 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.155699 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.155875 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.156006 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.156139 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 09:29:00.156266 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.156522 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.156832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.157140 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.157442 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:29:00.157683 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 09:29:00.217846 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO dbcounter [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Registered counter for database nova_api Jul 14 09:29:00.218816 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Registered counter for database nova_api Jul 14 09:29:00.331247 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG oslo_db.sqlalchemy.engines [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:29:00.332902 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:29:00.338388 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writer thread running {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:29:00.339985 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:29:00.394457 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.context [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11929b56-3cfc-42c6-a919-563dcd828b94(cell1) {{(pid=103391) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 09:29:00.395370 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.context [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11929b56-3cfc-42c6-a919-563dcd828b94(cell1) {{(pid=103392) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 09:29:00.398341 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG oslo_concurrency.lockutils [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:29:00.399311 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:29:00.399916 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG oslo_concurrency.lockutils [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:29:00.400696 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG oslo_concurrency.lockutils [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:29:00.400865 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:29:00.401636 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:29:00.402810 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG oslo_concurrency.lockutils [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:29:00.403757 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:29:00.404757 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO dbcounter [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Registered counter for database nova_cell0 Jul 14 09:29:00.405772 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Registered counter for database nova_cell0 Jul 14 09:29:00.408848 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO dbcounter [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Registered counter for database nova_cell1 Jul 14 09:29:00.409537 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Registered counter for database nova_cell1 Jul 14 09:29:00.415891 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG oslo_db.sqlalchemy.engines [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:29:00.417522 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:29:00.420683 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writer thread running {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:29:00.421436 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG oslo_db.sqlalchemy.engines [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:29:00.424384 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:29:00.426949 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:29:00.563876 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writer thread running {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:29:00.566086 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:29:00.573508 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO dbcounter [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Registered counter for database nova_cell0 Jul 14 09:29:00.575669 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO dbcounter [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Registered counter for database nova_cell0 Jul 14 09:29:00.581942 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG oslo_db.sqlalchemy.engines [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:29:00.586542 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writer thread running {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:29:00.589264 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_db.sqlalchemy.engines [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:29:00.594540 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writer thread running {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:29:00.923897 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 09:29:00.926977 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: WARNING keystonemiddleware.auth_token [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 09:29:00.931658 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 09:29:00.934761 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: WARNING keystonemiddleware.auth_token [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 09:29:01.269260 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 09:29:01.275785 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: WARNING keystonemiddleware.auth_token [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 09:29:01.280807 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: WARNING keystonemiddleware.auth_token [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 09:29:01.281018 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2ae18b9c0 pid: 103392 (default app) Jul 14 09:29:01.283093 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:29:01.284248 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Jul 14 09:29:01.284659 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Thu Jul 14 09:29:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:29:01.286794 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: WARNING keystonemiddleware.auth_token [None req-6971f430-9dca-47c2-bc40-ad79ced54557 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 09:29:01.292726 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2ae18b9c0 pid: 103391 (default app) Jul 14 09:30:18.037152 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:18.038159 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 14 09:30:18.038905 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:18.050825 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_api:SELECT=3 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:18.051828 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_cell1:SELECT=3 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:18.052828 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_cell0:SELECT=3 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:18.053582 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:18.958650 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-ec81b16e-17bb-42fe-8962-f48459e8cfe2 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:18.997483 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-ec81b16e-17bb-42fe-8962-f48459e8cfe2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.951816 Jul 14 09:30:19.006540 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 14 09:30:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:30:21.318564 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:21.319573 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-334eaf68-b9b7-432b-82bd-e70d9272cef5 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 14 09:30:21.320196 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:21.812327 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-f734bc88-e4ea-4724-a1f0-695827fb9422 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:21.830273 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:30:21.830273 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: warnings.warn(msg) Jul 14 09:30:21.859728 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-f734bc88-e4ea-4724-a1f0-695827fb9422 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533653 Jul 14 09:30:21.860279 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:30:22.098564 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-221a3901-9eeb-456a-9d97-580eec1da995 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:22.101245 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:30:22.101245 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 14 09:30:22.104275 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:22.105098 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:22.105794 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell1:SELECT=3 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:22.106764 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:22.174241 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-221a3901-9eeb-456a-9d97-580eec1da995 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.305002 Jul 14 09:30:22.175114 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 09:30:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:30:24.493624 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-f734bc88-e4ea-4724-a1f0-695827fb9422 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:24.494935 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-f734bc88-e4ea-4724-a1f0-695827fb9422 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001844 Jul 14 09:30:24.495600 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:25.393860 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-57d9aab2-871b-4edc-a5c5-dbe03de621ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:25.412739 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:30:25.412739 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 14 09:30:25.435931 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-57d9aab2-871b-4edc-a5c5-dbe03de621ca admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.933829 Jul 14 09:30:25.436525 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:30:25.448623 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-42d49b77-7801-4e59-a8b3-c53f05345d01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:25.450321 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:30:25.450321 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: warnings.warn(msg) Jul 14 09:30:25.486139 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-42d49b77-7801-4e59-a8b3-c53f05345d01 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041359 Jul 14 09:30:25.494977 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 09:30:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:30:27.831662 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-57d9aab2-871b-4edc-a5c5-dbe03de621ca admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:27.833009 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-57d9aab2-871b-4edc-a5c5-dbe03de621ca admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Jul 14 09:30:27.833416 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:28.349501 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-2d897504-a36d-4d72-af6b-119dbae71aae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:28.370766 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-2d897504-a36d-4d72-af6b-119dbae71aae admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531165 Jul 14 09:30:28.371753 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:30:28.384845 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-1bf91da6-5185-4eab-9f3b-9ef3849c9340 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:28.414686 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-1bf91da6-5185-4eab-9f3b-9ef3849c9340 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033475 Jul 14 09:30:28.415374 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 09:30:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:30:30.771247 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-2d897504-a36d-4d72-af6b-119dbae71aae admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:30.773411 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-2d897504-a36d-4d72-af6b-119dbae71aae admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002885 Jul 14 09:30:30.774745 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:31.361847 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-cd8c517f-8f59-419b-a016-2fcd21619f85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "name": "ds2G", "ram": 2048}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:31.388946 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-cd8c517f-8f59-419b-a016-2fcd21619f85 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.608578 Jul 14 09:30:31.389490 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:30:31.402876 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-7f44103b-3baf-401b-bce1-fa4dccca8799 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:31.433244 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-7f44103b-3baf-401b-bce1-fa4dccca8799 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035480 Jul 14 09:30:31.444658 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 09:30:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:30:33.752386 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-cd8c517f-8f59-419b-a016-2fcd21619f85 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:33.754024 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-cd8c517f-8f59-419b-a016-2fcd21619f85 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Jul 14 09:30:33.754681 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:34.301093 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-cf3e34a2-4692-4df1-a73e-0fe22221c82a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "ram": 4096, "swap": 0}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:34.330255 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-cf3e34a2-4692-4df1-a73e-0fe22221c82a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.568872 Jul 14 09:30:34.331248 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:30:34.345035 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-8f630d62-1939-43c2-81a7-d76b1dc8ded3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:34.385121 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-8f630d62-1939-43c2-81a7-d76b1dc8ded3 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045738 Jul 14 09:30:34.387507 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Thu Jul 14 09:30:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:30:36.830083 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-cf3e34a2-4692-4df1-a73e-0fe22221c82a admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:36.831865 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-cf3e34a2-4692-4df1-a73e-0fe22221c82a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002888 Jul 14 09:30:36.833533 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:37.311651 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-3489d1e4-af4d-4f27-bf89-af25fba0d131 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:37.335977 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-3489d1e4-af4d-4f27-bf89-af25fba0d131 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.495382 Jul 14 09:30:37.336794 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 14 09:30:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:30:40.102752 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-cf3e34a2-4692-4df1-a73e-0fe22221c82a admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:40.103771 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-cf3e34a2-4692-4df1-a73e-0fe22221c82a admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 14 09:30:40.104176 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:40.558710 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-5f5c9880-4e1f-43b9-b3f2-6d365a497325 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "id": "1", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:40.581765 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-5f5c9880-4e1f-43b9-b3f2-6d365a497325 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.470420 Jul 14 09:30:40.582480 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:30:40.597306 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-1268a9cf-8923-467c-942f-2147d06f996d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:40.624199 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-1268a9cf-8923-467c-942f-2147d06f996d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031660 Jul 14 09:30:40.624774 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 09:30:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:30:42.846499 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-5f5c9880-4e1f-43b9-b3f2-6d365a497325 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:42.847685 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-5f5c9880-4e1f-43b9-b3f2-6d365a497325 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Jul 14 09:30:42.848158 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:43.239355 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-32c77823-0675-4dfb-a930-ba32872b0e76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:43.258684 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-32c77823-0675-4dfb-a930-ba32872b0e76 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.404510 Jul 14 09:30:43.259241 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:30:43.271346 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-122b682e-e26e-4a32-b356-70cf6a72d122 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:43.294058 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-122b682e-e26e-4a32-b356-70cf6a72d122 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026453 Jul 14 09:30:43.294682 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 09:30:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:30:45.519992 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-32c77823-0675-4dfb-a930-ba32872b0e76 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:45.521521 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-32c77823-0675-4dfb-a930-ba32872b0e76 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002215 Jul 14 09:30:45.521926 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:45.926946 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-0c2d852f-6b9d-401f-8ffd-98d8803458a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:45.945002 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-0c2d852f-6b9d-401f-8ffd-98d8803458a6 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.416935 Jul 14 09:30:45.946089 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:30:45.958529 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-bd4d71c2-3c66-4271-8086-715efe27c7cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:45.981569 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-bd4d71c2-3c66-4271-8086-715efe27c7cf admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026794 Jul 14 09:30:45.982700 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 09:30:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:30:48.306368 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-0c2d852f-6b9d-401f-8ffd-98d8803458a6 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:48.308166 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-0c2d852f-6b9d-401f-8ffd-98d8803458a6 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002253 Jul 14 09:30:48.308891 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:48.823756 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3f4f918d-d4f9-4340-9ca2-d4051c0cce65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:48.828378 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:30:48.846794 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3f4f918d-d4f9-4340-9ca2-d4051c0cce65 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.531502 Jul 14 09:30:48.848116 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:30:48.861015 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-7296824b-c41c-4430-a40f-1397aa809dde admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:48.888596 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-7296824b-c41c-4430-a40f-1397aa809dde admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031864 Jul 14 09:30:48.900922 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 09:30:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:30:51.127758 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3f4f918d-d4f9-4340-9ca2-d4051c0cce65 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:30:51.128776 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3f4f918d-d4f9-4340-9ca2-d4051c0cce65 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 14 09:30:51.129361 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:30:51.561623 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-22d11bd6-fc85-4987-92aa-61cd8c45625b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:51.584245 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-22d11bd6-fc85-4987-92aa-61cd8c45625b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449358 Jul 14 09:30:51.584800 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Thu Jul 14 09:30:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:30:51.599164 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-a120a1ae-3fb8-49f7-a45a-8bf039a1b248 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:30:51.625789 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-a120a1ae-3fb8-49f7-a45a-8bf039a1b248 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032823 Jul 14 09:30:51.626391 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Thu Jul 14 09:30:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:31:11.009007 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-22d11bd6-fc85-4987-92aa-61cd8c45625b admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:11.010005 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-22d11bd6-fc85-4987-92aa-61cd8c45625b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 14 09:31:11.010438 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:11.020652 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:11.405126 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-7545738c-2ae0-4e61-a9c7-04f1a0bc6340 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:11.422439 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-7545738c-2ae0-4e61-a9c7-04f1a0bc6340 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406200 Jul 14 09:31:11.422961 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 14 09:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:31:12.490557 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-22d11bd6-fc85-4987-92aa-61cd8c45625b admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:12.491554 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-22d11bd6-fc85-4987-92aa-61cd8c45625b admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 14 09:31:12.491950 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:31:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:13.012698 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-83c21d43-6ff7-4781-bf79-094bff71462d admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:13.018938 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.wsgi [None req-83c21d43-6ff7-4781-bf79-094bff71462d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-83c21d43-6ff7-4781-bf79-094bff71462d admin admin] Request method failure captured: Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Accept: application/json Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Accept-Encoding: gzip, deflate Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Connection: keep-alive Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Content-Length: 0 Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Host: 10.222.0.40 Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Openstack-Api-Version: compute 2.90 Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Openstack-System-Scope: None Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: User-Agent: python-novaclient Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Auth-Token: gAAAAABiz-JgarjJkc3emVS8-maTAr7LSzE7hlE4-3BLmuIRXhus46TFmWOpZ1MoH1AaVE3YJmgw7P51U23fu-Xqn1z1WWWn_qot8F6wY_cVz2EwXulOM2Wioj_7IAO1LrVYKhGAWVAVRuftGamk286RS9jXYDYgOUE-jgKWF4-7Ec5yva6G7is Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Domain-Id: None Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Domain-Name: None Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Identity-Status: Confirmed Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Is-Admin-Project: True Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Domain-Id: default Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Domain-Name: Default Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Name: admin Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Role: reader,member,admin Jul 14 09:31:13.022237 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Roles: reader,member,admin Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant: admin Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant-Name: admin Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User: admin Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Domain-Id: default Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Domain-Name: Default Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Id: d3cc085bb5914250a5e384092f9f12f8 Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Name: admin Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: method: > Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: exception: Flavor 42 could not be found. Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: action_args: {'id': '42'} Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:31:13.023960 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:13.024808 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.025979 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-83c21d43-6ff7-4781-bf79-094bff71462d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:31:13.027137 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-83c21d43-6ff7-4781-bf79-094bff71462d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386764 Jul 14 09:31:13.027137 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 14 09:31:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:13.033064 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-7d5e8b51-ff7a-40b7-9499-435a37b508ff admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:13.035885 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:31:13.055105 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-7d5e8b51-ff7a-40b7-9499-435a37b508ff admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025534 Jul 14 09:31:13.055635 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 09:31:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:31:13.065612 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-813fbb03-8593-4c81-bf1a-087e46bce908 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:13.087211 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-813fbb03-8593-4c81-bf1a-087e46bce908 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025061 Jul 14 09:31:13.087682 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 09:31:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:31:13.096765 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-3978eb73-9220-4790-a120-ee720e2378a2 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:13.103697 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-3978eb73-9220-4790-a120-ee720e2378a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-3978eb73-9220-4790-a120-ee720e2378a2 admin admin] Request method failure captured: Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Accept: application/json Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Host: 10.222.0.40 Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABiz-JgarjJkc3emVS8-maTAr7LSzE7hlE4-3BLmuIRXhus46TFmWOpZ1MoH1AaVE3YJmgw7P51U23fu-Xqn1z1WWWn_qot8F6wY_cVz2EwXulOM2Wioj_7IAO1LrVYKhGAWVAVRuftGamk286RS9jXYDYgOUE-jgKWF4-7Ec5yva6G7is Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Role: reader,member,admin Jul 14 09:31:13.107223 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Roles: reader,member,admin Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User: admin Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Id: d3cc085bb5914250a5e384092f9f12f8 Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: method: > Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: exception: Flavor 42 could not be found. Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: action_args: {'id': '42'} Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:31:13.109238 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:13.110349 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:13.111693 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-3978eb73-9220-4790-a120-ee720e2378a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:31:13.112884 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-3978eb73-9220-4790-a120-ee720e2378a2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015881 Jul 14 09:31:13.112884 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 14 09:31:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:14.069454 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-813fbb03-8593-4c81-bf1a-087e46bce908 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:14.070496 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-813fbb03-8593-4c81-bf1a-087e46bce908 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 14 09:31:14.070900 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:14.588505 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a830151d-25e6-4652-bf9e-e3f35e505a37 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:14.594361 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-a830151d-25e6-4652-bf9e-e3f35e505a37 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a830151d-25e6-4652-bf9e-e3f35e505a37 admin admin] Request method failure captured: Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Accept: application/json Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Host: 10.222.0.40 Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABiz-Jh56suI6pXUbejgpH63XfwmmFKnscawN3ymMJrIivpwSe6rMXF7Si0OsRh2aMvvnnJZIrDfd-ikxpTtx2XjO78jjyq05MwjOGcU0MGelxfqp6-ABNsAxaKU8HJKnmTsyz8MeHdo08p_t1tr5herMHW_zVAO2WdFvdjjyQYmBaJwVs Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Role: reader,member,admin Jul 14 09:31:14.595886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Roles: reader,member,admin Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User: admin Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Id: d3cc085bb5914250a5e384092f9f12f8 Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: method: > Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: exception: Flavor 84 could not be found. Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: action_args: {'id': '84'} Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:31:14.597436 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:14.598582 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.600022 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-a830151d-25e6-4652-bf9e-e3f35e505a37 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:31:14.601335 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-a830151d-25e6-4652-bf9e-e3f35e505a37 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388631 Jul 14 09:31:14.601335 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 14 09:31:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:14.607124 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3c036789-ef83-4eda-8bd7-e4b0f4583c8e admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:14.621220 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3c036789-ef83-4eda-8bd7-e4b0f4583c8e admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017918 Jul 14 09:31:14.621733 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 09:31:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:31:14.631398 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-5219eaf3-90b1-4c92-879c-e48eb1b67af7 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:14.645632 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-5219eaf3-90b1-4c92-879c-e48eb1b67af7 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017604 Jul 14 09:31:14.646200 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 09:31:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:31:14.656818 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-cb1c724a-c6dc-4f12-ab32-9bbf942229b8 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:14.662131 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.wsgi [None req-cb1c724a-c6dc-4f12-ab32-9bbf942229b8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-cb1c724a-c6dc-4f12-ab32-9bbf942229b8 admin admin] Request method failure captured: Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Accept: application/json Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Accept-Encoding: gzip, deflate Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Connection: keep-alive Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Content-Length: 0 Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Host: 10.222.0.40 Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Openstack-Api-Version: compute 2.90 Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Openstack-System-Scope: None Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: User-Agent: python-novaclient Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Auth-Token: gAAAAABiz-Jh56suI6pXUbejgpH63XfwmmFKnscawN3ymMJrIivpwSe6rMXF7Si0OsRh2aMvvnnJZIrDfd-ikxpTtx2XjO78jjyq05MwjOGcU0MGelxfqp6-ABNsAxaKU8HJKnmTsyz8MeHdo08p_t1tr5herMHW_zVAO2WdFvdjjyQYmBaJwVs Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Domain-Id: None Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Domain-Name: None Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Identity-Status: Confirmed Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Is-Admin-Project: True Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Domain-Id: default Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Domain-Name: Default Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Name: admin Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Role: reader,member,admin Jul 14 09:31:14.663660 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Roles: reader,member,admin Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant: admin Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant-Name: admin Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User: admin Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Domain-Id: default Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Domain-Name: Default Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Id: d3cc085bb5914250a5e384092f9f12f8 Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Name: admin Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: method: > Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: exception: Flavor 84 could not be found. Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: action_args: {'id': '84'} Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:31:14.665195 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:14.666422 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:14.667744 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-cb1c724a-c6dc-4f12-ab32-9bbf942229b8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:31:14.669162 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-cb1c724a-c6dc-4f12-ab32-9bbf942229b8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012882 Jul 14 09:31:14.669162 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Thu Jul 14 09:31:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:15.631025 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-5219eaf3-90b1-4c92-879c-e48eb1b67af7 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:15.632069 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-5219eaf3-90b1-4c92-879c-e48eb1b67af7 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 14 09:31:15.632465 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:16.145080 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-71c2e560-4c44-4c4e-ad1b-141d37c5cf1c admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:16.151008 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.wsgi [None req-71c2e560-4c44-4c4e-ad1b-141d37c5cf1c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-71c2e560-4c44-4c4e-ad1b-141d37c5cf1c admin admin] Request method failure captured: Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Accept: application/json Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Accept-Encoding: gzip, deflate Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Connection: keep-alive Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Content-Length: 0 Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Host: 10.222.0.40 Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Openstack-Api-Version: compute 2.90 Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Openstack-System-Scope: None Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: User-Agent: python-novaclient Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Auth-Token: gAAAAABiz-JjIZpMCIm06Tate0rzy4xrl6NMuUmrC6wpgCIr6IvG5NU-9-QMxTaww27GJTVvuVo5CGElBjDXTN_oQvQjw4qs2_zkxDz9CCKeMARcptUVYCukI-BAOeSNmoexFOA6YCaEekF0Y3FiJJuQPw5qHOvNxJtOzWqVUgEr_5v41JPZWMQ Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Domain-Id: None Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Domain-Name: None Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Identity-Status: Confirmed Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Is-Admin-Project: True Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Domain-Id: default Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Domain-Name: Default Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Project-Name: admin Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Role: reader,member,admin Jul 14 09:31:16.152520 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Roles: reader,member,admin Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant: admin Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-Tenant-Name: admin Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User: admin Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Domain-Id: default Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Domain-Name: Default Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Id: d3cc085bb5914250a5e384092f9f12f8 Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: X-User-Name: admin Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: method: > Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: exception: Flavor 451 could not be found. Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: action_args: {'id': '451'} Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:31:16.154230 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:16.155291 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.156735 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-71c2e560-4c44-4c4e-ad1b-141d37c5cf1c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:31:16.158004 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-71c2e560-4c44-4c4e-ad1b-141d37c5cf1c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.383467 Jul 14 09:31:16.158004 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 09:31:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:16.163450 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-043845c1-21aa-4cdf-87ea-bc20f26ccc89 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:16.177273 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-043845c1-21aa-4cdf-87ea-bc20f26ccc89 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017356 Jul 14 09:31:16.177789 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 09:31:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:31:16.187396 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:16.202175 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018818 Jul 14 09:31:16.202769 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Thu Jul 14 09:31:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:31:16.212307 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-961ca97c-8cf0-4827-b8ac-c80f3be9dbe2 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:16.217534 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.wsgi [None req-961ca97c-8cf0-4827-b8ac-c80f3be9dbe2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-961ca97c-8cf0-4827-b8ac-c80f3be9dbe2 admin admin] Request method failure captured: Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Accept: application/json Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Accept-Encoding: gzip, deflate Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Connection: keep-alive Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Content-Length: 0 Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Host: 10.222.0.40 Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Openstack-Api-Version: compute 2.90 Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Openstack-System-Scope: None Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: User-Agent: python-novaclient Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Auth-Token: gAAAAABiz-JjIZpMCIm06Tate0rzy4xrl6NMuUmrC6wpgCIr6IvG5NU-9-QMxTaww27GJTVvuVo5CGElBjDXTN_oQvQjw4qs2_zkxDz9CCKeMARcptUVYCukI-BAOeSNmoexFOA6YCaEekF0Y3FiJJuQPw5qHOvNxJtOzWqVUgEr_5v41JPZWMQ Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Domain-Id: None Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Domain-Name: None Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Identity-Status: Confirmed Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Is-Admin-Project: True Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Domain-Id: default Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Domain-Name: Default Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Project-Name: admin Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Role: reader,member,admin Jul 14 09:31:16.219041 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Roles: reader,member,admin Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_fc045bacae334916a4c6d8daadbcb707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant: admin Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant-Id: fc045bacae334916a4c6d8daadbcb707 Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-Tenant-Name: admin Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User: admin Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Domain-Id: default Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Domain-Name: Default Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Id: d3cc085bb5914250a5e384092f9f12f8 Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: X-User-Name: admin Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: method: > Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: exception: Flavor 451 could not be found. Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: action_args: {'id': '451'} Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:31:16.220546 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:16.221512 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: ERROR nova.api.openstack.wsgi Jul 14 09:31:16.222832 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-961ca97c-8cf0-4827-b8ac-c80f3be9dbe2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:31:16.224043 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-961ca97c-8cf0-4827-b8ac-c80f3be9dbe2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011619 Jul 14 09:31:16.224043 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 09:31:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 09:31:17.182704 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:17.183726 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 14 09:31:17.184120 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:17.713193 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-b78f7220-082a-49ab-86c4-cebfb813014b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:31:17.731180 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-b78f7220-082a-49ab-86c4-cebfb813014b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.409261 Jul 14 09:31:17.731709 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 14 09:31:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:31:18.716240 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:18.717281 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 14 09:31:18.717686 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:19.242372 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-cf2eef58-1cad-4ee0-9342-b9df28883be2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:31:19.258922 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-cf2eef58-1cad-4ee0-9342-b9df28883be2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403801 Jul 14 09:31:19.259451 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 14 09:31:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:31:20.223371 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:20.224375 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 14 09:31:20.224795 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:20.758742 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-1b764c24-d93c-43b4-93a8-e617ca56dd37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:31:20.776226 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-1b764c24-d93c-43b4-93a8-e617ca56dd37 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.415076 Jul 14 09:31:20.776759 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 14 09:31:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:31:21.733129 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:21.734214 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 14 09:31:21.734618 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:22.251241 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-5e09a7a7-a955-4e63-9acc-00947edbc848 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:31:22.269126 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-5e09a7a7-a955-4e63-9acc-00947edbc848 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.396110 Jul 14 09:31:22.269655 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Thu Jul 14 09:31:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:31:23.245080 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:23.246088 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 14 09:31:23.246514 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:31:23.777369 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-912e01fe-cf50-487b-af86-9686b84ecc20 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:31:23.797318 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-912e01fe-cf50-487b-af86-9686b84ecc20 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406470 Jul 14 09:31:23.797854 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Thu Jul 14 09:31:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:32:15.355342 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:32:15.356353 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-3e0b6e91-94f7-4799-a7f4-8e85e6c69b79 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Jul 14 09:32:15.356753 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Thu Jul 14 09:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:32:15.366833 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:15.750429 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-64ba64b4-fa1a-47b3-9295-cbd98dfb15ec admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:32:15.769564 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-64ba64b4-fa1a-47b3-9295-cbd98dfb15ec admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407154 Jul 14 09:32:15.770090 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Thu Jul 14 09:32:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:32:15.792773 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-c91f1a60-a92a-4768-b99a-3e9965db090b admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:32:15.796176 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG dbcounter [-] [103391] Writing DB stats nova_api:SELECT=14 {{(pid=103391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:32:15.801560 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-c91f1a60-a92a-4768-b99a-3e9965db090b admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012511 Jul 14 09:32:15.802088 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jul 14 09:32:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:32:15.813716 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-76e04151-22cb-4a51-aa2c-ebc917e10d59 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:32:15.821181 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-76e04151-22cb-4a51-aa2c-ebc917e10d59 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010978 Jul 14 09:32:15.821682 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jul 14 09:32:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:32:15.833650 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:32:15.841327 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011476 Jul 14 09:32:15.841846 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Thu Jul 14 09:32:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:32:15.853552 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-389b80a2-835c-4789-a092-f4ac36522abd admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:32:15.861173 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-389b80a2-835c-4789-a092-f4ac36522abd admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011550 Jul 14 09:32:15.861673 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Thu Jul 14 09:32:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:35:42.046039 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:35:42.047081 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 14 09:35:42.047472 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:35:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:35:42.189482 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=6 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:35:42.354159 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-54db4478-39e9-48d1-82c0-88671dd3489b admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:35:42.355492 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:35:42.355492 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 14 09:35:42.356808 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-54db4478-39e9-48d1-82c0-88671dd3489b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:35:42.357251 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-54db4478-39e9-48d1-82c0-88671dd3489b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:35:42.358030 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-54db4478-39e9-48d1-82c0-88671dd3489b admin admin] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:35:42.358483 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-54db4478-39e9-48d1-82c0-88671dd3489b admin admin] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:35:42.392654 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-54db4478-39e9-48d1-82c0-88671dd3489b admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.204526 Jul 14 09:35:42.393209 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 09:35:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:35:43.223587 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:35:43.224648 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Jul 14 09:35:43.225187 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:35:43.414299 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-b27291e7-01d1-45d4-adf6-24e564b5988f admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:35:43.415484 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:35:43.415484 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 14 09:35:43.416711 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-b27291e7-01d1-45d4-adf6-24e564b5988f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:35:43.417147 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-b27291e7-01d1-45d4-adf6-24e564b5988f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:35:43.417925 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-b27291e7-01d1-45d4-adf6-24e564b5988f admin admin] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:35:43.418403 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-b27291e7-01d1-45d4-adf6-24e564b5988f admin admin] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:35:43.437480 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-b27291e7-01d1-45d4-adf6-24e564b5988f admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073972 Jul 14 09:35:43.437965 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 09:35:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:35:54.682300 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:35:54.683338 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 14 09:35:54.683726 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:35:54.826767 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell0:SELECT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:35:54.827416 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_cell1:SELECT=4 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:35:54.828099 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG dbcounter [-] [103392] Writing DB stats nova_api:SELECT=8 {{(pid=103392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:35:54.875969 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-d61e1002-abb7-4102-8913-e3a7f5a5ff49 admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:35:54.877147 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:35:54.877147 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 14 09:35:54.878939 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-d61e1002-abb7-4102-8913-e3a7f5a5ff49 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:35:54.879378 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-d61e1002-abb7-4102-8913-e3a7f5a5ff49 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:35:54.880145 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-d61e1002-abb7-4102-8913-e3a7f5a5ff49 admin admin] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:35:54.880565 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-d61e1002-abb7-4102-8913-e3a7f5a5ff49 admin admin] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:35:54.905201 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-d61e1002-abb7-4102-8913-e3a7f5a5ff49 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083074 Jul 14 09:35:54.905738 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 09:35:54 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:35:55.854080 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: DEBUG nova.api.openstack.wsgi [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] Calling method '>' {{(pid=103391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:35:55.855132 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: INFO nova.api.openstack.requestlog [None req-fe58b8a1-56b3-44bc-a4bf-7658b035632c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 14 09:35:55.855529 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: [pid: 103391|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Thu Jul 14 09:35:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:35:56.045389 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG nova.api.openstack.wsgi [None req-cc218395-f13c-459b-b34a-4a7cecb4567b admin admin] Calling method '>' {{(pid=103392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:35:56.046635 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 09:35:56.046635 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: warnings.warn(msg) Jul 14 09:35:56.047802 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-cc218395-f13c-459b-b34a-4a7cecb4567b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:35:56.048239 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-cc218395-f13c-459b-b34a-4a7cecb4567b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:35:56.049011 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-cc218395-f13c-459b-b34a-4a7cecb4567b admin admin] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:35:56.049457 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: DEBUG oslo_concurrency.lockutils [None req-cc218395-f13c-459b-b34a-4a7cecb4567b admin admin] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:35:56.071343 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: INFO nova.api.openstack.requestlog [None req-cc218395-f13c-459b-b34a-4a7cecb4567b admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077565 Jul 14 09:35:56.071886 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: [pid: 103392|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Thu Jul 14 09:35:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:36:56.774539 dv-cinder-825492-26-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 09:36:56.775751 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: Thu Jul 14 09:36:56 2022 - graceful shutdown triggered... Jul 14 09:36:56.776178 dv-cinder-825492-26-iscsi devstack@n-api.service[103391]: Gracefully killing worker 1 (pid: 103391)... Jul 14 09:36:56.777334 dv-cinder-825492-26-iscsi devstack@n-api.service[103392]: Gracefully killing worker 2 (pid: 103392)... Jul 14 09:36:57.775826 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: worker 1 buried after 1 seconds Jul 14 09:36:57.776381 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: worker 2 buried after 1 seconds Jul 14 09:36:57.776381 dv-cinder-825492-26-iscsi devstack@n-api.service[103390]: goodbye to uWSGI. Jul 14 09:36:57.777459 dv-cinder-825492-26-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 09:36:57.778015 dv-cinder-825492-26-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 09:36:57.780833 dv-cinder-825492-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 09:36:57.790925 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 09:36:57 2022] *** Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: nodename: dv-cinder-825492-26-iscsi Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: machine: x86_64 Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: clock source: unix Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: pcre jit disabled Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: detected number of CPU cores: 4 Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: current working directory: / Jul 14 09:36:57.792793 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: detected binary path: /usr/bin/uwsgi-core Jul 14 09:36:57.793438 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: your processes number limit is 47680 Jul 14 09:36:57.793438 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: your memory page size is 4096 bytes Jul 14 09:36:57.793438 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: detected max file descriptor number: 2048 Jul 14 09:36:57.793438 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: lock engine: pthread robust mutexes Jul 14 09:36:57.793438 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: thunder lock: enabled Jul 14 09:36:57.793438 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 09:36:57.793438 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 09:36:57.838278 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: Python main interpreter initialized at 0x555b922169c0 Jul 14 09:36:57.838278 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: python threads support enabled Jul 14 09:36:57.838278 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: your server socket listen backlog is limited to 100 connections Jul 14 09:36:57.838278 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: your mercy for graceful operations on workers is 90 seconds Jul 14 09:36:57.838707 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 09:36:57.838707 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: *** Operational MODE: preforking *** Jul 14 09:36:57.838929 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: *** uWSGI is running in multiple interpreter mode *** Jul 14 09:36:57.838929 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: spawned uWSGI master process (pid: 129521) Jul 14 09:36:57.839138 dv-cinder-825492-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 09:36:57.840181 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: spawned uWSGI worker 1 (pid: 129536, cores: 1) Jul 14 09:36:57.846755 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: spawned uWSGI worker 2 (pid: 129537, cores: 1) Jul 14 09:36:57.846755 dv-cinder-825492-26-iscsi devstack@n-api.service[129521]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 09:36:58.498849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 09:36:58.511472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 09:36:59.708352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:36:59.708352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: from cryptography.utils import int_from_bytes Jul 14 09:36:59.709048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:36:59.709048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: from cryptography.utils import int_from_bytes Jul 14 09:36:59.709668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:36:59.709668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: from cryptography.utils import int_from_bytes Jul 14 09:36:59.709834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 09:36:59.709834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: from cryptography.utils import int_from_bytes Jul 14 09:37:02.000391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 09:37:02.000824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 09:37:02.001173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 09:37:02.001536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 09:37:02.001789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 09:37:02.002173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.002531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.002875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.003191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.003514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.003820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.004140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.004458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.004781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.005037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.005348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.005667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-26-iscsi {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.005985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.006319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.006629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.006945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.007246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.007565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.007866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.008360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.009494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.009827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.010158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.010949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.011203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.011689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.012010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.012327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.012682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.012988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.013403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-26-iscsi {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.013727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.014044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.014389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.014811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.015126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.015438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.015762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.016090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.016188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 09:37:02.016595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 09:37:02.016687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.016779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.016871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 09:37:02.017040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.017218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 09:37:02.017363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.017481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 09:37:02.017688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.017870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.017988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.018213 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.018337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.019069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.019169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.019389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.019495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.019720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.019823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.020029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.020128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.020278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.020371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.020587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.020713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.020911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.021015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.021210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.021386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.021564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.021730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.021871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-26-iscsi {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.021999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.022136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.022263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.022461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.022554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.022776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.022888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.023092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.023234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.023396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.023500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.023711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.023821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.024010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.024140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.024323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.024512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.024677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.024822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.024993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.025125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.025227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.025433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.025533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.025767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.025870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.026079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.026178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.026414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.026506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.026732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.026837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.027037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.027128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.027358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.027450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.027659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.027759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.027995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.028099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-26-iscsi {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.028310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.028417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.028622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.028724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.028941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.029051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.029260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.029391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.029565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.029670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.029870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.029975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.030172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.030311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.030538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.030669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.030872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.030976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.031206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.031528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.031629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.031784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.031882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.032086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.032189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.032392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.032490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.032711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.032870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.033155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.033257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.033353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.033463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.033617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.033721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.033896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.034021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.034862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.034979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.035184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.035347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.035559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.035687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.035885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.036005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.036210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.036357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.036601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.036722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.036864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.036993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.037187 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.037314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.037511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.037640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.037820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.037941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.038127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.038301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.038464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.038585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.038774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.038895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.039081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.039213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.039435 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.039572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.039700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.039812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.039988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.040115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.040306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.040434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.040624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.040750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.040927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.041046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.041229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.041363 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.041544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.041665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.041957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.042096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.042264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.042475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.042567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.042698 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.042829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.042977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.043217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.043353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.043511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.043672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.043878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.044007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.044197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.044304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.044508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.044648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.044813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.044934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.045121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.045241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.045438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.045542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.045760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.045862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.046063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.046158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.046391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.046503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.046696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.046798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.047056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.047168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.047377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.047478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.047682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.047781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.047986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.048135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.048340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.048500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.048638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.048842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.048948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.049282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.049403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.049651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.049952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.050082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.050180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.050294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.050576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.050700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.050908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.051020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.051222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.051315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.051526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.051629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.051845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.051954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.052165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.052355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.052529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.052674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.052820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.052972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.053126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.053305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.053529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.053693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.053837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.054064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.054242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.054412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.054568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.054719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.054858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.055087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.055227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.055227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.055524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.055524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.055799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.055799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.056073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.056233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.056383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.056524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.056672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.056821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.056969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.057140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.057287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.057438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.057579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.057727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.057868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.058022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.058162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.058332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.058422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.058514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.058611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.058702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.058838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.058977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.059147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.059272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.059475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.059576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.059805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.059921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.060118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.060258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.060427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.060532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.060737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.060844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.061047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.061141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.061349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.061453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.061656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.061748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 09:37:02.061962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.062063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.062319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.062437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.062633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.062729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.062943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.063043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.063255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.063356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.063571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.063727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.063936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.064071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.064214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.064304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.064482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.064575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.064784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.064877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.065099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.065256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.065422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.065514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.065735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.065835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.066053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.066147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.066396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.066488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.066727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.066835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.067033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.067126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.067347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.067436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.067663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.067768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.067972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.068080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.068286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.068379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.068613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.068773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.068930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.069022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.069285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.069424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.069785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.070090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.070326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.070490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.070691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.070810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.071010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.071139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.071338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.071459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.071662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.071782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.071977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.072104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.072289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.072406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.072630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.072769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.072893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.073015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.073203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.073331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.073538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.073685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.073979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.074330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.074538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.074813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.074913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.075003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.075242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.075361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.075553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.075654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.075885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.076034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.076351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.076582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.076702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.076902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.077007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.077218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.077358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.077538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.077641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.077852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.077955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.078163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.078342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.078491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.078639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.078800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.078954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.079107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.079269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.079415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.079584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.079734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.079899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.080040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.080241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.080338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.080551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.080654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.081371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.081513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.081716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.081853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.082030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.082166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.082370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.082518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.082750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.082904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.083039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.083182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.083323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.083463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.083622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.083774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.084505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.084666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.084803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.084803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.085070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.085203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.085334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.085876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.086018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.086161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.086418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.086571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.086715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.086864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.087006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.087140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.087281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.087421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.087568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.087703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.087835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.087966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.088097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.088228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.088369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.088502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.088640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.088782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.088923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.089056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.089196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.089337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.089470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.089602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.089741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.089875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.090021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.090162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.090313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.090459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.090600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.090733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.090885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.091020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.091159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.091299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.091685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.091833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.091967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.092099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.092231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.092363 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.092502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.092645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.092801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.093009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.093155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.093290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.093429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.093572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.093705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.093838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.093969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.094103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.094359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.094644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.094644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.094901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.095035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.095168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.095315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.095457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.095590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.095722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.095862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.095995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.096142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.096281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.096436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.097253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.097392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.097524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.097671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.097803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.098366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.098507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.098642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.098776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.098924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.099057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.099199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.099334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.099466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.099610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.099744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.099874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.100017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.100156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.100156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.100447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.100563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.100676 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.100795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.100918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.101040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.101163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.101277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.101391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.101511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.101625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.101737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.101885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.102009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.102254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.102399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.102553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.102685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.102876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.103018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.103215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.103344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.103495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.103633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.103884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.104016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.104138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.104253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.104426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.104705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.104840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.104955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.105076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.105190 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.105330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.105463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.105638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.105768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.105956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.106085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.106287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.106430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.106693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.106824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.106974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.107119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.107282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.107505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.107661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.107804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.107939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.108070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.108240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.108387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.108529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.108673 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.108834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.108995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.109212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.109390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.109539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.109695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.109844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.109991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.110153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.110371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.110521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.110676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.110851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.111015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.111181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.111335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.111494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.111665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.111822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.111979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.112167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.112328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.112499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.112655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.112810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.112978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.113127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.113400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.113562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.113562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.113882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.114137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.114322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.114475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.114642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.114945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.115117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.115269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.115883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.116068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.116227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.116389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.116589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.116752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.116900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.116900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.117210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.117376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.117552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.117804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.117967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.118131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.118354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.118504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.118675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.118838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.119007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.119175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.119324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.119479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.119628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.119783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.119931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.120092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.120249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.120396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.120544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.120711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.120908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.121085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.121085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.121371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.121519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.121667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.121824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.121972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.122127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.122311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.122431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.122526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.122526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.122807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.122807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.123995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.124084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.124164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.124255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.124340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.124422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.124539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.124787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.124899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.125090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.125201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.125398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.125498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.125701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.125791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.126006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.126293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.126389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.126627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.126717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.126936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.127051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.127241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.127341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.127550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.127651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.127889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.127979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.128200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.128299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.128504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.128611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.128804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.128903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.129109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.129209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.129411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.129723 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.129830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.130029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.130131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.130353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.130460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.130685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.130886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.131043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.131212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.131371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.131545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.131702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.131857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.131857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.132162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.132317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.132466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.132620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.132768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.132925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.133082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.133230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.133384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.133628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.133792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.133958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.134114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.134334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.134495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.134495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.134807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.134807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.135247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.135397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.135551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.135707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.135866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.136025 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.136173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.136173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.136470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.136626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.136775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.137006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.137178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.137465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.137632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.137791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.137994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.138169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.138344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.138575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.138744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.138905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.139070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.139220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.139376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.139524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.139672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.139827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.139989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.140149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.140298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.140453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.140602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.140768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.140917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.141065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.141214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.141360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.141515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.141678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.141834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.142018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.142202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.142360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.142508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.142668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.142826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.142975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.143130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.143280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.144068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.144243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.144402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.144550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.144698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.144863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.145167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.145335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.145487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.145642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.145790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.145945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.146108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.146279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.146432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.146432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.146725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.146725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.147635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.147804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.147963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.147963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.148246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.148395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.148555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.148704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.148852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.148852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.149140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.149296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.149456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.149628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.149781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.149929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.150077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.150268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.150432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.150589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.150739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.150895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.151050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.151209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.151357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.151505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.151665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.151814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.151961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.152123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.152273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.152430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.152586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.152743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.152892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.153049 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.153199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.153346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.153504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.153651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.153814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.153969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.154148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.154412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.154578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.154727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.154887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.155042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.155334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.155488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.155644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.155811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.155977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.156125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.156281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.156436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.156592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.156748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.156911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.157059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.157214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.157362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.157653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.157820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.157982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.158131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.158315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.158466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.158577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.158682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.158771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.158862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.158954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.159111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.159199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.159296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.159388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.159471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.159561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.159652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.159735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.160316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.160411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.160495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.160585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.160668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.160759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.160842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.160928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.161942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.162953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.163966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.164181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.164283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.164496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.164601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.164804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.164903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.165114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.165215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.165481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.165596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.165725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.165833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.166035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.166135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.166365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.166460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.166667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.166773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.166986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.167146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.167289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.167382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.167592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.167735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.167893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.167985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.168194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.168366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.168521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.168682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.168841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.168996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.169163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.169319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.169481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.169640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.169795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.169941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.170219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.170521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.170688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.170846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.171147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.171448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.171615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.171791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.172043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.172197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.172354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.172517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.172680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.172835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.173003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.173159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.173324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.173489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.173654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.173821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.173976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.174138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.174324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.174492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.174688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.174859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.175021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.175177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.175331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.175715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.175888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.175888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.176196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.176359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.176514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.176679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.176836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.176991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.177145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.177299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.177462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.177626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.177937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.178107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.178296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.178467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.178623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.178795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.178954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.179116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.179279 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.179435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.179600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.179756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.179918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.180084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.180239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.180401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.180577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.180732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.180886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.181042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.181205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.181360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.181524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.181679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.181842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.182004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.182160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.182350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.182531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.182695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.182858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.183013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.183168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.183322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.183486 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.183650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.183813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.183969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.183969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.184278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.184433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.184598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.184752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.184907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.185069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.185237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.185406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.185580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.185929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.186090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.186287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.186465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.186629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.186785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.186950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.187113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.187282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.187439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.187592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.187746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.188050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.188224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.188476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.188643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.188798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.188960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.189127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.189290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.189457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.189612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.189767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.189929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.190091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.190285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.190473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.190632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.190786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.190948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.191104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.191284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.191441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.191596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.191750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.191905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.192067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.192232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.192394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.192550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.192704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.192859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.193014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.193178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.193343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.193506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.193663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.193817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.193971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.194138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.194365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.194523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.194686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.194842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.194842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.195150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.195307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.195480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.195636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.196004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.196186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.196351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.196507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.196669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.196840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.197002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.197172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.197337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.197500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.197673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.197831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.198141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.198344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.198509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.198666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.198942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.199149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.199330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.199498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.199660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.199816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.199979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.200154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.200324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.200488 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.200650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.200813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.200968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.201123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.201287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.201443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.201599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.201761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.201923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.202108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.202288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.202447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.202620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.202777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.202940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.203111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.203273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.203429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.203590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.203744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.203744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.204070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.204229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.204384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.204539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.204701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.204866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.205021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.205177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.205331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.205493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.205656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.205825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.206734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.206914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.207070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.207233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.207387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.207558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.207713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.207875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.208030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.208336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.208512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.208687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.208853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.209028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.209191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.209355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.209355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.209670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.209833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.209987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.210141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.210501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.210683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.210848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.211012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.211166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.211331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.211487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.211487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.211792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.211954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.212118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.212273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.212441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.212605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.212768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.212930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.213100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.213263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.213492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.213653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.213808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.213961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.214115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.214316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.214491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.214648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.214853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.215111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.215344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.215576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.215855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.216102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.216933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.217198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.217460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.217739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.217993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.218517 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.218802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.219071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.219337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.219626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.219899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.220178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.220410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.220680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.222693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.222898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.223073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.223244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.223447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.223609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.223781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.223945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.224123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.224287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.224445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.224600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.224884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.225045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.225209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.225365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.225528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.225683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.225852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.226007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.226171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.226364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.226520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.226692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.227095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.227268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.227426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.227581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.227744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.227915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.228072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.228235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.228398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.228718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.228894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.229065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.229230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.229395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.229600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.229792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.229792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.230066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.230182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.230640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.230819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.231089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.231288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.231448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.231610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.231773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.231773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.232075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.232241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.232438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.232606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.232781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.232943 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.233098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.233263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.233263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.233587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.233753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.233916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.234085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.234305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.234478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.234478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.234797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.234953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.235118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.235280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.235434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.235601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.235755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.235755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.236067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.236222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.236376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.236376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.236677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.236833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.237255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.237480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.237643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.237799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.237975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.238147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.238328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.238506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.238914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.239055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.239174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.239301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.239418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.239532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.239532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.239763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.239886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.240015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.240131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.240246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.240368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.240368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.240581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.240855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.241026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.241183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.241336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.241536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.241749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.241921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.242077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.242272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.242434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.242597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.242761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.242917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.243071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.243232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.243393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.243557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.243725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.243900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.243900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.244210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.244400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.244621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.244787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.244951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.245111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.245236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.245359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.245488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.245605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.245727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.245850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.245972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.246088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.246239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.246644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.246812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.246969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.247829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.249332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.249332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.249332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.249779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.249935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.250098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.250302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.250536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.250718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.250718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.251085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.251240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.251240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.251536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.251536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.251877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.252038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.252193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.252355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.252355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.252660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.252857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.253014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.253014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.253317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.253472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.253636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.253790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.253790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.254084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.254300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.254300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.254619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.254785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.254940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.255094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.255248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.255411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.255567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.255883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.256036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.256036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.256425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.256425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.256732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.256732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.257041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.257195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.257621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.257792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.257949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.257949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.258269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.258269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.258583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.258739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.258739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.259222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.259402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.259402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.259708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.259861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.260023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.260177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.260338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.260502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.260660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.260815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.260969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.261131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.261304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.261469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.261631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.261788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.261951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.261951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.261951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.262480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.262642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.262797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.262958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.263119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.263284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.263449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.263604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.263765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.263921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.264115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.264283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.264445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.264608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.264779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.264943 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.265112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.265268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.265432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.265432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.265734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.265888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.266053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.266233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.266406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.266561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.266722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.266876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.267046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.267202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.267356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.268895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.269069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.269399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.269586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.269751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.269907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.270062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.270250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.270426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.270582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.270737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.270891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.271065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.271230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.271396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.271553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.271709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.271871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.272026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.272181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.272346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.272510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.272666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.272821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.272994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.273165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.273321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.273476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.273631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.273785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.273953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.274124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.274312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.274481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.274636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.274798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.274953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.275129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.275295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.275460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.275622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.275784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.275953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.276109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.276271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.276434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.276434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.276729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.276894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.277055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.277230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.277384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.277539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 09:37:02.278775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.278775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.280228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.280228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.280228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.280228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.280228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.280228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.280228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.280228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.281377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.281377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.281377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.281377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.281377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.281377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.281377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.281377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.282583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.282583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.282583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.282583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.282583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.282583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.282583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.282583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.283758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.283758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.283758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.283758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.283758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.283758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.283758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.283758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.285517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.285517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.285517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.285517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.285517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.285517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.285517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.285517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.286800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.286800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.286800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.286800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.286800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.286800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.286800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 09:37:02.287849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 09:37:02.424781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO dbcounter [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Registered counter for database nova_api Jul 14 09:37:02.439952 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO dbcounter [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Registered counter for database nova_api Jul 14 09:37:02.445310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_db.sqlalchemy.engines [None req-47f2754e-d472-4574-a731-22709b185e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:37:02.452069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writer thread running {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:37:02.460642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_db.sqlalchemy.engines [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:37:02.467551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writer thread running {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:37:02.508457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.context [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11929b56-3cfc-42c6-a919-563dcd828b94(cell1) {{(pid=129536) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 09:37:02.512468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:37:02.514137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:37:02.514967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:37:02.516944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:37:02.519463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO dbcounter [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Registered counter for database nova_cell0 Jul 14 09:37:02.523515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO dbcounter [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Registered counter for database nova_cell1 Jul 14 09:37:02.524140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.context [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11929b56-3cfc-42c6-a919-563dcd828b94(cell1) {{(pid=129537) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 09:37:02.529667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:37:02.530823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_db.sqlalchemy.engines [None req-47f2754e-d472-4574-a731-22709b185e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:37:02.531333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:37:02.532171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:37:02.534248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:37:02.536294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO dbcounter [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Registered counter for database nova_cell0 Jul 14 09:37:02.538485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_db.sqlalchemy.engines [None req-47f2754e-d472-4574-a731-22709b185e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:37:02.540110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writer thread running {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:37:02.542170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO dbcounter [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Registered counter for database nova_cell1 Jul 14 09:37:02.549667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_db.sqlalchemy.engines [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:37:02.552377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_db.sqlalchemy.engines [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:37:02.559449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writer thread running {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:37:02.559788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writer thread running {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:37:02.679601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writer thread running {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:37:02.688237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO dbcounter [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Registered counter for database nova_cell0 Jul 14 09:37:02.695537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_db.sqlalchemy.engines [None req-47f2754e-d472-4574-a731-22709b185e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:37:02.700019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writer thread running {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:37:02.703586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO dbcounter [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Registered counter for database nova_cell0 Jul 14 09:37:02.710336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_db.sqlalchemy.engines [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 09:37:02.714680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writer thread running {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 09:37:03.021880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: WARNING keystonemiddleware.auth_token [None req-47f2754e-d472-4574-a731-22709b185e9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 09:37:03.029268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: WARNING keystonemiddleware.auth_token [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 09:37:03.031520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: WARNING keystonemiddleware.auth_token [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 09:37:03.038838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: WARNING keystonemiddleware.auth_token [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 09:37:03.380598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: WARNING keystonemiddleware.auth_token [None req-47f2754e-d472-4574-a731-22709b185e9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 09:37:03.385216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: WARNING keystonemiddleware.auth_token [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 09:37:03.386619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: WARNING keystonemiddleware.auth_token [None req-47f2754e-d472-4574-a731-22709b185e9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 09:37:03.391247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: WARNING keystonemiddleware.auth_token [None req-730d2a32-44b0-490d-8631-cef7df7e7aaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 09:37:03.392880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b922169c0 pid: 129536 (default app) Jul 14 09:37:03.397469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b922169c0 pid: 129537 (default app) Jul 14 09:37:43.492189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:43.493316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:43.494076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:43.494824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.609345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=3 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.611130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=3 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.613892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=3 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.614880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=3 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:37:44.742518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-33de64fc-b15b-45d3-be87-49bda02d22dd tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Action: 'create', calling method: .version_select at 0x7f7da3cd4c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-985581251", "metadata": {"Type": "work"}}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-33de64fc-b15b-45d3-be87-49bda02d22dd tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Request method failure captured: Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 121 Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PnrjAAHdBE33KMT5C_cPSBVzjxmWYghmYdRTSVGVdFlrQL1z39b07ZoGvINBUH64E5rOsf1eFKYP0P9WF1uhuGAEiSo1JIR0sToJedDIV7PHsJqkLG_XZkXrlnRsxv3wniZCViz27GyWf1C33_0adA1mhD0Wgc59UnyZaTFRLe-bg Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:37:44.764562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4324e0082184371a7f886a43dcfb358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 43d67da8d2554d6c9eb1e28eca883b87 Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-985581251", "metadata": {"Type": "work"}}} Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:37:44.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-985581251', 'metadata': {'Type': 'work'}}}} Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise error Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:37:44.767854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 09:37:44.769410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 09:37:44.771436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 09:37:44.771436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.772622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-33de64fc-b15b-45d3-be87-49bda02d22dd tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:37:44.774012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-33de64fc-b15b-45d3-be87-49bda02d22dd tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.293124 Jul 14 09:37:44.775078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 14 09:37:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 09:37:44.788228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c735406-5b09-4818-865b-774903f42282 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Action: 'create', calling method: .version_select at 0x7f7da3c22ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-604863167", "metadata": {"Type": "work"}}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c735406-5b09-4818-865b-774903f42282 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Request method failure captured: Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 119 Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PnrjAAHdBE33KMT5C_cPSBVzjxmWYghmYdRTSVGVdFlrQL1z39b07ZoGvINBUH64E5rOsf1eFKYP0P9WF1uhuGAEiSo1JIR0sToJedDIV7PHsJqkLG_XZkXrlnRsxv3wniZCViz27GyWf1C33_0adA1mhD0Wgc59UnyZaTFRLe-bg Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:37:44.792298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4324e0082184371a7f886a43dcfb358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 43d67da8d2554d6c9eb1e28eca883b87 Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-604863167", "metadata": {"Type": "work"}}} Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:37:44.794963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-604863167', 'metadata': {'Type': 'work'}}}} Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise error Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi '0' Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:37:44.795802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 09:37:44.797226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 09:37:44.799395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 09:37:44.799395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.799395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c735406-5b09-4818-865b-774903f42282 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:37:44.799395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c735406-5b09-4818-865b-774903f42282 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010449 Jul 14 09:37:44.799395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 2/2] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 14 09:37:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:37:44.809029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-94fe4439-631c-4fa5-bbb5-277756199165 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Action: 'create', calling method: .version_select at 0x7f7da3c220d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1586592148", "metadata": {"Type": "work"}}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-94fe4439-631c-4fa5-bbb5-277756199165 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Request method failure captured: Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 119 Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PnrjAAHdBE33KMT5C_cPSBVzjxmWYghmYdRTSVGVdFlrQL1z39b07ZoGvINBUH64E5rOsf1eFKYP0P9WF1uhuGAEiSo1JIR0sToJedDIV7PHsJqkLG_XZkXrlnRsxv3wniZCViz27GyWf1C33_0adA1mhD0Wgc59UnyZaTFRLe-bg Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:37:44.813390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4324e0082184371a7f886a43dcfb358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 43d67da8d2554d6c9eb1e28eca883b87 Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1586592148", "metadata": {"Type": "work"}}} Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:37:44.814928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1586592148', 'metadata': {'Type': 'work'}}}} Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise error Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi '' Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:37:44.815905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 09:37:44.818451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 09:37:44.820357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 09:37:44.820357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:44.820357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-94fe4439-631c-4fa5-bbb5-277756199165 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:37:44.820357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-94fe4439-631c-4fa5-bbb5-277756199165 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015469 Jul 14 09:37:44.820357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 3/3] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 14 09:37:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:37:44.830277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7d0ad48c-528d-4f67-8a98-e621bf287238 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Calling method '.version_select at 0x7f7da3c02c10>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:46.237640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cb8f3acf-3544-40c7-87d5-83a26e577062 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Action: 'create', calling method: .version_select at 0x7f7da3cd3c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2110798757"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:37:46.408903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-7d0ad48c-528d-4f67-8a98-e621bf287238 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] HTTP exception thrown: Volume tempest-invalid-1645501198 could not be found. Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7d0ad48c-528d-4f67-8a98-e621bf287238 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Request method failure captured: Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1645501198 HTTP/1.1 Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PnrjAAHdBE33KMT5C_cPSBVzjxmWYghmYdRTSVGVdFlrQL1z39b07ZoGvINBUH64E5rOsf1eFKYP0P9WF1uhuGAEiSo1JIR0sToJedDIV7PHsJqkLG_XZkXrlnRsxv3wniZCViz27GyWf1C33_0adA1mhD0Wgc59UnyZaTFRLe-bg Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:37:46.417550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4324e0082184371a7f886a43dcfb358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 43d67da8d2554d6c9eb1e28eca883b87 Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Volume tempest-invalid-1645501198 could not be found. Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': 'tempest-invalid-1645501198'} Jul 14 09:37:46.419038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1645501198 could not be found. (HTTP 404) (Request-ID: req-d74eeefe-fedc-4430-9cb2-abed78817acb) Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.419971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 09:37:46.421412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1645501198 could not be found. Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:37:46.423077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1645501198 could not be found. Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1645501198 could not be found. Jul 14 09:37:46.424433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.428940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7d0ad48c-528d-4f67-8a98-e621bf287238 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Returning 404 to user: Volume tempest-invalid-1645501198 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:37:46.430374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7d0ad48c-528d-4f67-8a98-e621bf287238 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1645501198" status: 404 len: 99 microversion: 2.1 time: 1.604657 Jul 14 09:37:46.439391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 4/4] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 09:37:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1645501198 => generated 99 bytes in 1614 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 09:37:46.449545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ec7192be-d40d-42a1-9832-29e01f7c9b09 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008702 Jul 14 09:37:46.462490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 5/5] 10.222.0.40 () {58 vars in 1139 bytes} [Thu Jul 14 09:37:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 09:37:46.473922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-05e824c4-465b-48c9-b966-c73434b793cb tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007360 Jul 14 09:37:46.474927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 6/6] 10.222.0.40 () {58 vars in 1136 bytes} [Thu Jul 14 09:37:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 09:37:46.485722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f5abaf25-9012-49c6-8c41-ffd1a81f66de tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Calling method '.version_select at 0x7f7da3b20ee0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:46.658963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-f5abaf25-9012-49c6-8c41-ffd1a81f66de tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] HTTP exception thrown: Volume dfbb8bd3-b204-4f8f-8efe-221d2efa134f could not be found. Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f5abaf25-9012-49c6-8c41-ffd1a81f66de tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Request method failure captured: Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/os-volumes/dfbb8bd3-b204-4f8f-8efe-221d2efa134f HTTP/1.1 Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PnrjAAHdBE33KMT5C_cPSBVzjxmWYghmYdRTSVGVdFlrQL1z39b07ZoGvINBUH64E5rOsf1eFKYP0P9WF1uhuGAEiSo1JIR0sToJedDIV7PHsJqkLG_XZkXrlnRsxv3wniZCViz27GyWf1C33_0adA1mhD0Wgc59UnyZaTFRLe-bg Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:37:46.662487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4324e0082184371a7f886a43dcfb358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 43d67da8d2554d6c9eb1e28eca883b87 Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Volume dfbb8bd3-b204-4f8f-8efe-221d2efa134f could not be found. Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': 'dfbb8bd3-b204-4f8f-8efe-221d2efa134f'} Jul 14 09:37:46.663922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfbb8bd3-b204-4f8f-8efe-221d2efa134f could not be found. (HTTP 404) (Request-ID: req-c7025093-74ab-4af5-8afc-f8dc8a98184e) Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.664847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 09:37:46.665933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfbb8bd3-b204-4f8f-8efe-221d2efa134f could not be found. Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 09:37:46.667158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfbb8bd3-b204-4f8f-8efe-221d2efa134f could not be found. Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfbb8bd3-b204-4f8f-8efe-221d2efa134f could not be found. Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f5abaf25-9012-49c6-8c41-ffd1a81f66de tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Returning 404 to user: Volume dfbb8bd3-b204-4f8f-8efe-221d2efa134f could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f5abaf25-9012-49c6-8c41-ffd1a81f66de tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/dfbb8bd3-b204-4f8f-8efe-221d2efa134f" status: 404 len: 109 microversion: 2.1 time: 0.183239 Jul 14 09:37:46.668243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 7/7] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 09:37:46 2022] DELETE /compute/v2.1/os-volumes/dfbb8bd3-b204-4f8f-8efe-221d2efa134f => generated 109 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:37:46.681920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c6c73e4-4853-4efc-a41d-7dd622607392 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Calling method '.version_select at 0x7f7da3b394c0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:46.747441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-3c6c73e4-4853-4efc-a41d-7dd622607392 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] HTTP exception thrown: Volume a2779ea4-4c36-4f0b-8792-b5c65eb63da1 could not be found. Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c6c73e4-4853-4efc-a41d-7dd622607392 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Request method failure captured: Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/os-volumes/a2779ea4-4c36-4f0b-8792-b5c65eb63da1 HTTP/1.1 Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PnrjAAHdBE33KMT5C_cPSBVzjxmWYghmYdRTSVGVdFlrQL1z39b07ZoGvINBUH64E5rOsf1eFKYP0P9WF1uhuGAEiSo1JIR0sToJedDIV7PHsJqkLG_XZkXrlnRsxv3wniZCViz27GyWf1C33_0adA1mhD0Wgc59UnyZaTFRLe-bg Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:37:46.751030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a4324e0082184371a7f886a43dcfb358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a4324e0082184371a7f886a43dcfb358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: a4324e0082184371a7f886a43dcfb358 Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesNegativeTest-1957422951 Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 43d67da8d2554d6c9eb1e28eca883b87 Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesNegativeTest-1957422951-project Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Volume a2779ea4-4c36-4f0b-8792-b5c65eb63da1 could not be found. Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': 'a2779ea4-4c36-4f0b-8792-b5c65eb63da1'} Jul 14 09:37:46.752571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2779ea4-4c36-4f0b-8792-b5c65eb63da1 could not be found. (HTTP 404) (Request-ID: req-4df2f8ca-0e11-474f-839f-6514ad962d84) Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.753522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:37:46.754822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2779ea4-4c36-4f0b-8792-b5c65eb63da1 could not be found. Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 09:37:46.755899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2779ea4-4c36-4f0b-8792-b5c65eb63da1 could not be found. Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2779ea4-4c36-4f0b-8792-b5c65eb63da1 could not be found. Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c6c73e4-4853-4efc-a41d-7dd622607392 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] Returning 404 to user: Volume a2779ea4-4c36-4f0b-8792-b5c65eb63da1 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3c6c73e4-4853-4efc-a41d-7dd622607392 tempest-VolumesNegativeTest-1957422951 tempest-VolumesNegativeTest-1957422951-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a2779ea4-4c36-4f0b-8792-b5c65eb63da1" status: 404 len: 109 microversion: 2.1 time: 0.082685 Jul 14 09:37:46.756986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 8/8] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:37:46 2022] GET /compute/v2.1/os-volumes/a2779ea4-4c36-4f0b-8792-b5c65eb63da1 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:37:48.839466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cb8f3acf-3544-40c7-87d5-83a26e577062 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.235079 Jul 14 09:37:48.840838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1/9] 10.222.0.40 () {60 vars in 1154 bytes} [Thu Jul 14 09:37:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4239 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 14 09:37:48.856050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6445ec9e-b4df-4025-b8b3-5b13f87f7fa7 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b209d0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:48.974149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6445ec9e-b4df-4025-b8b3-5b13f87f7fa7 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366" status: 200 len: 345 microversion: 2.1 time: 0.124203 Jul 14 09:37:48.974834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 9/10] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:37:48 2022] GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:49.989901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-311953c9-416b-4e3e-b360-19965fc0a3ec tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b9aa60>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:50.092337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-311953c9-416b-4e3e-b360-19965fc0a3ec tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366" status: 200 len: 345 microversion: 2.1 time: 0.107826 Jul 14 09:37:50.094656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 2/11] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:37:49 2022] GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:51.115662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7493acec-f254-4088-a507-a69bd941696f tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b390d0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:51.276647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7493acec-f254-4088-a507-a69bd941696f tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366" status: 200 len: 346 microversion: 2.1 time: 0.173720 Jul 14 09:37:51.291947 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-808cef55-7447-43eb-b7ae-98c50bf46a2b tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Action: 'create', calling method: .version_select at 0x7f7da3b9adc0>, body: {"snapshot": {"volume_id": "222af170-e25c-439e-a99a-2af388a4b366", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1432412458"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:37:51.293204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 10/12] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:37:51 2022] GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 => generated 346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:52.136719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-808cef55-7447-43eb-b7ae-98c50bf46a2b tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.851329 Jul 14 09:37:52.137390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 3/13] 10.222.0.40 () {60 vars in 1161 bytes} [Thu Jul 14 09:37:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:52.149543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c4d1f101-d1d3-40e4-a01f-5e1f1198ad64 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b3f040>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:52.342577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c4d1f101-d1d3-40e4-a01f-5e1f1198ad64 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 287 microversion: 2.1 time: 0.198421 Jul 14 09:37:52.343514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 11/14] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:37:52 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 287 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:52.360177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-170b9a8a-1891-4485-bab8-0e50d04043e6 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3bb0670>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:52.899737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-170b9a8a-1891-4485-bab8-0e50d04043e6 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.548000 Jul 14 09:37:52.900639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 4/15] 10.222.0.40 () {58 vars in 1139 bytes} [Thu Jul 14 09:37:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:52.916130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-11eb21fd-65ac-453c-bf71-645e9450592b tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b3f790>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:52.993025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-11eb21fd-65ac-453c-bf71-645e9450592b tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 287 microversion: 2.1 time: 0.085165 Jul 14 09:37:52.993585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 12/16] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:37:52 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:54.005495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-adf79dd9-6c39-4439-a0c0-3c29d02daa9c tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3bbd3a0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:54.073631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-adf79dd9-6c39-4439-a0c0-3c29d02daa9c tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 287 microversion: 2.1 time: 0.072476 Jul 14 09:37:54.074331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 5/17] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:37:53 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:55.085150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e554554c-a67f-4b2c-8e61-5a81980ca9d1 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b20f70>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:55.227641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e554554c-a67f-4b2c-8e61-5a81980ca9d1 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 287 microversion: 2.1 time: 0.146324 Jul 14 09:37:55.228461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 13/18] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:37:55 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:56.240163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9d50ab5f-942d-427f-acdd-fe7f10b97833 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b9a9d0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:56.400653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9d50ab5f-942d-427f-acdd-fe7f10b97833 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 287 microversion: 2.1 time: 0.164436 Jul 14 09:37:56.402067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 6/19] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:37:56 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:57.412728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-172357f8-05d5-4d83-b9dc-1279ab4fc38a tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b39940>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:57.653696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-172357f8-05d5-4d83-b9dc-1279ab4fc38a tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 287 microversion: 2.1 time: 0.244656 Jul 14 09:37:57.654680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 14/20] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:37:57 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 287 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:58.012249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9edb73b6-876a-4cca-9197-5f9bb27213f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'create', calling method: .version_select at 0x7f7da3bbd700>, body: {"keypair": {"name": "tempest-keypair-1244140682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHll9VeSC2K7XDxrM3HfabPVZjNd0sEyi1m7frRdT/umNTYrVUfWVi/N4wG8nbOkwSalOrAtRSGtuufzSQYLy7sukbHMimXxiElerfX6d4z6X8YPxI3uz/tH9u2FPJ8PPw=="}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:37:58.125015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-9edb73b6-876a-4cca-9197-5f9bb27213f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Getting quotas for project 140620648e604251bc9c5c1a0e9c483b. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:37:58.142362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-9edb73b6-876a-4cca-9197-5f9bb27213f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Getting quotas for user 688f473972144fb6b7a398c1f775a5c1 and project 140620648e604251bc9c5c1a0e9c483b. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:37:58.283863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9edb73b6-876a-4cca-9197-5f9bb27213f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.603343 Jul 14 09:37:58.284881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 7/21] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 09:37:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:37:58.462762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1432246643", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "networks": [{"uuid": "19a5cf79-58c5-460c-9f17-3318ad6843ab"}]}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:37:58.664614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] validate_networks() for [('19a5cf79-58c5-460c-9f17-3318ad6843ab', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:37:58.670473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e56d62bd-1522-4990-bc56-2d643b600af1 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b0eee0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:58.842728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e56d62bd-1522-4990-bc56-2d643b600af1 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 287 microversion: 2.1 time: 0.179633 Jul 14 09:37:58.844192 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 8/22] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:37:58 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:37:59.855622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7f1b2e39-53bb-4784-a155-d2a495b90873 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b425e0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:37:59.911382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7f1b2e39-53bb-4784-a155-d2a495b90873 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 288 microversion: 2.1 time: 0.059676 Jul 14 09:37:59.912459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 9/23] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:37:59 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 288 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:37:59.922857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4cfde8a2-1ab3-4fc9-8264-673a059cf36f tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b42ca0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:00.384973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4cfde8a2-1ab3-4fc9-8264-673a059cf36f tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 202 len: 0 microversion: 2.1 time: 0.465922 Jul 14 09:38:00.385721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 10/24] 10.222.0.40 () {58 vars in 1253 bytes} [Thu Jul 14 09:37:59 2022] DELETE /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 09:38:00.394710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fbaf0fdf-2ab0-483b-8cdf-093fe097f4e6 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3b42c10>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:00.477581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fbaf0fdf-2ab0-483b-8cdf-093fe097f4e6 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 200 len: 287 microversion: 2.1 time: 0.087463 Jul 14 09:38:00.478387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 11/25] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:38:00 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:01.416132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:38:01.416604 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:38:01.417298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:38:01.417991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:38:01.422774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:38:01.442580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:01.443487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:01.444617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:01.445519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:01.585544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Getting quotas for project 84ed99374b3b42b3b4cc3d68b2a67ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:38:01.601484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Getting quotas for user 9b6ae4ed064a44c882b44b07d5595665 and project 84ed99374b3b42b3b4cc3d68b2a67ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:38:01.660598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:38:01.667909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:38:01.893321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-07773c5e-3299-47ae-981a-76df5a3b5d99 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.615144 Jul 14 09:38:01.894052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 15/26] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:37:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:38:01.915704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7b6a79ce-43d8-4f9c-a0fb-8a56ca0a6a6d tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da3a30c10>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:01.999613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-7b6a79ce-43d8-4f9c-a0fb-8a56ca0a6a6d tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] HTTP exception thrown: Snapshot 003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f could not be found. Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7b6a79ce-43d8-4f9c-a0fb-8a56ca0a6a6d tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Request method failure captured: Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f HTTP/1.1 Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PoyKUyRGIxSIZ_VLdilpBdjuDBxC-VYuqnlty-tH88a3dRBTb-2zzKMTFyDSRqLUNdlUJTUoRhYHxq6DCvuoLzCNESESyc6TVfDTStI4sQnF6ZicxOcnnEfqbLGQ3CsZtf7fVgpIppBUZ-MwTm13u4Z_rJzoK0UOC0bOYLyaOqiMs Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 0dde10631582463ab587bc4c275c856d Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:38:02.001967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0dde10631582463ab587bc4c275c856d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0dde10631582463ab587bc4c275c856d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0dde10631582463ab587bc4c275c856d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0dde10631582463ab587bc4c275c856d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 0dde10631582463ab587bc4c275c856d Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotsTestJSON-809863703-project Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 9cb02e863d1f4da6b29fd29674d92e33 Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotsTestJSON-809863703-project Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Snapshot 003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f could not be found. Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f'} Jul 14 09:38:02.003034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f could not be found. (HTTP 404) (Request-ID: req-b678fd11-9f56-42da-b011-649df8010a1c) Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:02.003670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:38:02.004890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f could not be found. Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 09:38:02.007694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f could not be found. Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f could not be found. Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7b6a79ce-43d8-4f9c-a0fb-8a56ca0a6a6d tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Returning 404 to user: Snapshot 003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7b6a79ce-43d8-4f9c-a0fb-8a56ca0a6a6d tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f" status: 404 len: 111 microversion: 2.1 time: 0.106946 Jul 14 09:38:02.010307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 16/27] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 09:38:01 2022] GET /compute/v2.1/os-snapshots/003b6be6-a2dc-4b8a-80ff-9d76b7e9b66f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:38:02.084130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bd42edb1-58fc-43ff-b5ef-7a9f97bf984d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Action: 'create', calling method: .version_select at 0x7f7da3b425e0>, body: {"keypair": {"name": "tempest-keypair-455870700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsdBQSTqWxtGavY+98WKTTMfDuu4jzjHN1vu4fsPPY/SKlTC/wu7V3BHcCxMRfCbNmJL5NfWrIzYZ25G6HMn1lF4cLIYt2kQxs+ArWPX5ptejQK5CqLK69BU/FqDBTrFQ=="}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:02.129036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-bd42edb1-58fc-43ff-b5ef-7a9f97bf984d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Getting quotas for project e4d87102c8234c7f9ba0c1a6299ba3d7. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:38:02.155997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-bd42edb1-58fc-43ff-b5ef-7a9f97bf984d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Getting quotas for user f50c3855aa764c2fb86c48c90eb9e15c and project e4d87102c8234c7f9ba0c1a6299ba3d7. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:38:02.246974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bd42edb1-58fc-43ff-b5ef-7a9f97bf984d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.861257 Jul 14 09:38:02.251669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 12/28] 10.222.0.40 () {62 vars in 1199 bytes} [Thu Jul 14 09:38:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 877 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 09:38:02.260429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-565df6da-13f7-49dd-862d-6e004581ef08 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:02.264250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-565df6da-13f7-49dd-862d-6e004581ef08 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:02.349864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1737861899", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:02.444673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] validate_networks() for [('9f202f74-cfe8-4c79-b9f2-92b6b8371392', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:38:02.548984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-565df6da-13f7-49dd-862d-6e004581ef08 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:02.593740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-565df6da-13f7-49dd-862d-6e004581ef08 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1215 microversion: 2.1 time: 0.339977 Jul 14 09:38:02.603987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 13/29] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:02 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1215 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:02.628791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1d8c95fc-89ff-44e7-86b7-d36f9642b151 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da32cf700>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:02.757887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1d8c95fc-89ff-44e7-86b7-d36f9642b151 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366" status: 202 len: 0 microversion: 2.1 time: 0.142133 Jul 14 09:38:02.761661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 14/30] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 09:38:02 2022] DELETE /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:38:02.770024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5ee2862e-f849-4afb-98f1-8fab9a636897 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da328ea60>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:02.867565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5ee2862e-f849-4afb-98f1-8fab9a636897 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366" status: 200 len: 345 microversion: 2.1 time: 0.102377 Jul 14 09:38:02.868782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 15/31] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:02 2022] GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:03.623932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a349fcdd-e58e-4d11-bc96-9b19b0a81dbf tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:03.626540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a349fcdd-e58e-4d11-bc96-9b19b0a81dbf tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:03.675984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:38:03.676422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:38:03.676969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:38:03.677244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:38:03.677827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:38:03.703558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:03.713131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:03.713131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:03.713131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:03.790083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Getting quotas for project f35a70c5090a4570ad8ba3701dad3f80. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:38:03.813798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Getting quotas for user f1d0b9390f474de79828a675d4e0646a and project f35a70c5090a4570ad8ba3701dad3f80. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:38:03.839391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:38:03.844435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:38:03.894475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a349fcdd-e58e-4d11-bc96-9b19b0a81dbf tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:03.906642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a349fcdd-e58e-4d11-bc96-9b19b0a81dbf tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1215 microversion: 2.1 time: 0.286400 Jul 14 09:38:03.909894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 16/32] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:03 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1215 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:03.931290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-edd35862-a7b1-4c51-836b-90e931be4b39 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da328ef70>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:03.958073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0dc441d8-cbec-4cdb-83af-5d87f73b60f6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.952797 Jul 14 09:38:03.960445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 17/33] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:38:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:38:03.971964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0ec18a0f-000c-441a-8dcb-4ad9eea4d4ae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:03.974955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0ec18a0f-000c-441a-8dcb-4ad9eea4d4ae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:04.057227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-edd35862-a7b1-4c51-836b-90e931be4b39 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] HTTP exception thrown: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-edd35862-a7b1-4c51-836b-90e931be4b39 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Request method failure captured: Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 HTTP/1.1 Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-PoyKUyRGIxSIZ_VLdilpBdjuDBxC-VYuqnlty-tH88a3dRBTb-2zzKMTFyDSRqLUNdlUJTUoRhYHxq6DCvuoLzCNESESyc6TVfDTStI4sQnF6ZicxOcnnEfqbLGQ3CsZtf7fVgpIppBUZ-MwTm13u4Z_rJzoK0UOC0bOYLyaOqiMs Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 0dde10631582463ab587bc4c275c856d Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:38:04.072320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0dde10631582463ab587bc4c275c856d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0dde10631582463ab587bc4c275c856d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0dde10631582463ab587bc4c275c856d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0dde10631582463ab587bc4c275c856d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 0dde10631582463ab587bc4c275c856d Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-VolumesSnapshotsTestJSON-809863703-project Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 9cb02e863d1f4da6b29fd29674d92e33 Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-VolumesSnapshotsTestJSON-809863703-project Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '222af170-e25c-439e-a99a-2af388a4b366'} Jul 14 09:38:04.073806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. (HTTP 404) (Request-ID: req-1f817f2a-23f0-482d-83be-8552af8ea810) Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.074674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:38:04.075747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 09:38:04.076777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.077777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-edd35862-a7b1-4c51-836b-90e931be4b39 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Returning 404 to user: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:38:04.079561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-edd35862-a7b1-4c51-836b-90e931be4b39 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366" status: 404 len: 109 microversion: 2.1 time: 0.165459 Jul 14 09:38:04.081541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 17/34] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:03 2022] GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:38:04.107121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1515559933", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d18e0618-14d4-4101-85c8-7617d5de1451"}], "security_groups": [{"name": "tempest-securitygroup--1452658464"}], "key_name": "tempest-keypair-1244140682", "user_data": "}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:04.217888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0ec18a0f-000c-441a-8dcb-4ad9eea4d4ae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:04.259323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0ec18a0f-000c-441a-8dcb-4ad9eea4d4ae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1222 microversion: 2.1 time: 0.292354 Jul 14 09:38:04.270991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 18/35] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:03 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1222 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:04.302245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-64b786f5-8e7a-47ad-9592-01c97e4bf7c4 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da29d8d30>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:04.512545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-64b786f5-8e7a-47ad-9592-01c97e4bf7c4 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] HTTP exception thrown: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-64b786f5-8e7a-47ad-9592-01c97e4bf7c4 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Request method failure captured: Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 HTTP/1.1 Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PoyKUyRGIxSIZ_VLdilpBdjuDBxC-VYuqnlty-tH88a3dRBTb-2zzKMTFyDSRqLUNdlUJTUoRhYHxq6DCvuoLzCNESESyc6TVfDTStI4sQnF6ZicxOcnnEfqbLGQ3CsZtf7fVgpIppBUZ-MwTm13u4Z_rJzoK0UOC0bOYLyaOqiMs Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 0dde10631582463ab587bc4c275c856d Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:38:04.514782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0dde10631582463ab587bc4c275c856d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0dde10631582463ab587bc4c275c856d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0dde10631582463ab587bc4c275c856d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0dde10631582463ab587bc4c275c856d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 0dde10631582463ab587bc4c275c856d Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotsTestJSON-809863703-project Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 9cb02e863d1f4da6b29fd29674d92e33 Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotsTestJSON-809863703-project Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '222af170-e25c-439e-a99a-2af388a4b366'} Jul 14 09:38:04.516064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. (HTTP 404) (Request-ID: req-2e123a18-67ca-4e25-9da9-53135038ad2f) Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.517291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 09:38:04.518460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 09:38:04.519404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-64b786f5-8e7a-47ad-9592-01c97e4bf7c4 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Returning 404 to user: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-64b786f5-8e7a-47ad-9592-01c97e4bf7c4 tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366" status: 404 len: 109 microversion: 2.1 time: 0.236442 Jul 14 09:38:04.520336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 19/36] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 09:38:04 2022] DELETE /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 => generated 109 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:38:04.525777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-545046a7-e3b1-41d6-a6b0-2ed861b003cf tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Calling method '.version_select at 0x7f7da29c7700>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:04.700039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] validate_networks() for [('d18e0618-14d4-4101-85c8-7617d5de1451', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:38:04.757351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-545046a7-e3b1-41d6-a6b0-2ed861b003cf tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] HTTP exception thrown: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-545046a7-e3b1-41d6-a6b0-2ed861b003cf tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Request method failure captured: Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 HTTP/1.1 Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-PoyKUyRGIxSIZ_VLdilpBdjuDBxC-VYuqnlty-tH88a3dRBTb-2zzKMTFyDSRqLUNdlUJTUoRhYHxq6DCvuoLzCNESESyc6TVfDTStI4sQnF6ZicxOcnnEfqbLGQ3CsZtf7fVgpIppBUZ-MwTm13u4Z_rJzoK0UOC0bOYLyaOqiMs Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 0dde10631582463ab587bc4c275c856d Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:38:04.759418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0dde10631582463ab587bc4c275c856d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0dde10631582463ab587bc4c275c856d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0dde10631582463ab587bc4c275c856d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0dde10631582463ab587bc4c275c856d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 0dde10631582463ab587bc4c275c856d Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-809863703 Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotsTestJSON-809863703-project Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 9cb02e863d1f4da6b29fd29674d92e33 Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotsTestJSON-809863703-project Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '222af170-e25c-439e-a99a-2af388a4b366'} Jul 14 09:38:04.760796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. (HTTP 404) (Request-ID: req-d65f1265-4bb0-4ab2-993b-547dca9dc068) Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.761611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:38:04.762638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 09:38:04.763588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-545046a7-e3b1-41d6-a6b0-2ed861b003cf tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] Returning 404 to user: Volume 222af170-e25c-439e-a99a-2af388a4b366 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-545046a7-e3b1-41d6-a6b0-2ed861b003cf tempest-VolumesSnapshotsTestJSON-809863703 tempest-VolumesSnapshotsTestJSON-809863703-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366" status: 404 len: 109 microversion: 2.1 time: 0.239451 Jul 14 09:38:04.764557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 20/37] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:04 2022] GET /compute/v2.1/os-volumes/222af170-e25c-439e-a99a-2af388a4b366 => generated 109 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:38:04.766787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2079977360", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:04.887364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] validate_networks() for [('9f202f74-cfe8-4c79-b9f2-92b6b8371392', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:38:07.206218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:38:07.206880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:38:07.207192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:38:07.208007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:38:07.208428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:38:07.230684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:07.231164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:07.236415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:07.236886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:07.280053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Getting quotas for project f35a70c5090a4570ad8ba3701dad3f80. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:38:07.298794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Getting quotas for user f1d0b9390f474de79828a675d4e0646a and project f35a70c5090a4570ad8ba3701dad3f80. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:38:07.323770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:38:07.339922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:38:07.527468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0faba440-51ef-4345-bada-fb92c54caaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.764634 Jul 14 09:38:07.531248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 21/38] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:38:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:38:07.545175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-52a89f59-f0ad-4196-9d38-aab20e03d065 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:07.546733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-52a89f59-f0ad-4196-9d38-aab20e03d065 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:07.601011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52a89f59-f0ad-4196-9d38-aab20e03d065 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:07.601011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52a89f59-f0ad-4196-9d38-aab20e03d065 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:07.601700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52a89f59-f0ad-4196-9d38-aab20e03d065 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:07.602143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52a89f59-f0ad-4196-9d38-aab20e03d065 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:07.705152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:38:07.705930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:38:07.706098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:38:07.706703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:38:07.707920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:38:07.773896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:07.774504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:07.775407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:07.775850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:07.940314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Getting quotas for project 140620648e604251bc9c5c1a0e9c483b. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:38:07.959697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Getting quotas for user 688f473972144fb6b7a398c1f775a5c1 and project 140620648e604251bc9c5c1a0e9c483b. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:38:08.015979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:38:08.025981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:38:08.191991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-26d40ada-1c3c-4868-959f-1141d0de8f83 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.104003 Jul 14 09:38:08.192848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 18/39] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:38:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 4111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:38:08.204744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-08a343dd-d008-4f9c-af30-0251568e8338 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:08.206306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-08a343dd-d008-4f9c-af30-0251568e8338 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:08.311026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-52a89f59-f0ad-4196-9d38-aab20e03d065 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:08.335055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-52a89f59-f0ad-4196-9d38-aab20e03d065 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1273 microversion: 2.1 time: 0.802044 Jul 14 09:38:08.336037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 22/40] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:07 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1273 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:08.341111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a72e461d-0d5e-4fbf-a666-f355a27c61b4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:08.341991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a72e461d-0d5e-4fbf-a666-f355a27c61b4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:08.425725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-08a343dd-d008-4f9c-af30-0251568e8338 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:08.439150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-08a343dd-d008-4f9c-af30-0251568e8338 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1222 microversion: 2.1 time: 0.242796 Jul 14 09:38:08.441876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 19/41] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:08 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1222 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:08.478840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a72e461d-0d5e-4fbf-a666-f355a27c61b4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:08.488946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a72e461d-0d5e-4fbf-a666-f355a27c61b4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1238 microversion: 2.1 time: 0.150435 Jul 14 09:38:08.489549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 23/42] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:08 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1238 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:09.353219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a9ab29e7-41dc-49a8-9cba-0b261e55e94e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:09.354518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a9ab29e7-41dc-49a8-9cba-0b261e55e94e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:09.374916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a9ab29e7-41dc-49a8-9cba-0b261e55e94e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:09.375466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a9ab29e7-41dc-49a8-9cba-0b261e55e94e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:09.376380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a9ab29e7-41dc-49a8-9cba-0b261e55e94e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:09.377777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a9ab29e7-41dc-49a8-9cba-0b261e55e94e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:09.415391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-950719429", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5490315d-3e4a-465a-9671-ccf13d951e7e"}], "security_groups": [{"name": "tempest-securitygroup--627894920"}], "key_name": "tempest-keypair-455870700", "user_data": "}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:09.680962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] validate_networks() for [('5490315d-3e4a-465a-9671-ccf13d951e7e', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:38:09.685019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a9ab29e7-41dc-49a8-9cba-0b261e55e94e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:09.706029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a9ab29e7-41dc-49a8-9cba-0b261e55e94e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1273 microversion: 2.1 time: 0.356921 Jul 14 09:38:09.707446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 20/43] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:09 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:09.714057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-40defa0d-eb36-47ab-8b04-9af14c78bcc8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:09.714836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-40defa0d-eb36-47ab-8b04-9af14c78bcc8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:09.725238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-40defa0d-eb36-47ab-8b04-9af14c78bcc8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:09.725684 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-40defa0d-eb36-47ab-8b04-9af14c78bcc8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:09.727107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-40defa0d-eb36-47ab-8b04-9af14c78bcc8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:09.728190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-40defa0d-eb36-47ab-8b04-9af14c78bcc8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:09.846835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-40defa0d-eb36-47ab-8b04-9af14c78bcc8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:09.854295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-40defa0d-eb36-47ab-8b04-9af14c78bcc8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1226 microversion: 2.1 time: 0.145731 Jul 14 09:38:09.854865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 21/44] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:09 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1226 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:09.868455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-973337b8-1caf-45d9-94fd-8de92ece7587 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:09.869375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-973337b8-1caf-45d9-94fd-8de92ece7587 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:09.878406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-973337b8-1caf-45d9-94fd-8de92ece7587 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:09.880522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-973337b8-1caf-45d9-94fd-8de92ece7587 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:09.881285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-973337b8-1caf-45d9-94fd-8de92ece7587 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:09.881778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-973337b8-1caf-45d9-94fd-8de92ece7587 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:10.002296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-973337b8-1caf-45d9-94fd-8de92ece7587 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:10.011428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-973337b8-1caf-45d9-94fd-8de92ece7587 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1242 microversion: 2.1 time: 0.150395 Jul 14 09:38:10.015800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 22/45] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:09 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1242 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:10.706443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e15c407d-6c0d-4e95-bde2-489edc014a6d tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Action: 'create', calling method: .version_select at 0x7f7da20ca0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-912159888", "metadata": {"Type": "work"}}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:10.723427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:38:10.723978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:38:10.724349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:38:10.724730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:38:10.725139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:38:10.739360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:10.739814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:10.740609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:10.741055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:10.803364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Getting quotas for project e4d87102c8234c7f9ba0c1a6299ba3d7. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:38:10.810812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Getting quotas for user f50c3855aa764c2fb86c48c90eb9e15c and project e4d87102c8234c7f9ba0c1a6299ba3d7. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:38:10.834697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:38:10.837375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:38:10.933968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8717dbfa-6364-4cc5-a1e4-8368ce1d32bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.523102 Jul 14 09:38:10.937688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 24/46] 10.222.0.40 () {62 vars in 1187 bytes} [Thu Jul 14 09:38:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 09:38:10.949111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d32888d9-f363-4081-830b-899503b0b4f2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:10.951223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d32888d9-f363-4081-830b-899503b0b4f2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:10.970234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d32888d9-f363-4081-830b-899503b0b4f2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:10.970864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d32888d9-f363-4081-830b-899503b0b4f2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:10.973019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d32888d9-f363-4081-830b-899503b0b4f2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:10.974640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d32888d9-f363-4081-830b-899503b0b4f2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:11.128322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d32888d9-f363-4081-830b-899503b0b4f2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:11.145927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d32888d9-f363-4081-830b-899503b0b4f2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1273 microversion: 2.1 time: 0.203683 Jul 14 09:38:11.148301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 25/47] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:10 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:11.153413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5fcbb6db-a93e-4281-b8f0-10b7bc70e2e5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:11.155466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5fcbb6db-a93e-4281-b8f0-10b7bc70e2e5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:11.164535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fcbb6db-a93e-4281-b8f0-10b7bc70e2e5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:11.165015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fcbb6db-a93e-4281-b8f0-10b7bc70e2e5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:11.173204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fcbb6db-a93e-4281-b8f0-10b7bc70e2e5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:11.173831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fcbb6db-a93e-4281-b8f0-10b7bc70e2e5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:11.350245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5fcbb6db-a93e-4281-b8f0-10b7bc70e2e5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:11.360182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5fcbb6db-a93e-4281-b8f0-10b7bc70e2e5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1226 microversion: 2.1 time: 0.209827 Jul 14 09:38:11.361237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 26/48] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:11 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1226 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:11.362399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e15c407d-6c0d-4e95-bde2-489edc014a6d tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.099310 Jul 14 09:38:11.363016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 23/49] 10.222.0.40 () {60 vars in 1155 bytes} [Thu Jul 14 09:38:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1103 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 09:38:11.366713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dff4759c-2925-4046-947c-df002e1c2426 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:11.367617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dff4759c-2925-4046-947c-df002e1c2426 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:11.367831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c1e18ac4-6746-4dc2-8d55-4f02a1fc3372 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:11.368486 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c1e18ac4-6746-4dc2-8d55-4f02a1fc3372 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:11.380013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1e18ac4-6746-4dc2-8d55-4f02a1fc3372 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:11.381790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1e18ac4-6746-4dc2-8d55-4f02a1fc3372 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:11.384196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1e18ac4-6746-4dc2-8d55-4f02a1fc3372 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:11.384801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1e18ac4-6746-4dc2-8d55-4f02a1fc3372 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:11.599847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dff4759c-2925-4046-947c-df002e1c2426 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:11.612694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dff4759c-2925-4046-947c-df002e1c2426 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:11.619493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dff4759c-2925-4046-947c-df002e1c2426 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:11.621202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c1e18ac4-6746-4dc2-8d55-4f02a1fc3372 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:11.622219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dff4759c-2925-4046-947c-df002e1c2426 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1280 microversion: 2.20 time: 0.259094 Jul 14 09:38:11.624535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 27/50] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1280 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:11.630473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c1e18ac4-6746-4dc2-8d55-4f02a1fc3372 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1242 microversion: 2.1 time: 0.266389 Jul 14 09:38:11.632785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 24/51] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:11 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1242 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:11.633974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ad590347-3527-48ef-8af5-d1311a76fa27 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da28d5160>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:11.741797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ad590347-3527-48ef-8af5-d1311a76fa27 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 200 len: 352 microversion: 2.1 time: 0.115420 Jul 14 09:38:11.747223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 28/52] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:11 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:12.165703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-572ef2b6-422a-4b09-9239-1e6a78c52f5c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:12.167720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-572ef2b6-422a-4b09-9239-1e6a78c52f5c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:12.188185 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-572ef2b6-422a-4b09-9239-1e6a78c52f5c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:12.191624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-572ef2b6-422a-4b09-9239-1e6a78c52f5c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:12.193494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-572ef2b6-422a-4b09-9239-1e6a78c52f5c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:12.193818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-572ef2b6-422a-4b09-9239-1e6a78c52f5c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:12.379349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5f0fb24f-a25e-4591-a14d-ad1f43fc1fdd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:12.380308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5f0fb24f-a25e-4591-a14d-ad1f43fc1fdd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:12.394507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f0fb24f-a25e-4591-a14d-ad1f43fc1fdd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:12.397388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f0fb24f-a25e-4591-a14d-ad1f43fc1fdd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:12.401564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f0fb24f-a25e-4591-a14d-ad1f43fc1fdd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:12.402333 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f0fb24f-a25e-4591-a14d-ad1f43fc1fdd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:12.446288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-572ef2b6-422a-4b09-9239-1e6a78c52f5c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:12.484580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-572ef2b6-422a-4b09-9239-1e6a78c52f5c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1273 microversion: 2.1 time: 0.323994 Jul 14 09:38:12.491272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 25/53] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:12 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:12.644638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:12.645221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:12.655327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:12.655474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5f0fb24f-a25e-4591-a14d-ad1f43fc1fdd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:12.655779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:12.656557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:12.663490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5f0fb24f-a25e-4591-a14d-ad1f43fc1fdd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1226 microversion: 2.1 time: 0.290258 Jul 14 09:38:12.669735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 29/54] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:12 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1226 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:12.674799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a751fa38-c5b8-43f9-95ba-1d5e0eeda72e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:12.674960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:12.687797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a751fa38-c5b8-43f9-95ba-1d5e0eeda72e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:12.716724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a751fa38-c5b8-43f9-95ba-1d5e0eeda72e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:12.718505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a751fa38-c5b8-43f9-95ba-1d5e0eeda72e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:12.723693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a751fa38-c5b8-43f9-95ba-1d5e0eeda72e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:12.724634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a751fa38-c5b8-43f9-95ba-1d5e0eeda72e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:12.970708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a751fa38-c5b8-43f9-95ba-1d5e0eeda72e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:12.976953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:12.996783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a751fa38-c5b8-43f9-95ba-1d5e0eeda72e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.325563 Jul 14 09:38:13.005600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:13.007358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:13.008561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-89727ec5-303a-4786-b4d4-657890cffafa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1284 microversion: 2.20 time: 0.369513 Jul 14 09:38:13.009060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 30/55] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:12 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:13.024327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0c494c52-b661-4efa-b5f6-845165a2fdf9 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da2933430>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:13.030633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 26/56] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1284 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:13.180368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0c494c52-b661-4efa-b5f6-845165a2fdf9 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 200 len: 353 microversion: 2.1 time: 0.170090 Jul 14 09:38:13.187551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 31/57] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:13 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:13.193181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-208093f1-0d8b-4754-93c9-e3adb586f6eb tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da20cac10>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:13.354406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-208093f1-0d8b-4754-93c9-e3adb586f6eb tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 200 len: 353 microversion: 2.1 time: 0.165138 Jul 14 09:38:13.355514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 27/58] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:13 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:13.371563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9d1a2d21-d08e-4320-8624-8d761dc74aa6 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da2933dc0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:13.503184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a24c505d-3568-4600-8bc4-5b0add24c1d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:13.503790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a24c505d-3568-4600-8bc4-5b0add24c1d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:13.524853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a24c505d-3568-4600-8bc4-5b0add24c1d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:13.525682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a24c505d-3568-4600-8bc4-5b0add24c1d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:13.526705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a24c505d-3568-4600-8bc4-5b0add24c1d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:13.527292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a24c505d-3568-4600-8bc4-5b0add24c1d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:13.545252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9d1a2d21-d08e-4320-8624-8d761dc74aa6 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 202 len: 0 microversion: 2.1 time: 0.177541 Jul 14 09:38:13.545840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 09:38:13 2022] DELETE /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:38:13.554009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-28eca604-3b67-4a7b-bbb9-a9df942ca56a tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da291a940>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:13.672038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-28eca604-3b67-4a7b-bbb9-a9df942ca56a tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 200 len: 352 microversion: 2.1 time: 0.121679 Jul 14 09:38:13.672592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 33/60] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:13 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 352 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:38:13.682502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c70d177-6ca6-4582-828b-fd04cb0cd4dd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:13.683585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c70d177-6ca6-4582-828b-fd04cb0cd4dd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:13.693781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c70d177-6ca6-4582-828b-fd04cb0cd4dd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:13.694440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c70d177-6ca6-4582-828b-fd04cb0cd4dd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:13.695317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c70d177-6ca6-4582-828b-fd04cb0cd4dd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:13.695871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c70d177-6ca6-4582-828b-fd04cb0cd4dd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:13.743716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a24c505d-3568-4600-8bc4-5b0add24c1d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:13.758748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a24c505d-3568-4600-8bc4-5b0add24c1d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1273 microversion: 2.1 time: 0.261599 Jul 14 09:38:13.759906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 28/61] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:13 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:13.816487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1c70d177-6ca6-4582-828b-fd04cb0cd4dd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:13.829876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c70d177-6ca6-4582-828b-fd04cb0cd4dd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.151176 Jul 14 09:38:13.830663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 34/62] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:13 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:14.014694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-da83f9d5-8c5d-4fcc-a503-da34c5c33ae9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:14.015315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-da83f9d5-8c5d-4fcc-a503-da34c5c33ae9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:14.027749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da83f9d5-8c5d-4fcc-a503-da34c5c33ae9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:14.031116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:14.032486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:14.035053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da83f9d5-8c5d-4fcc-a503-da34c5c33ae9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:14.035895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da83f9d5-8c5d-4fcc-a503-da34c5c33ae9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:14.036342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da83f9d5-8c5d-4fcc-a503-da34c5c33ae9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:14.051363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:14.052177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:14.053775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:14.054541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:14.242424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:14.242856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-da83f9d5-8c5d-4fcc-a503-da34c5c33ae9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:14.255546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:14.257547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:14.261945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-da83f9d5-8c5d-4fcc-a503-da34c5c33ae9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.250439 Jul 14 09:38:14.263533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-083e251c-a7e7-4088-a0fd-654dcfdefea5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1284 microversion: 2.20 time: 0.239401 Jul 14 09:38:14.264679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 35/63] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:14.274329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 29/64] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:14 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:14.684613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9b32edea-68db-4f4b-8862-93cdf8acb48b tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da28d51f0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:14.777613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9b32edea-68db-4f4b-8862-93cdf8acb48b tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 200 len: 352 microversion: 2.1 time: 0.096904 Jul 14 09:38:14.783747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 36/65] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:14 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:14.785597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4b7e326b-fa99-4fe1-a30b-e519f8c40d88 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:14.786255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4b7e326b-fa99-4fe1-a30b-e519f8c40d88 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:14.802535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b7e326b-fa99-4fe1-a30b-e519f8c40d88 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:14.802993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b7e326b-fa99-4fe1-a30b-e519f8c40d88 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:14.804956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b7e326b-fa99-4fe1-a30b-e519f8c40d88 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:14.807879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b7e326b-fa99-4fe1-a30b-e519f8c40d88 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:14.849503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6b6cbc74-81d7-4176-ba3b-f7b3a0942523 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:14.850481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6b6cbc74-81d7-4176-ba3b-f7b3a0942523 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:14.865071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b6cbc74-81d7-4176-ba3b-f7b3a0942523 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:14.865617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b6cbc74-81d7-4176-ba3b-f7b3a0942523 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:14.867163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b6cbc74-81d7-4176-ba3b-f7b3a0942523 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:14.868301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b6cbc74-81d7-4176-ba3b-f7b3a0942523 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:15.188572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6b6cbc74-81d7-4176-ba3b-f7b3a0942523 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:15.204054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6b6cbc74-81d7-4176-ba3b-f7b3a0942523 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.360006 Jul 14 09:38:15.204717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 37/66] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:14 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:15.281773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b4f12613-03a3-4b77-a484-43af74d34365 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:15.283224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b4f12613-03a3-4b77-a484-43af74d34365 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:15.297208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4f12613-03a3-4b77-a484-43af74d34365 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:15.297656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4f12613-03a3-4b77-a484-43af74d34365 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:15.298464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4f12613-03a3-4b77-a484-43af74d34365 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:15.298895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4f12613-03a3-4b77-a484-43af74d34365 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:15.458396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4b7e326b-fa99-4fe1-a30b-e519f8c40d88 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:15.467263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4b7e326b-fa99-4fe1-a30b-e519f8c40d88 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.694812 Jul 14 09:38:15.473877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 30/67] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:14 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:15.485027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:15.486146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:15.495623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:15.497624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:15.508278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b4f12613-03a3-4b77-a484-43af74d34365 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:15.516986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b4f12613-03a3-4b77-a484-43af74d34365 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.239272 Jul 14 09:38:15.518572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:15.519026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:15.528483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 38/68] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:15 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:15.631446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:15.642716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:15.645473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:15.646898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8bb0f00b-4fe0-418d-beae-34da16f2b859 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.172023 Jul 14 09:38:15.648128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 31/69] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:15.790737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5b415d0c-8a68-4ce5-be6b-bb76d7086997 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da2933280>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:15.869970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5b415d0c-8a68-4ce5-be6b-bb76d7086997 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 200 len: 352 microversion: 2.1 time: 0.082959 Jul 14 09:38:15.870573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 39/70] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:15 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:16.223717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-44c87ba1-d164-4bab-8135-2cbdbdf9dacd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:16.224412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-44c87ba1-d164-4bab-8135-2cbdbdf9dacd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:16.231442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44c87ba1-d164-4bab-8135-2cbdbdf9dacd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:16.232156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44c87ba1-d164-4bab-8135-2cbdbdf9dacd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:16.234079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44c87ba1-d164-4bab-8135-2cbdbdf9dacd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:16.234863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44c87ba1-d164-4bab-8135-2cbdbdf9dacd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:16.300899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-44c87ba1-d164-4bab-8135-2cbdbdf9dacd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:16.321750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-44c87ba1-d164-4bab-8135-2cbdbdf9dacd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.089201 Jul 14 09:38:16.322542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 32/71] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:16 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:16.491173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0bfdcf23-039b-4264-b6fd-1243ceffcc8b tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:16.491776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0bfdcf23-039b-4264-b6fd-1243ceffcc8b tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:16.499638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0bfdcf23-039b-4264-b6fd-1243ceffcc8b tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:16.500084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0bfdcf23-039b-4264-b6fd-1243ceffcc8b tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:16.500847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0bfdcf23-039b-4264-b6fd-1243ceffcc8b tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:16.501273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0bfdcf23-039b-4264-b6fd-1243ceffcc8b tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:16.536623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ca443b6a-e2e8-477e-8ce4-bf3e1df80e76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:16.537230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ca443b6a-e2e8-477e-8ce4-bf3e1df80e76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:16.543426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ca443b6a-e2e8-477e-8ce4-bf3e1df80e76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:16.544184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ca443b6a-e2e8-477e-8ce4-bf3e1df80e76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:16.545065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ca443b6a-e2e8-477e-8ce4-bf3e1df80e76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:16.545853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ca443b6a-e2e8-477e-8ce4-bf3e1df80e76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:16.656118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ca443b6a-e2e8-477e-8ce4-bf3e1df80e76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:16.663846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ca443b6a-e2e8-477e-8ce4-bf3e1df80e76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.131043 Jul 14 09:38:16.664425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 33/72] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:16 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:16.677568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:16.680335 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:16.688558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:16.689237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:16.690860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:16.691464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:16.719949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0bfdcf23-039b-4264-b6fd-1243ceffcc8b tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:16.729537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0bfdcf23-039b-4264-b6fd-1243ceffcc8b tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.241913 Jul 14 09:38:16.732892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 40/73] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:16 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:16.782536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:16.791469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:16.793042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:16.794256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c1e05b40-571e-4a2f-a2f6-ad22ef0c3f58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.126545 Jul 14 09:38:16.794756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 34/74] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:16.882984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c42c9e4a-4f2d-41c8-9016-b60079354e2f tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da2933b80>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:16.941761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c42c9e4a-4f2d-41c8-9016-b60079354e2f tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 200 len: 352 microversion: 2.1 time: 0.062629 Jul 14 09:38:16.942363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 41/75] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:16 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:17.339716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-07854a05-fbf6-497a-b6aa-c6b6e52cabae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:17.340627 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-07854a05-fbf6-497a-b6aa-c6b6e52cabae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:17.347860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07854a05-fbf6-497a-b6aa-c6b6e52cabae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:17.348669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07854a05-fbf6-497a-b6aa-c6b6e52cabae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:17.349669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07854a05-fbf6-497a-b6aa-c6b6e52cabae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:17.350328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07854a05-fbf6-497a-b6aa-c6b6e52cabae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:17.453066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-07854a05-fbf6-497a-b6aa-c6b6e52cabae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:17.465714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-07854a05-fbf6-497a-b6aa-c6b6e52cabae tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.130074 Jul 14 09:38:17.466317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 35/76] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:17 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:17.680686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0e1f0a7d-989e-4eeb-bbc7-3d9e58735983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:17.681303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0e1f0a7d-989e-4eeb-bbc7-3d9e58735983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:17.684405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:17.688485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e1f0a7d-989e-4eeb-bbc7-3d9e58735983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:17.688927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e1f0a7d-989e-4eeb-bbc7-3d9e58735983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:17.689683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e1f0a7d-989e-4eeb-bbc7-3d9e58735983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:17.690122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e1f0a7d-989e-4eeb-bbc7-3d9e58735983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:17.750003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-91c9c70d-a8a4-4051-a892-5c052bb47591 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:17.750997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-91c9c70d-a8a4-4051-a892-5c052bb47591 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:17.757072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0e1f0a7d-989e-4eeb-bbc7-3d9e58735983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:17.757620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91c9c70d-a8a4-4051-a892-5c052bb47591 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:17.759015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91c9c70d-a8a4-4051-a892-5c052bb47591 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:17.760113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91c9c70d-a8a4-4051-a892-5c052bb47591 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:17.760713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91c9c70d-a8a4-4051-a892-5c052bb47591 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:17.777010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0e1f0a7d-989e-4eeb-bbc7-3d9e58735983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.100136 Jul 14 09:38:17.778100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 42/77] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:17 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:17.814994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:17.815500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:17.821447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:17.821896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:17.822883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:17.823315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:17.881149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:17.914295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:17.925253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:17.927578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:17.929740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-526f5d19-0b3b-47ed-88f0-66ede14bb273 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.118806 Jul 14 09:38:17.943863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 43/78] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:17.956306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4570d6a6-a7e9-4039-b250-188d6e1dd773 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da296bd30>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:17.979559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-91c9c70d-a8a4-4051-a892-5c052bb47591 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:17.987691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-91c9c70d-a8a4-4051-a892-5c052bb47591 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.244453 Jul 14 09:38:17.994461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 36/79] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:17 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:18.061745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4570d6a6-a7e9-4039-b250-188d6e1dd773 tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 200 len: 352 microversion: 2.1 time: 0.110325 Jul 14 09:38:18.062358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 44/80] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:17 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:18.483121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0ca5f396-8190-49fd-a07c-18c206c9a9db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:18.483964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0ca5f396-8190-49fd-a07c-18c206c9a9db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:18.485714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=20 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:18.499666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ca5f396-8190-49fd-a07c-18c206c9a9db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:18.500109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ca5f396-8190-49fd-a07c-18c206c9a9db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:18.500885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ca5f396-8190-49fd-a07c-18c206c9a9db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:18.501571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ca5f396-8190-49fd-a07c-18c206c9a9db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:18.591111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0ca5f396-8190-49fd-a07c-18c206c9a9db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:18.599159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0ca5f396-8190-49fd-a07c-18c206c9a9db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.120452 Jul 14 09:38:18.599529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 37/81] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:18 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:18.797508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a062464b-ae83-4135-967d-78844b071d46 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:18.798866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a062464b-ae83-4135-967d-78844b071d46 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:18.819993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a062464b-ae83-4135-967d-78844b071d46 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:18.820451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a062464b-ae83-4135-967d-78844b071d46 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:18.821645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a062464b-ae83-4135-967d-78844b071d46 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:18.822281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a062464b-ae83-4135-967d-78844b071d46 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:18.917197 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a062464b-ae83-4135-967d-78844b071d46 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:18.928941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a062464b-ae83-4135-967d-78844b071d46 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.136239 Jul 14 09:38:18.929514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 45/82] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:18 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:18.953202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:18.953871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:18.966923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:18.967765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:18.971058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:18.971730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:18.976616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:19.007224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-07ec604b-c34c-4e9a-ba4c-b856f6f46c84 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:19.008146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-07ec604b-c34c-4e9a-ba4c-b856f6f46c84 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:19.016218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07ec604b-c34c-4e9a-ba4c-b856f6f46c84 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:19.017020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07ec604b-c34c-4e9a-ba4c-b856f6f46c84 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:19.018025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07ec604b-c34c-4e9a-ba4c-b856f6f46c84 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:19.018783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07ec604b-c34c-4e9a-ba4c-b856f6f46c84 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:19.062648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:19.071824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:19.077875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:19.087238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2abfd187-1baa-4c1a-982a-8a095acfc867 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.139785 Jul 14 09:38:19.087826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 38/83] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:19.093378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8a6a68bc-eed9-4a2d-92bb-150f28757c2a tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Calling method '.version_select at 0x7f7da20ca040>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:19.170644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-8a6a68bc-eed9-4a2d-92bb-150f28757c2a tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] HTTP exception thrown: Volume 1d082aae-7940-4975-86d6-c0f0b6d5081d could not be found. Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8a6a68bc-eed9-4a2d-92bb-150f28757c2a tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Request method failure captured: Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d HTTP/1.1 Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-QCFqoDjpkPRgDTfvbu9XC9WJAIabsOPMSKMlXnpGvxeUypjxFLeQFUKMQpghBwNWvOeE3FpESyPJuagnZoax9LY8gXTVz3gQmfCLh0-yedYSiwVikOG1mCijt6sZ8e5gMEqDYnvg-rN_BLXMoqDg8fLziTKN7GUG62lSaBhAI1dzM Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: e93b54fa3c984ebda354d3d6b872b083 Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-VolumesGetTestJSON-2085047530 Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:38:19.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e93b54fa3c984ebda354d3d6b872b083"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e93b54fa3c984ebda354d3d6b872b083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e93b54fa3c984ebda354d3d6b872b083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e93b54fa3c984ebda354d3d6b872b083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-VolumesGetTestJSON-2085047530 Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: e93b54fa3c984ebda354d3d6b872b083 Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-VolumesGetTestJSON-2085047530 Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-VolumesGetTestJSON-2085047530-project Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: bf275fc1ec8440bba63681b548f159fe Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-VolumesGetTestJSON-2085047530-project Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Volume 1d082aae-7940-4975-86d6-c0f0b6d5081d could not be found. Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '1d082aae-7940-4975-86d6-c0f0b6d5081d'} Jul 14 09:38:19.174489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d082aae-7940-4975-86d6-c0f0b6d5081d could not be found. (HTTP 404) (Request-ID: req-c6334b46-4339-4ff6-956e-1f81cda46c10) Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:19.175430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 09:38:19.176866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d082aae-7940-4975-86d6-c0f0b6d5081d could not be found. Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 09:38:19.178132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d082aae-7940-4975-86d6-c0f0b6d5081d could not be found. Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d082aae-7940-4975-86d6-c0f0b6d5081d could not be found. Jul 14 09:38:19.179378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:38:19.181792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8a6a68bc-eed9-4a2d-92bb-150f28757c2a tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] Returning 404 to user: Volume 1d082aae-7940-4975-86d6-c0f0b6d5081d could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:38:19.183080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8a6a68bc-eed9-4a2d-92bb-150f28757c2a tempest-VolumesGetTestJSON-2085047530 tempest-VolumesGetTestJSON-2085047530-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d" status: 404 len: 109 microversion: 2.1 time: 0.093583 Jul 14 09:38:19.183723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 39/84] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 09:38:19 2022] GET /compute/v2.1/os-volumes/1d082aae-7940-4975-86d6-c0f0b6d5081d => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:38:19.269609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-07ec604b-c34c-4e9a-ba4c-b856f6f46c84 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:19.279712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-07ec604b-c34c-4e9a-ba4c-b856f6f46c84 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.277611 Jul 14 09:38:19.288555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 46/85] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:19 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:19.617991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-75c3af46-4eb2-4bc0-b254-80f28d06f83b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:19.619111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-75c3af46-4eb2-4bc0-b254-80f28d06f83b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:19.635699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75c3af46-4eb2-4bc0-b254-80f28d06f83b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:19.636172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75c3af46-4eb2-4bc0-b254-80f28d06f83b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:19.637853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75c3af46-4eb2-4bc0-b254-80f28d06f83b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:19.639633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75c3af46-4eb2-4bc0-b254-80f28d06f83b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:19.786063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-75c3af46-4eb2-4bc0-b254-80f28d06f83b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:19.803751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-75c3af46-4eb2-4bc0-b254-80f28d06f83b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.190352 Jul 14 09:38:19.804937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 40/86] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:19 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:19.946464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-46948a0e-bd4a-4c37-8cd8-759cdd7754d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:19.947896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-46948a0e-bd4a-4c37-8cd8-759cdd7754d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:19.960130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46948a0e-bd4a-4c37-8cd8-759cdd7754d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:19.960852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46948a0e-bd4a-4c37-8cd8-759cdd7754d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:19.961938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46948a0e-bd4a-4c37-8cd8-759cdd7754d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:19.964773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46948a0e-bd4a-4c37-8cd8-759cdd7754d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:20.081452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-46948a0e-bd4a-4c37-8cd8-759cdd7754d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:20.096891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-46948a0e-bd4a-4c37-8cd8-759cdd7754d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.154321 Jul 14 09:38:20.097475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 47/87] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:19 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:20.112753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:20.113782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:20.121701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:20.122064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:20.126295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:20.128358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:20.221408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:20.235236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:20.236850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:20.237979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a142affb-c90d-471f-9b94-a418ceb45c41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.129243 Jul 14 09:38:20.238898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 41/88] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:20.296106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1431a7c1-ed15-4b9f-bce8-e1c3bde9c6f6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:20.296800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1431a7c1-ed15-4b9f-bce8-e1c3bde9c6f6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:20.302885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1431a7c1-ed15-4b9f-bce8-e1c3bde9c6f6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:20.303341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1431a7c1-ed15-4b9f-bce8-e1c3bde9c6f6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:20.304153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1431a7c1-ed15-4b9f-bce8-e1c3bde9c6f6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:20.304744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1431a7c1-ed15-4b9f-bce8-e1c3bde9c6f6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:20.308910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:20.450622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1431a7c1-ed15-4b9f-bce8-e1c3bde9c6f6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:20.459146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1431a7c1-ed15-4b9f-bce8-e1c3bde9c6f6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.166838 Jul 14 09:38:20.459714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 48/89] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:20 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:20.824395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-93d3d0d4-77bf-4b1d-b130-6858fcf5ade8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:20.825015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-93d3d0d4-77bf-4b1d-b130-6858fcf5ade8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:20.843284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93d3d0d4-77bf-4b1d-b130-6858fcf5ade8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:20.843742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93d3d0d4-77bf-4b1d-b130-6858fcf5ade8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:20.844563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93d3d0d4-77bf-4b1d-b130-6858fcf5ade8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:20.845002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93d3d0d4-77bf-4b1d-b130-6858fcf5ade8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:20.960695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-93d3d0d4-77bf-4b1d-b130-6858fcf5ade8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:20.971286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-93d3d0d4-77bf-4b1d-b130-6858fcf5ade8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.150775 Jul 14 09:38:20.972497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 42/90] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:20 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:21.111567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=8 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:21.116530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6b3dddcb-92c9-4549-b536-7a6e379db090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:21.117150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6b3dddcb-92c9-4549-b536-7a6e379db090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:21.130171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b3dddcb-92c9-4549-b536-7a6e379db090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:21.130755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b3dddcb-92c9-4549-b536-7a6e379db090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:21.132120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b3dddcb-92c9-4549-b536-7a6e379db090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:21.132564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b3dddcb-92c9-4549-b536-7a6e379db090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:21.221793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6b3dddcb-92c9-4549-b536-7a6e379db090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:21.240045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6b3dddcb-92c9-4549-b536-7a6e379db090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.128388 Jul 14 09:38:21.242609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 49/91] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:21 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:21.258682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:21.259277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:21.266399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:21.267004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:21.268040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:21.268684 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:21.340540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:21.352917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:21.355068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:21.356665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-096c1110-652a-4006-8f6a-d50b3c0c08a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.102088 Jul 14 09:38:21.358472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 43/92] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:21.476121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-88d24eb6-9fd2-4e65-9126-9880de952a19 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:21.477253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-88d24eb6-9fd2-4e65-9126-9880de952a19 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:21.492506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-88d24eb6-9fd2-4e65-9126-9880de952a19 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:21.492961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-88d24eb6-9fd2-4e65-9126-9880de952a19 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:21.493732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-88d24eb6-9fd2-4e65-9126-9880de952a19 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:21.494165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-88d24eb6-9fd2-4e65-9126-9880de952a19 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:21.609375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=30 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:21.640126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-88d24eb6-9fd2-4e65-9126-9880de952a19 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:21.647450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-88d24eb6-9fd2-4e65-9126-9880de952a19 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.175974 Jul 14 09:38:21.647991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 50/93] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:21 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:21.987951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b0510e25-d18d-437f-a786-a4900181482a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:21.988564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b0510e25-d18d-437f-a786-a4900181482a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:21.994697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0510e25-d18d-437f-a786-a4900181482a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:21.995149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0510e25-d18d-437f-a786-a4900181482a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:21.995944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0510e25-d18d-437f-a786-a4900181482a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:21.996429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0510e25-d18d-437f-a786-a4900181482a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:22.059816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b0510e25-d18d-437f-a786-a4900181482a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:22.068124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b0510e25-d18d-437f-a786-a4900181482a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.084078 Jul 14 09:38:22.068692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 44/94] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:21 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:22.260711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-89635cb1-08ce-4f9e-9c13-5b7f03defa4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:22.261332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-89635cb1-08ce-4f9e-9c13-5b7f03defa4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:22.267914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89635cb1-08ce-4f9e-9c13-5b7f03defa4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:22.268419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89635cb1-08ce-4f9e-9c13-5b7f03defa4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:22.269261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89635cb1-08ce-4f9e-9c13-5b7f03defa4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:22.269802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89635cb1-08ce-4f9e-9c13-5b7f03defa4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:22.331819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-89635cb1-08ce-4f9e-9c13-5b7f03defa4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:22.339629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-89635cb1-08ce-4f9e-9c13-5b7f03defa4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.083030 Jul 14 09:38:22.340188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 51/95] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:22 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:22.376611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:22.377246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:22.380134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:22.384057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:22.384504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:22.385257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:22.385689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:22.445329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:22.453176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:22.454752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:22.455874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-93a75d7d-e1b8-45d9-a31d-fe67e8f7da4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.083965 Jul 14 09:38:22.456428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 45/96] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:22.664765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8d2fde61-c981-4fa7-93c3-4de12f54ca35 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:22.665398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8d2fde61-c981-4fa7-93c3-4de12f54ca35 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:22.672155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d2fde61-c981-4fa7-93c3-4de12f54ca35 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:22.672597 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d2fde61-c981-4fa7-93c3-4de12f54ca35 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:22.673349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d2fde61-c981-4fa7-93c3-4de12f54ca35 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:22.673779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d2fde61-c981-4fa7-93c3-4de12f54ca35 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:22.800709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8d2fde61-c981-4fa7-93c3-4de12f54ca35 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:22.808112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8d2fde61-c981-4fa7-93c3-4de12f54ca35 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.147293 Jul 14 09:38:22.808677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 52/97] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:22 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:23.086714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-97351141-6b0e-442f-b15a-84c3b91eafbc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:23.087239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-97351141-6b0e-442f-b15a-84c3b91eafbc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:23.094305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97351141-6b0e-442f-b15a-84c3b91eafbc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:23.094783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97351141-6b0e-442f-b15a-84c3b91eafbc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:23.095562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97351141-6b0e-442f-b15a-84c3b91eafbc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:23.096018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97351141-6b0e-442f-b15a-84c3b91eafbc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:23.157186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-97351141-6b0e-442f-b15a-84c3b91eafbc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:23.164575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-97351141-6b0e-442f-b15a-84c3b91eafbc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.081780 Jul 14 09:38:23.165134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 46/98] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:23 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:23.356427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3608ca8e-4a93-4f14-8a3c-db59611e2e31 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:23.356992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3608ca8e-4a93-4f14-8a3c-db59611e2e31 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:23.363550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3608ca8e-4a93-4f14-8a3c-db59611e2e31 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:23.363999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3608ca8e-4a93-4f14-8a3c-db59611e2e31 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:23.364872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3608ca8e-4a93-4f14-8a3c-db59611e2e31 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:23.365301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3608ca8e-4a93-4f14-8a3c-db59611e2e31 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:23.441535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3608ca8e-4a93-4f14-8a3c-db59611e2e31 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:23.450532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3608ca8e-4a93-4f14-8a3c-db59611e2e31 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.097861 Jul 14 09:38:23.451884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 53/99] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:23 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:23.474066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:23.475473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:23.481843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:23.482463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:23.483309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:23.483827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:23.548964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:23.557318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:23.558908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:23.560069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ef0621cd-5d22-411f-9acb-4fb9140d7cb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.090001 Jul 14 09:38:23.561247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 47/100] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:23.825116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-56b5093b-638f-4bcf-808e-2311e15bc3bc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:23.825757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-56b5093b-638f-4bcf-808e-2311e15bc3bc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:23.832510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56b5093b-638f-4bcf-808e-2311e15bc3bc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:23.832973 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56b5093b-638f-4bcf-808e-2311e15bc3bc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:23.833981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56b5093b-638f-4bcf-808e-2311e15bc3bc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:23.834513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56b5093b-638f-4bcf-808e-2311e15bc3bc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:23.974625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-56b5093b-638f-4bcf-808e-2311e15bc3bc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:23.981981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-56b5093b-638f-4bcf-808e-2311e15bc3bc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.160747 Jul 14 09:38:23.983076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 54/101] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:23 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:24.180983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ab788bca-8027-4bdc-be80-0db2b8408e90 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:24.181582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ab788bca-8027-4bdc-be80-0db2b8408e90 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:24.187864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab788bca-8027-4bdc-be80-0db2b8408e90 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:24.188299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab788bca-8027-4bdc-be80-0db2b8408e90 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:24.189047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab788bca-8027-4bdc-be80-0db2b8408e90 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:24.189470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab788bca-8027-4bdc-be80-0db2b8408e90 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:24.256035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ab788bca-8027-4bdc-be80-0db2b8408e90 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:24.263322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ab788bca-8027-4bdc-be80-0db2b8408e90 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.086272 Jul 14 09:38:24.263871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 48/102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:24 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:24.469779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e94e6eb7-7943-4ea1-99c8-e6e49a31b0e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:24.471063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e94e6eb7-7943-4ea1-99c8-e6e49a31b0e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:24.477473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e94e6eb7-7943-4ea1-99c8-e6e49a31b0e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:24.477920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e94e6eb7-7943-4ea1-99c8-e6e49a31b0e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:24.478712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e94e6eb7-7943-4ea1-99c8-e6e49a31b0e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:24.479148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e94e6eb7-7943-4ea1-99c8-e6e49a31b0e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:24.544406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e94e6eb7-7943-4ea1-99c8-e6e49a31b0e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:24.551907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e94e6eb7-7943-4ea1-99c8-e6e49a31b0e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.086648 Jul 14 09:38:24.552461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 55/103] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:24 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:24.578805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:24.579416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:24.585445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:24.585895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:24.586803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:24.587239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:24.661329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:24.669751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:24.671265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:24.672342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5dec06b6-9db4-48d7-996a-ff4520017fd4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.097969 Jul 14 09:38:24.672884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 49/104] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:24.999826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2d665af9-789f-4efc-86ea-c274bdcee278 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:25.000427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2d665af9-789f-4efc-86ea-c274bdcee278 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:25.006508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d665af9-789f-4efc-86ea-c274bdcee278 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:25.006958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d665af9-789f-4efc-86ea-c274bdcee278 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:25.007714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d665af9-789f-4efc-86ea-c274bdcee278 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:25.008257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d665af9-789f-4efc-86ea-c274bdcee278 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:25.151557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2d665af9-789f-4efc-86ea-c274bdcee278 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:25.159113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2d665af9-789f-4efc-86ea-c274bdcee278 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.163626 Jul 14 09:38:25.159932 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 56/105] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:24 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:25.279669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cc48b08b-4642-4dd4-92f4-00167fd3bb9c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:25.280355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cc48b08b-4642-4dd4-92f4-00167fd3bb9c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:25.286604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc48b08b-4642-4dd4-92f4-00167fd3bb9c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:25.287052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc48b08b-4642-4dd4-92f4-00167fd3bb9c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:25.287814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc48b08b-4642-4dd4-92f4-00167fd3bb9c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:25.288242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc48b08b-4642-4dd4-92f4-00167fd3bb9c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:25.358219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cc48b08b-4642-4dd4-92f4-00167fd3bb9c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:25.367196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cc48b08b-4642-4dd4-92f4-00167fd3bb9c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.091192 Jul 14 09:38:25.367772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 50/106] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:25 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:25.568022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bf744b64-1acd-43f5-91a1-41066224dbdc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:25.568625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bf744b64-1acd-43f5-91a1-41066224dbdc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:25.574625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf744b64-1acd-43f5-91a1-41066224dbdc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:25.575063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf744b64-1acd-43f5-91a1-41066224dbdc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:25.575870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf744b64-1acd-43f5-91a1-41066224dbdc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:25.576298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf744b64-1acd-43f5-91a1-41066224dbdc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:25.638536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bf744b64-1acd-43f5-91a1-41066224dbdc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:25.645850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bf744b64-1acd-43f5-91a1-41066224dbdc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.081624 Jul 14 09:38:25.646431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 57/107] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:25 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:25.689914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:25.690549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:25.696615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:25.697067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:25.697828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:25.698289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:25.759189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:25.767416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:25.768913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:25.770013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-40769d4b-8581-4d1d-9020-428b0fe3af4c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.083947 Jul 14 09:38:25.770747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 51/108] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:26.176796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-113219a2-eaba-493c-a032-32ef038320e6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:26.177404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-113219a2-eaba-493c-a032-32ef038320e6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:26.183428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-113219a2-eaba-493c-a032-32ef038320e6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:26.183876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-113219a2-eaba-493c-a032-32ef038320e6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:26.184629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-113219a2-eaba-493c-a032-32ef038320e6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:26.185064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-113219a2-eaba-493c-a032-32ef038320e6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:26.309782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-113219a2-eaba-493c-a032-32ef038320e6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:26.317921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-113219a2-eaba-493c-a032-32ef038320e6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.144918 Jul 14 09:38:26.318520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 58/109] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:26 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:26.385160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f5524b1b-e9df-4fd5-aba1-1c3ef8c9ce80 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:26.385790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f5524b1b-e9df-4fd5-aba1-1c3ef8c9ce80 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:26.392509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f5524b1b-e9df-4fd5-aba1-1c3ef8c9ce80 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:26.392948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f5524b1b-e9df-4fd5-aba1-1c3ef8c9ce80 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:26.393704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f5524b1b-e9df-4fd5-aba1-1c3ef8c9ce80 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:26.394111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f5524b1b-e9df-4fd5-aba1-1c3ef8c9ce80 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:26.469736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f5524b1b-e9df-4fd5-aba1-1c3ef8c9ce80 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:26.478688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f5524b1b-e9df-4fd5-aba1-1c3ef8c9ce80 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.097903 Jul 14 09:38:26.488124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 52/110] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:26 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:26.663868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6aab2c7f-22b9-48dd-9f94-18433be68f54 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:26.664696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6aab2c7f-22b9-48dd-9f94-18433be68f54 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:26.671701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6aab2c7f-22b9-48dd-9f94-18433be68f54 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:26.672143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6aab2c7f-22b9-48dd-9f94-18433be68f54 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:26.672900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6aab2c7f-22b9-48dd-9f94-18433be68f54 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:26.673331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6aab2c7f-22b9-48dd-9f94-18433be68f54 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:26.739216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6aab2c7f-22b9-48dd-9f94-18433be68f54 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:26.746424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6aab2c7f-22b9-48dd-9f94-18433be68f54 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.086488 Jul 14 09:38:26.746982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 59/111] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:26 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:26.788470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:26.789188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:26.795983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:26.796430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:26.797184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:26.797616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:26.857366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:26.865396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:26.867128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:26.868288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-04219a04-4be9-4503-bb5a-faf19d55dc0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.083715 Jul 14 09:38:26.868837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 53/112] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:27.335675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6714787f-5cfa-45fd-bce4-ec03e48b14c5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:27.336403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6714787f-5cfa-45fd-bce4-ec03e48b14c5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:27.343649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6714787f-5cfa-45fd-bce4-ec03e48b14c5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:27.344100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6714787f-5cfa-45fd-bce4-ec03e48b14c5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:27.344862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6714787f-5cfa-45fd-bce4-ec03e48b14c5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:27.345297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6714787f-5cfa-45fd-bce4-ec03e48b14c5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:27.479416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6714787f-5cfa-45fd-bce4-ec03e48b14c5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:27.486773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6714787f-5cfa-45fd-bce4-ec03e48b14c5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.155678 Jul 14 09:38:27.487348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 60/113] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:27 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:27.497483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dab4eece-a4dd-4613-a70d-b44132138f37 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:27.497483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dab4eece-a4dd-4613-a70d-b44132138f37 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:27.502573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dab4eece-a4dd-4613-a70d-b44132138f37 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:27.503077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dab4eece-a4dd-4613-a70d-b44132138f37 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:27.503753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dab4eece-a4dd-4613-a70d-b44132138f37 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:27.504184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dab4eece-a4dd-4613-a70d-b44132138f37 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:27.567347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dab4eece-a4dd-4613-a70d-b44132138f37 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:27.574605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dab4eece-a4dd-4613-a70d-b44132138f37 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1218 microversion: 2.1 time: 0.082808 Jul 14 09:38:27.575162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 54/114] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:27 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:27.767096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ac389dc4-12f0-4df5-a5f0-80331077d1ab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:27.768375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ac389dc4-12f0-4df5-a5f0-80331077d1ab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:27.776554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac389dc4-12f0-4df5-a5f0-80331077d1ab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:27.777248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac389dc4-12f0-4df5-a5f0-80331077d1ab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:27.778060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac389dc4-12f0-4df5-a5f0-80331077d1ab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:27.778531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac389dc4-12f0-4df5-a5f0-80331077d1ab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:27.861391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ac389dc4-12f0-4df5-a5f0-80331077d1ab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:27.872220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ac389dc4-12f0-4df5-a5f0-80331077d1ab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1234 microversion: 2.1 time: 0.107426 Jul 14 09:38:27.875899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 61/115] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:27 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1234 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:27.886810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:27.887431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:27.894446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:27.894892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:27.895646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:27.896075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:27.971244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:27.975320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:27.981069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:27.982619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:27.983716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1c719de7-0e98-42c6-87a5-db258a3be19e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1276 microversion: 2.20 time: 0.100797 Jul 14 09:38:27.984286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 55/116] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:28.505125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f4cf2b9d-be01-4622-a8f8-602d79cdb9d1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:28.506012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f4cf2b9d-be01-4622-a8f8-602d79cdb9d1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:28.517451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4cf2b9d-be01-4622-a8f8-602d79cdb9d1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:28.517907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4cf2b9d-be01-4622-a8f8-602d79cdb9d1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:28.518753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4cf2b9d-be01-4622-a8f8-602d79cdb9d1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:28.519273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4cf2b9d-be01-4622-a8f8-602d79cdb9d1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:28.592654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-182c14c7-42e1-4088-8ed4-a332bfa9f6eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:28.593263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-182c14c7-42e1-4088-8ed4-a332bfa9f6eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:28.599635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-182c14c7-42e1-4088-8ed4-a332bfa9f6eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:28.600339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-182c14c7-42e1-4088-8ed4-a332bfa9f6eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:28.601313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-182c14c7-42e1-4088-8ed4-a332bfa9f6eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:28.601928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-182c14c7-42e1-4088-8ed4-a332bfa9f6eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:28.702368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-182c14c7-42e1-4088-8ed4-a332bfa9f6eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:28.722560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-182c14c7-42e1-4088-8ed4-a332bfa9f6eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1282 microversion: 2.1 time: 0.133748 Jul 14 09:38:28.723840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 56/117] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:28 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:28.742891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f4cf2b9d-be01-4622-a8f8-602d79cdb9d1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:28.750715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f4cf2b9d-be01-4622-a8f8-602d79cdb9d1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.251439 Jul 14 09:38:28.751383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 62/118] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:28 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:28.895557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2dda5774-6f72-4536-9e2b-da5d78dbe23e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:28.898709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2dda5774-6f72-4536-9e2b-da5d78dbe23e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:28.921430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2dda5774-6f72-4536-9e2b-da5d78dbe23e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:28.922450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2dda5774-6f72-4536-9e2b-da5d78dbe23e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:28.923468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2dda5774-6f72-4536-9e2b-da5d78dbe23e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:28.924108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2dda5774-6f72-4536-9e2b-da5d78dbe23e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:29.001735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:29.003214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:29.016497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:29.017990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:29.021890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:29.022606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:29.131483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2dda5774-6f72-4536-9e2b-da5d78dbe23e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:29.140528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2dda5774-6f72-4536-9e2b-da5d78dbe23e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1290 microversion: 2.1 time: 0.250770 Jul 14 09:38:29.141099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 57/119] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:28 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1290 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:29.194318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:29.205221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:29.206769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:29.213568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c4087a13-dd10-46ce-abc9-91bac3a64639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1332 microversion: 2.20 time: 0.213987 Jul 14 09:38:29.217439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 63/120] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1332 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:29.740056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8a310d65-d2f2-47ad-8869-5dfba0f415f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:29.740865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8a310d65-d2f2-47ad-8869-5dfba0f415f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:29.760175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8a310d65-d2f2-47ad-8869-5dfba0f415f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:29.760631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8a310d65-d2f2-47ad-8869-5dfba0f415f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:29.762532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8a310d65-d2f2-47ad-8869-5dfba0f415f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:29.762532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8a310d65-d2f2-47ad-8869-5dfba0f415f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:29.768574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-13aaa12e-c312-4794-af90-63ddaf6ccd7e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:29.769397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-13aaa12e-c312-4794-af90-63ddaf6ccd7e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:29.777423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13aaa12e-c312-4794-af90-63ddaf6ccd7e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:29.779765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13aaa12e-c312-4794-af90-63ddaf6ccd7e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:29.781681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13aaa12e-c312-4794-af90-63ddaf6ccd7e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:29.782338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13aaa12e-c312-4794-af90-63ddaf6ccd7e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:30.002314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8a310d65-d2f2-47ad-8869-5dfba0f415f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:30.010563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8a310d65-d2f2-47ad-8869-5dfba0f415f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1280 microversion: 2.1 time: 0.274268 Jul 14 09:38:30.020600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 58/121] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:29 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:30.157354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f79b1a23-00f2-4a54-ac35-fdcc7ea84e2c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:30.157954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f79b1a23-00f2-4a54-ac35-fdcc7ea84e2c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:30.173701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f79b1a23-00f2-4a54-ac35-fdcc7ea84e2c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:30.174144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f79b1a23-00f2-4a54-ac35-fdcc7ea84e2c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:30.175097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f79b1a23-00f2-4a54-ac35-fdcc7ea84e2c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:30.175836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f79b1a23-00f2-4a54-ac35-fdcc7ea84e2c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:30.341080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f79b1a23-00f2-4a54-ac35-fdcc7ea84e2c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:30.349871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f79b1a23-00f2-4a54-ac35-fdcc7ea84e2c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1296 microversion: 2.1 time: 0.195988 Jul 14 09:38:30.350747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 59/122] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:30 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1296 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:30.360068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:30.360952 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:30.369039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:30.370467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:30.371452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:30.372122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:30.415422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-13aaa12e-c312-4794-af90-63ddaf6ccd7e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:30.420400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:30.429028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-13aaa12e-c312-4794-af90-63ddaf6ccd7e tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.664346 Jul 14 09:38:30.431222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 64/123] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:29 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:30.494906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-cb131527-61ac-48a4-8a19-8e0841babd41 req-721d003e-a6a6-4665-8bd7-e0d41b90622c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1", "tag": "2a9b746f-3a6c-4ff1-b675-838773cc6ee9"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:30.510040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-cb131527-61ac-48a4-8a19-8e0841babd41 req-721d003e-a6a6-4665-8bd7-e0d41b90622c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:30.510902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-cb131527-61ac-48a4-8a19-8e0841babd41 req-721d003e-a6a6-4665-8bd7-e0d41b90622c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:30.530767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-cb131527-61ac-48a4-8a19-8e0841babd41 req-721d003e-a6a6-4665-8bd7-e0d41b90622c service nova] Creating event network-changed:2a9b746f-3a6c-4ff1-b675-838773cc6ee9 for instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 on hv-cinder-82549 Jul 14 09:38:30.531687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-cb131527-61ac-48a4-8a19-8e0841babd41 req-721d003e-a6a6-4665-8bd7-e0d41b90622c service nova] Acquired lock "compute-rpcapi-router" {{(pid=129536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 09:38:30.532956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7815a990-e8fb-4a73-bda9-f53626ac69fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:30.533561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7815a990-e8fb-4a73-bda9-f53626ac69fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:30.534467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7815a990-e8fb-4a73-bda9-f53626ac69fb None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:30.534898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7815a990-e8fb-4a73-bda9-f53626ac69fb None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:30.545732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.compute.rpcapi [None req-7815a990-e8fb-4a73-bda9-f53626ac69fb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 09:38:30.546656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7815a990-e8fb-4a73-bda9-f53626ac69fb None None] Releasing lock "compute-rpcapi-router" {{(pid=129536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 09:38:30.564236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7815a990-e8fb-4a73-bda9-f53626ac69fb None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133032 Jul 14 09:38:30.565025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 65/124] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:30.576220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:30.586249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:30.589203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:30.590585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-38d9c19e-822a-4d2c-8d74-851eaac47f5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1338 microversion: 2.20 time: 0.238727 Jul 14 09:38:30.591689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 60/125] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1338 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:31.029268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ed23b260-8b45-4dcb-bf02-2f3be15f6474 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:31.030038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ed23b260-8b45-4dcb-bf02-2f3be15f6474 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:31.036529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed23b260-8b45-4dcb-bf02-2f3be15f6474 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:31.037277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed23b260-8b45-4dcb-bf02-2f3be15f6474 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:31.038058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed23b260-8b45-4dcb-bf02-2f3be15f6474 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:31.038737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed23b260-8b45-4dcb-bf02-2f3be15f6474 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:31.175725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ed23b260-8b45-4dcb-bf02-2f3be15f6474 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:31.183320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ed23b260-8b45-4dcb-bf02-2f3be15f6474 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.158919 Jul 14 09:38:31.183874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 66/126] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:31 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:31.367145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e379f6a3-cbfd-4894-8e6a-ee04873b9783 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:31.367746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e379f6a3-cbfd-4894-8e6a-ee04873b9783 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:31.373724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e379f6a3-cbfd-4894-8e6a-ee04873b9783 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:31.374169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e379f6a3-cbfd-4894-8e6a-ee04873b9783 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:31.374954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e379f6a3-cbfd-4894-8e6a-ee04873b9783 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:31.375385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e379f6a3-cbfd-4894-8e6a-ee04873b9783 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:31.434596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e379f6a3-cbfd-4894-8e6a-ee04873b9783 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:31.442081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e379f6a3-cbfd-4894-8e6a-ee04873b9783 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1296 microversion: 2.1 time: 0.078705 Jul 14 09:38:31.442655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 61/127] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:31 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1296 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:31.446039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-03a6c269-87f4-435a-a4ac-183ec5eecd0d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:31.446670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-03a6c269-87f4-435a-a4ac-183ec5eecd0d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:31.453172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03a6c269-87f4-435a-a4ac-183ec5eecd0d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:31.453618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03a6c269-87f4-435a-a4ac-183ec5eecd0d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:31.454392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03a6c269-87f4-435a-a4ac-183ec5eecd0d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:31.454823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03a6c269-87f4-435a-a4ac-183ec5eecd0d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:31.584301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-03a6c269-87f4-435a-a4ac-183ec5eecd0d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:31.591953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-03a6c269-87f4-435a-a4ac-183ec5eecd0d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.149687 Jul 14 09:38:31.592520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 67/128] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:31 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:31.608689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:31.609287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:31.615242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:31.615684 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:31.616456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:31.616882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:31.677132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:31.685567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:31.687091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:31.688174 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-14ee1402-6bd6-4ef7-854a-bb1260a123c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1338 microversion: 2.20 time: 0.083397 Jul 14 09:38:31.688717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 62/129] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1338 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:32.200030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d35aaf47-c12b-49ba-8cd1-8ee8849b2cb2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:32.200668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d35aaf47-c12b-49ba-8cd1-8ee8849b2cb2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:32.206692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d35aaf47-c12b-49ba-8cd1-8ee8849b2cb2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.207129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d35aaf47-c12b-49ba-8cd1-8ee8849b2cb2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.207866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d35aaf47-c12b-49ba-8cd1-8ee8849b2cb2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.208302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d35aaf47-c12b-49ba-8cd1-8ee8849b2cb2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.335730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d35aaf47-c12b-49ba-8cd1-8ee8849b2cb2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:32.344099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d35aaf47-c12b-49ba-8cd1-8ee8849b2cb2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.147875 Jul 14 09:38:32.344647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 68/130] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:32 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:32.459154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f9786d3f-6c75-408c-a1da-698183ae01e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:32.459705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f9786d3f-6c75-408c-a1da-698183ae01e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:32.465946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9786d3f-6c75-408c-a1da-698183ae01e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.466968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9786d3f-6c75-408c-a1da-698183ae01e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.467719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9786d3f-6c75-408c-a1da-698183ae01e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.468149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9786d3f-6c75-408c-a1da-698183ae01e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.527365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f9786d3f-6c75-408c-a1da-698183ae01e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:32.535667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f9786d3f-6c75-408c-a1da-698183ae01e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1296 microversion: 2.1 time: 0.080472 Jul 14 09:38:32.536222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 63/131] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:32 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1296 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:32.577801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-c7db689a-3f7b-4bf3-985b-6ae835bc68fb req-4e591ffe-3a9e-4254-8281-50b7c74e316c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15537672-68be-4fae-8588-b9f6a56f9a88", "tag": "79654163-e203-4648-9bf6-ad925378a698"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:32.585690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-c7db689a-3f7b-4bf3-985b-6ae835bc68fb req-4e591ffe-3a9e-4254-8281-50b7c74e316c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.586122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-c7db689a-3f7b-4bf3-985b-6ae835bc68fb req-4e591ffe-3a9e-4254-8281-50b7c74e316c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.597078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-c7db689a-3f7b-4bf3-985b-6ae835bc68fb req-4e591ffe-3a9e-4254-8281-50b7c74e316c service nova] Creating event network-changed:79654163-e203-4648-9bf6-ad925378a698 for instance 15537672-68be-4fae-8588-b9f6a56f9a88 on hv-cinder-82549 Jul 14 09:38:32.601888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-c7db689a-3f7b-4bf3-985b-6ae835bc68fb req-4e591ffe-3a9e-4254-8281-50b7c74e316c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027702 Jul 14 09:38:32.602882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 69/132] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:32.608262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-878dc369-c6d4-46ae-b7fb-c0d0eebb9765 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:32.608871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-878dc369-c6d4-46ae-b7fb-c0d0eebb9765 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:32.614912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-878dc369-c6d4-46ae-b7fb-c0d0eebb9765 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.615355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-878dc369-c6d4-46ae-b7fb-c0d0eebb9765 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.616105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-878dc369-c6d4-46ae-b7fb-c0d0eebb9765 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.616690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-878dc369-c6d4-46ae-b7fb-c0d0eebb9765 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.706661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:32.707455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:32.714157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.714651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.715470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:32.715968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:32.741821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-878dc369-c6d4-46ae-b7fb-c0d0eebb9765 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:32.749623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-878dc369-c6d4-46ae-b7fb-c0d0eebb9765 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.145682 Jul 14 09:38:32.750209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 64/133] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:32 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:32.776583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:32.785020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:32.786545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:32.787622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3a9bd7ae-0640-4d18-a9fd-9cd60c050571 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1338 microversion: 2.20 time: 0.085214 Jul 14 09:38:32.788169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 70/134] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1338 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:33.360536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-15308cdc-d7a5-48a8-8ca2-f916af2b3081 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:33.361142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-15308cdc-d7a5-48a8-8ca2-f916af2b3081 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:33.369198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15308cdc-d7a5-48a8-8ca2-f916af2b3081 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:33.369519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15308cdc-d7a5-48a8-8ca2-f916af2b3081 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:33.370456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15308cdc-d7a5-48a8-8ca2-f916af2b3081 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:33.374325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15308cdc-d7a5-48a8-8ca2-f916af2b3081 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:33.553483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-731917da-89c0-447f-ade4-bcab21d38e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:33.554412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-731917da-89c0-447f-ade4-bcab21d38e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:33.564218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-731917da-89c0-447f-ade4-bcab21d38e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:33.565251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-731917da-89c0-447f-ade4-bcab21d38e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:33.566879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-731917da-89c0-447f-ade4-bcab21d38e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:33.567501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-731917da-89c0-447f-ade4-bcab21d38e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:33.721402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-731917da-89c0-447f-ade4-bcab21d38e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:33.730693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-731917da-89c0-447f-ade4-bcab21d38e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1296 microversion: 2.1 time: 0.181533 Jul 14 09:38:33.731521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 71/135] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:33 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1296 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:33.766450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-92e84605-146b-40b8-b898-9edae45a15bd tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:33.767834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-92e84605-146b-40b8-b898-9edae45a15bd tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:33.778365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-92e84605-146b-40b8-b898-9edae45a15bd tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:33.779552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-92e84605-146b-40b8-b898-9edae45a15bd tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:33.780551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-92e84605-146b-40b8-b898-9edae45a15bd tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:33.781174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-92e84605-146b-40b8-b898-9edae45a15bd tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:33.853880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-15308cdc-d7a5-48a8-8ca2-f916af2b3081 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:33.864687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-15308cdc-d7a5-48a8-8ca2-f916af2b3081 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.507127 Jul 14 09:38:33.873882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 65/136] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:33 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:33.882523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:33.883871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:33.890737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:33.891180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:33.893235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:33.893235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:34.272037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:34.280622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:34.282159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:34.283278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c4e1a2c5-939e-497e-9eed-5f8d62f6e037 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1338 microversion: 2.20 time: 0.406625 Jul 14 09:38:34.283860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 66/137] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1338 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:34.461497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-92e84605-146b-40b8-b898-9edae45a15bd tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:34.470532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-92e84605-146b-40b8-b898-9edae45a15bd tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.707928 Jul 14 09:38:34.471114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 72/138] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:33 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:34.749924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-13c4dbd8-be13-49a9-a299-d14a779b57fc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:34.750680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-13c4dbd8-be13-49a9-a299-d14a779b57fc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:34.757751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13c4dbd8-be13-49a9-a299-d14a779b57fc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:34.758211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13c4dbd8-be13-49a9-a299-d14a779b57fc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:34.759311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13c4dbd8-be13-49a9-a299-d14a779b57fc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:34.759868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13c4dbd8-be13-49a9-a299-d14a779b57fc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:34.866158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-13c4dbd8-be13-49a9-a299-d14a779b57fc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:34.876750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-13c4dbd8-be13-49a9-a299-d14a779b57fc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1296 microversion: 2.1 time: 0.132009 Jul 14 09:38:34.884024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-25b9f350-46fb-4332-928f-23ac0a38e730 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:34.885209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-25b9f350-46fb-4332-928f-23ac0a38e730 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:34.887262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 67/139] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:34 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:34.892020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25b9f350-46fb-4332-928f-23ac0a38e730 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:34.892589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25b9f350-46fb-4332-928f-23ac0a38e730 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:34.893461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25b9f350-46fb-4332-928f-23ac0a38e730 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:34.893985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25b9f350-46fb-4332-928f-23ac0a38e730 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.303411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:35.304007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:35.311251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.311698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.312455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.312935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.345791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-25b9f350-46fb-4332-928f-23ac0a38e730 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:35.353235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-25b9f350-46fb-4332-928f-23ac0a38e730 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.474011 Jul 14 09:38:35.353792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 73/140] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:34 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:35.418164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:35.426081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:35.427597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:35.428775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6b738bea-e3ad-47e1-87c4-7ec35cf99e35 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1338 microversion: 2.20 time: 0.129390 Jul 14 09:38:35.429414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 68/141] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1338 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:35.487860 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5b92044e-f3d6-436f-8022-a78f1309db66 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:35.488458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5b92044e-f3d6-436f-8022-a78f1309db66 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:35.494675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b92044e-f3d6-436f-8022-a78f1309db66 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.495114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b92044e-f3d6-436f-8022-a78f1309db66 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.495896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b92044e-f3d6-436f-8022-a78f1309db66 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.496328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b92044e-f3d6-436f-8022-a78f1309db66 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.887863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5b92044e-f3d6-436f-8022-a78f1309db66 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:35.901910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5b92044e-f3d6-436f-8022-a78f1309db66 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.417773 Jul 14 09:38:35.902534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 74/142] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:35 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:35.910854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72693572-d613-45ee-bfc9-27dadc411919 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:35.911463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-72693572-d613-45ee-bfc9-27dadc411919 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:35.917654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72693572-d613-45ee-bfc9-27dadc411919 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.918094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72693572-d613-45ee-bfc9-27dadc411919 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.918902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72693572-d613-45ee-bfc9-27dadc411919 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.919914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72693572-d613-45ee-bfc9-27dadc411919 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.929283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-56481acc-284e-42f2-ad52-ca768ba4c348 req-7bbdfb56-b053-4be5-929c-d0316db4fe85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61bb2fe3-a0ee-48ce-996f-64ef966f6bcd", "tag": "48f22e3e-0aba-4714-8fb9-6f1f18ac1f69"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:35.941773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-56481acc-284e-42f2-ad52-ca768ba4c348 req-7bbdfb56-b053-4be5-929c-d0316db4fe85 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.943806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-56481acc-284e-42f2-ad52-ca768ba4c348 req-7bbdfb56-b053-4be5-929c-d0316db4fe85 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.966266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-56481acc-284e-42f2-ad52-ca768ba4c348 req-7bbdfb56-b053-4be5-929c-d0316db4fe85 service nova] Creating event network-changed:48f22e3e-0aba-4714-8fb9-6f1f18ac1f69 for instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd on hv-cinder-82549 Jul 14 09:38:35.967054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-56481acc-284e-42f2-ad52-ca768ba4c348 req-7bbdfb56-b053-4be5-929c-d0316db4fe85 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129537) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 09:38:35.968349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63a752f7-07ba-4dcd-9654-498f044a033d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.968936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63a752f7-07ba-4dcd-9654-498f044a033d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.969894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63a752f7-07ba-4dcd-9654-498f044a033d None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:35.970507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63a752f7-07ba-4dcd-9654-498f044a033d None None] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:35.984943 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.compute.rpcapi [None req-63a752f7-07ba-4dcd-9654-498f044a033d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 09:38:35.986028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63a752f7-07ba-4dcd-9654-498f044a033d None None] Releasing lock "compute-rpcapi-router" {{(pid=129537) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 09:38:36.002024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-63a752f7-07ba-4dcd-9654-498f044a033d None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153845 Jul 14 09:38:36.002865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 69/143] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:36.058258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-72693572-d613-45ee-bfc9-27dadc411919 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:36.065616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-72693572-d613-45ee-bfc9-27dadc411919 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.162136 Jul 14 09:38:36.066158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 75/144] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:35 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:36.371290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d248eccc-5ebc-4a0f-8b00-eea13579648b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:36.372240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d248eccc-5ebc-4a0f-8b00-eea13579648b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:36.379198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d248eccc-5ebc-4a0f-8b00-eea13579648b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:36.379639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d248eccc-5ebc-4a0f-8b00-eea13579648b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:36.380380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d248eccc-5ebc-4a0f-8b00-eea13579648b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:36.380808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d248eccc-5ebc-4a0f-8b00-eea13579648b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:36.447765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:36.448343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:36.454894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:36.455338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:36.456095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:36.456530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:36.537632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d248eccc-5ebc-4a0f-8b00-eea13579648b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:36.545291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d248eccc-5ebc-4a0f-8b00-eea13579648b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.179140 Jul 14 09:38:36.545852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 70/145] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:36 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:36.598976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:36.606908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:36.608414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:36.609502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f1eed5e3-b73a-4257-80fb-d7c39cf0e3b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.165747 Jul 14 09:38:36.610051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 76/146] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:36.918693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b9ed2dd5-2026-4be1-8a03-97b317003bd9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:36.919290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b9ed2dd5-2026-4be1-8a03-97b317003bd9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:36.925383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9ed2dd5-2026-4be1-8a03-97b317003bd9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:36.925818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9ed2dd5-2026-4be1-8a03-97b317003bd9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:36.926593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9ed2dd5-2026-4be1-8a03-97b317003bd9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:36.927022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9ed2dd5-2026-4be1-8a03-97b317003bd9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:37.051183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b9ed2dd5-2026-4be1-8a03-97b317003bd9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:37.058373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b9ed2dd5-2026-4be1-8a03-97b317003bd9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.143464 Jul 14 09:38:37.058931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 71/147] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:36 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:37.082095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-25a5d9f0-0a48-4519-83be-6eeefe8a33bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:37.082732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-25a5d9f0-0a48-4519-83be-6eeefe8a33bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:37.088982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25a5d9f0-0a48-4519-83be-6eeefe8a33bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:37.089426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25a5d9f0-0a48-4519-83be-6eeefe8a33bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:37.090178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25a5d9f0-0a48-4519-83be-6eeefe8a33bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:37.090628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25a5d9f0-0a48-4519-83be-6eeefe8a33bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:37.219368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-25a5d9f0-0a48-4519-83be-6eeefe8a33bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:37.226622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-25a5d9f0-0a48-4519-83be-6eeefe8a33bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.148280 Jul 14 09:38:37.227179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 77/148] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:37 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:37.562864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c37d9d6b-ffeb-4280-a49b-365ad659e92c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:37.563472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c37d9d6b-ffeb-4280-a49b-365ad659e92c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:37.569478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c37d9d6b-ffeb-4280-a49b-365ad659e92c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:37.569917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c37d9d6b-ffeb-4280-a49b-365ad659e92c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:37.570700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c37d9d6b-ffeb-4280-a49b-365ad659e92c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:37.571131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c37d9d6b-ffeb-4280-a49b-365ad659e92c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:37.627910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:37.628511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:37.634505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:37.634942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:37.635691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:37.636115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:37.740068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c37d9d6b-ffeb-4280-a49b-365ad659e92c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:37.743575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:37.748877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c37d9d6b-ffeb-4280-a49b-365ad659e92c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.190396 Jul 14 09:38:37.749446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 72/149] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:37 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:37.784160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:37.791950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:37.793467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:37.794605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-00f12d05-3030-4bea-831d-ef25a1bd1b14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.170546 Jul 14 09:38:37.795154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 78/150] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:38.075406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-62238d04-4597-4cd4-ad26-4869f9ba5530 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:38.076007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-62238d04-4597-4cd4-ad26-4869f9ba5530 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:38.082403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-62238d04-4597-4cd4-ad26-4869f9ba5530 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:38.082842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-62238d04-4597-4cd4-ad26-4869f9ba5530 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:38.083593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-62238d04-4597-4cd4-ad26-4869f9ba5530 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:38.084019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-62238d04-4597-4cd4-ad26-4869f9ba5530 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:38.214422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-62238d04-4597-4cd4-ad26-4869f9ba5530 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:38.221826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-62238d04-4597-4cd4-ad26-4869f9ba5530 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.150043 Jul 14 09:38:38.222480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 73/151] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:38 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:38.243914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d71767c9-8764-4195-910c-781672a9a7b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:38.244517 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d71767c9-8764-4195-910c-781672a9a7b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:38.250933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d71767c9-8764-4195-910c-781672a9a7b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:38.251367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d71767c9-8764-4195-910c-781672a9a7b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:38.252114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d71767c9-8764-4195-910c-781672a9a7b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:38.252540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d71767c9-8764-4195-910c-781672a9a7b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:38.765673 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f42db017-f938-4552-bd3c-db993e921be6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:38.766327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f42db017-f938-4552-bd3c-db993e921be6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:38.772631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f42db017-f938-4552-bd3c-db993e921be6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:38.773078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f42db017-f938-4552-bd3c-db993e921be6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:38.773843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f42db017-f938-4552-bd3c-db993e921be6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:38.774492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f42db017-f938-4552-bd3c-db993e921be6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:38.935176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d71767c9-8764-4195-910c-781672a9a7b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:38.946160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d71767c9-8764-4195-910c-781672a9a7b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.705808 Jul 14 09:38:38.947889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 79/152] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:38 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:38.952751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:38.953340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:38.959876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:38.961034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:38.962328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:38.962965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:39.346112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f42db017-f938-4552-bd3c-db993e921be6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:39.353845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f42db017-f938-4552-bd3c-db993e921be6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.592539 Jul 14 09:38:39.356911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 74/153] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:38 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:39.361683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c0c192ba-7740-49b9-88fe-4c586054d5e8 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:39.362309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c0c192ba-7740-49b9-88fe-4c586054d5e8 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:39.381217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0c192ba-7740-49b9-88fe-4c586054d5e8 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:39.381710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0c192ba-7740-49b9-88fe-4c586054d5e8 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:39.382535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0c192ba-7740-49b9-88fe-4c586054d5e8 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:39.382979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0c192ba-7740-49b9-88fe-4c586054d5e8 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:39.474862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:39.497700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:39.502833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:39.505616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ad4ce8a5-0628-48c7-91e3-9635ada517c3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.556782 Jul 14 09:38:39.508441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 80/154] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:39.812824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c0c192ba-7740-49b9-88fe-4c586054d5e8 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:39.827083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c0c192ba-7740-49b9-88fe-4c586054d5e8 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.468834 Jul 14 09:38:39.828021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 75/155] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:39 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:39.980061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3d32b38f-9533-4c36-b4ff-bb7c9150b521 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:39.980861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3d32b38f-9533-4c36-b4ff-bb7c9150b521 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:39.997804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3d32b38f-9533-4c36-b4ff-bb7c9150b521 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:40.003218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3d32b38f-9533-4c36-b4ff-bb7c9150b521 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:40.004507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3d32b38f-9533-4c36-b4ff-bb7c9150b521 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:40.005115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3d32b38f-9533-4c36-b4ff-bb7c9150b521 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:40.388748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a91f9b31-2d3a-4fe5-845e-697a9771a04b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:40.390091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a91f9b31-2d3a-4fe5-845e-697a9771a04b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:40.396887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a91f9b31-2d3a-4fe5-845e-697a9771a04b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:40.397612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a91f9b31-2d3a-4fe5-845e-697a9771a04b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:40.398616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a91f9b31-2d3a-4fe5-845e-697a9771a04b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:40.399229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a91f9b31-2d3a-4fe5-845e-697a9771a04b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:40.437182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3d32b38f-9533-4c36-b4ff-bb7c9150b521 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:40.446376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3d32b38f-9533-4c36-b4ff-bb7c9150b521 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.485381 Jul 14 09:38:40.447317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 81/156] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:39 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:40.544652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:40.548586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:40.551015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:40.563084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:40.563733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:40.564657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:40.565233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:40.587518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:41.000520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a91f9b31-2d3a-4fe5-845e-697a9771a04b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:41.018536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a91f9b31-2d3a-4fe5-845e-697a9771a04b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.639876 Jul 14 09:38:41.019948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 76/157] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:40 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:41.023104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:41.032797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-0191e7b7-0bfa-422a-9764-5787a2450c96 req-943ed262-ac46-4e92-9997-914a8f8434d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00a0737-b755-4d07-a5a1-8b691911836f", "tag": "1975270c-eaaa-4443-9916-238cad412d51"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:41.033300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:41.035137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:41.036446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1b5b81c5-f828-4066-9ab8-291f6001bb72 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.515105 Jul 14 09:38:41.048373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 82/158] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:41.053922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-574b6782-8320-4a91-8bdb-20f94880e0d6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:41.062002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-0191e7b7-0bfa-422a-9764-5787a2450c96 req-943ed262-ac46-4e92-9997-914a8f8434d9 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:41.062734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-0191e7b7-0bfa-422a-9764-5787a2450c96 req-943ed262-ac46-4e92-9997-914a8f8434d9 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:41.063493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-574b6782-8320-4a91-8bdb-20f94880e0d6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:41.076495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-574b6782-8320-4a91-8bdb-20f94880e0d6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:41.077095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-574b6782-8320-4a91-8bdb-20f94880e0d6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:41.077876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-574b6782-8320-4a91-8bdb-20f94880e0d6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:41.079053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-574b6782-8320-4a91-8bdb-20f94880e0d6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:41.100477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-0191e7b7-0bfa-422a-9764-5787a2450c96 req-943ed262-ac46-4e92-9997-914a8f8434d9 service nova] Creating event network-changed:1975270c-eaaa-4443-9916-238cad412d51 for instance a00a0737-b755-4d07-a5a1-8b691911836f on hv-cinder-82549 Jul 14 09:38:41.110101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-0191e7b7-0bfa-422a-9764-5787a2450c96 req-943ed262-ac46-4e92-9997-914a8f8434d9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087878 Jul 14 09:38:41.112579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 77/159] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:41.321182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-574b6782-8320-4a91-8bdb-20f94880e0d6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:41.348985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-574b6782-8320-4a91-8bdb-20f94880e0d6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.284130 Jul 14 09:38:41.359923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 83/160] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:41 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:41.464231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-64268aa4-c224-468c-b400-8e02c04e6deb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:41.465056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-64268aa4-c224-468c-b400-8e02c04e6deb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:41.478460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-64268aa4-c224-468c-b400-8e02c04e6deb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:41.479065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-64268aa4-c224-468c-b400-8e02c04e6deb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:41.481380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-64268aa4-c224-468c-b400-8e02c04e6deb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:41.484047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-64268aa4-c224-468c-b400-8e02c04e6deb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:42.035770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-66368730-580f-4fa6-8644-b7a02729c980 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:42.036918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-66368730-580f-4fa6-8644-b7a02729c980 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:42.046436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-66368730-580f-4fa6-8644-b7a02729c980 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:42.046880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-66368730-580f-4fa6-8644-b7a02729c980 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:42.047702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-66368730-580f-4fa6-8644-b7a02729c980 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:42.048077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-66368730-580f-4fa6-8644-b7a02729c980 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:42.237676 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-64268aa4-c224-468c-b400-8e02c04e6deb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:42.247634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-64268aa4-c224-468c-b400-8e02c04e6deb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.787609 Jul 14 09:38:42.248493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 78/161] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:42.253477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:42.254224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:42.261438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:42.262153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:42.263629 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:42.264196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:42.541542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-66368730-580f-4fa6-8644-b7a02729c980 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:42.552469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-66368730-580f-4fa6-8644-b7a02729c980 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.520245 Jul 14 09:38:42.561721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 84/162] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:42 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:42.566951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e7cff743-1a51-4c07-adfd-fd3c0dd666d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:42.567624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e7cff743-1a51-4c07-adfd-fd3c0dd666d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:42.574127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7cff743-1a51-4c07-adfd-fd3c0dd666d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:42.575393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7cff743-1a51-4c07-adfd-fd3c0dd666d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:42.576469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7cff743-1a51-4c07-adfd-fd3c0dd666d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:42.577074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7cff743-1a51-4c07-adfd-fd3c0dd666d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:42.580772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:42.597772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:42.599452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:42.600811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f3d306ab-e09a-476f-87f4-66089c811dd2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.350978 Jul 14 09:38:42.605345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 79/163] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:42.785198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e7cff743-1a51-4c07-adfd-fd3c0dd666d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:42.795742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e7cff743-1a51-4c07-adfd-fd3c0dd666d2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.232227 Jul 14 09:38:42.797027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 85/164] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:42 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:43.125323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-ac6fe090-f6f7-48e9-bf45-b997e3b8a561 req-62be4c0b-fbc0-4821-906f-b6eafb8d79d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99819874-5159-49fd-81c9-78998c928020", "tag": "c1165b3f-8447-4ca2-8d04-05ed3e331d2a"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:43.133759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-ac6fe090-f6f7-48e9-bf45-b997e3b8a561 req-62be4c0b-fbc0-4821-906f-b6eafb8d79d5 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.134219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-ac6fe090-f6f7-48e9-bf45-b997e3b8a561 req-62be4c0b-fbc0-4821-906f-b6eafb8d79d5 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:43.145597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-ac6fe090-f6f7-48e9-bf45-b997e3b8a561 req-62be4c0b-fbc0-4821-906f-b6eafb8d79d5 service nova] Creating event network-changed:c1165b3f-8447-4ca2-8d04-05ed3e331d2a for instance 99819874-5159-49fd-81c9-78998c928020 on hv-cinder-82549 Jul 14 09:38:43.150637 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-ac6fe090-f6f7-48e9-bf45-b997e3b8a561 req-62be4c0b-fbc0-4821-906f-b6eafb8d79d5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029285 Jul 14 09:38:43.151222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 80/165] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:43.265164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a4f527aa-6443-4930-9301-175d40801f36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:43.266550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a4f527aa-6443-4930-9301-175d40801f36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:43.272714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a4f527aa-6443-4930-9301-175d40801f36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.273177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a4f527aa-6443-4930-9301-175d40801f36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:43.273922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a4f527aa-6443-4930-9301-175d40801f36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.274540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a4f527aa-6443-4930-9301-175d40801f36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:43.496161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a4f527aa-6443-4930-9301-175d40801f36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:43.508016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a4f527aa-6443-4930-9301-175d40801f36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.247317 Jul 14 09:38:43.509848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 86/166] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:43.572579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-79224c36-4e99-4ecf-9bf7-4dc2e099f37c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:43.573551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-79224c36-4e99-4ecf-9bf7-4dc2e099f37c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:43.584744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79224c36-4e99-4ecf-9bf7-4dc2e099f37c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.586122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79224c36-4e99-4ecf-9bf7-4dc2e099f37c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:43.587396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79224c36-4e99-4ecf-9bf7-4dc2e099f37c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.588565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79224c36-4e99-4ecf-9bf7-4dc2e099f37c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:43.624046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:43.624878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:43.633542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.634364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:43.635136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.635902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:43.875828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-79224c36-4e99-4ecf-9bf7-4dc2e099f37c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:43.890812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:43.892619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-79224c36-4e99-4ecf-9bf7-4dc2e099f37c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.325045 Jul 14 09:38:43.896446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 81/167] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:43 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:43.903447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-66b44cac-9780-4c4d-8646-3d1400895be2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:43.904053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-66b44cac-9780-4c4d-8646-3d1400895be2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:43.908328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:43.910118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:43.911519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-51785799-8904-4627-8719-49ce4049bbde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.291899 Jul 14 09:38:43.912554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 87/168] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:43.931355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-66b44cac-9780-4c4d-8646-3d1400895be2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.931794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-66b44cac-9780-4c4d-8646-3d1400895be2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:43.937542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-66b44cac-9780-4c4d-8646-3d1400895be2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:43.938115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-66b44cac-9780-4c4d-8646-3d1400895be2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:44.149301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-66b44cac-9780-4c4d-8646-3d1400895be2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:44.158679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-66b44cac-9780-4c4d-8646-3d1400895be2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.260172 Jul 14 09:38:44.168266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 82/169] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:43 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:44.535552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-75f19a8e-e4a2-433e-be2d-b092c9870f35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:44.537605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-75f19a8e-e4a2-433e-be2d-b092c9870f35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:44.549493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75f19a8e-e4a2-433e-be2d-b092c9870f35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:44.549939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75f19a8e-e4a2-433e-be2d-b092c9870f35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:44.550727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75f19a8e-e4a2-433e-be2d-b092c9870f35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:44.551309 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75f19a8e-e4a2-433e-be2d-b092c9870f35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:44.919646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1d48c17b-137e-46f7-8b45-7c457d4580dc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:44.920882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1d48c17b-137e-46f7-8b45-7c457d4580dc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:44.935792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d48c17b-137e-46f7-8b45-7c457d4580dc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:44.936252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d48c17b-137e-46f7-8b45-7c457d4580dc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:44.939896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d48c17b-137e-46f7-8b45-7c457d4580dc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:44.940381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d48c17b-137e-46f7-8b45-7c457d4580dc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:45.540567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-75f19a8e-e4a2-433e-be2d-b092c9870f35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:45.552589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-75f19a8e-e4a2-433e-be2d-b092c9870f35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 1.028402 Jul 14 09:38:45.570415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 88/170] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:44 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:45.578032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:45.579087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:45.598990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:45.600626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:45.601975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:45.603409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1d48c17b-137e-46f7-8b45-7c457d4580dc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:45.604348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:45.617762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1d48c17b-137e-46f7-8b45-7c457d4580dc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.706187 Jul 14 09:38:45.617762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 83/171] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:44 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:45.647597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e7fd27d8-10d6-4165-9673-d96be7a1ad63 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:45.648225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e7fd27d8-10d6-4165-9673-d96be7a1ad63 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:45.666634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e7fd27d8-10d6-4165-9673-d96be7a1ad63 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:45.667460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e7fd27d8-10d6-4165-9673-d96be7a1ad63 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:45.669006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e7fd27d8-10d6-4165-9673-d96be7a1ad63 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:45.669785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e7fd27d8-10d6-4165-9673-d96be7a1ad63 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:45.871297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:45.879605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:45.881851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:45.883826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-74fe0f18-358b-48c1-a855-d15a450d9d96 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.315595 Jul 14 09:38:45.884585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 89/172] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:45.932630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e7fd27d8-10d6-4165-9673-d96be7a1ad63 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:45.940537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e7fd27d8-10d6-4165-9673-d96be7a1ad63 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.304939 Jul 14 09:38:45.941169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 84/173] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:45 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:46.581157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-df621d2b-3959-4aae-86e3-dc4d322f50b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:46.582289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-df621d2b-3959-4aae-86e3-dc4d322f50b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:46.596008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df621d2b-3959-4aae-86e3-dc4d322f50b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:46.596693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df621d2b-3959-4aae-86e3-dc4d322f50b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:46.597655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df621d2b-3959-4aae-86e3-dc4d322f50b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:46.598285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df621d2b-3959-4aae-86e3-dc4d322f50b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:46.634719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b9e4d6c4-e761-4223-8aca-fc4aa4fa0169 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:46.635458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b9e4d6c4-e761-4223-8aca-fc4aa4fa0169 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:46.649472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:46.659261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9e4d6c4-e761-4223-8aca-fc4aa4fa0169 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:46.660186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9e4d6c4-e761-4223-8aca-fc4aa4fa0169 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:46.664214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9e4d6c4-e761-4223-8aca-fc4aa4fa0169 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:46.665265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9e4d6c4-e761-4223-8aca-fc4aa4fa0169 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:46.918917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-df621d2b-3959-4aae-86e3-dc4d322f50b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:46.929942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-df621d2b-3959-4aae-86e3-dc4d322f50b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.353683 Jul 14 09:38:46.939743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 90/174] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:46 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:46.953624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:46.955875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:46.975236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:46.975921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:46.978742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:46.980034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:47.042336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b9e4d6c4-e761-4223-8aca-fc4aa4fa0169 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:47.051840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b9e4d6c4-e761-4223-8aca-fc4aa4fa0169 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.421581 Jul 14 09:38:47.053925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 85/175] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:46 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:47.163824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:47.173648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:47.175227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:47.176349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e99d1180-ecb8-4ef2-8c67-805dbe9077eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.237222 Jul 14 09:38:47.177378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 91/176] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:47.182271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5fbde2cb-66de-4723-9a83-c75f5cb91ce6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:47.183021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5fbde2cb-66de-4723-9a83-c75f5cb91ce6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:47.189286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fbde2cb-66de-4723-9a83-c75f5cb91ce6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:47.189740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fbde2cb-66de-4723-9a83-c75f5cb91ce6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:47.190652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fbde2cb-66de-4723-9a83-c75f5cb91ce6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:47.191086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fbde2cb-66de-4723-9a83-c75f5cb91ce6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:47.358944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5fbde2cb-66de-4723-9a83-c75f5cb91ce6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:47.369816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5fbde2cb-66de-4723-9a83-c75f5cb91ce6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.191165 Jul 14 09:38:47.370589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 92/177] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:47 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:47.382002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-2a8f5bb2-466c-4ea3-b4a1-aa794ed5dd6d req-221ed655-6c95-4f0f-a628-88a0b18463c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15537672-68be-4fae-8588-b9f6a56f9a88", "name": "network-vif-plugged", "status": "completed", "tag": "79654163-e203-4648-9bf6-ad925378a698"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:47.391974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-2a8f5bb2-466c-4ea3-b4a1-aa794ed5dd6d req-221ed655-6c95-4f0f-a628-88a0b18463c3 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:47.392404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-2a8f5bb2-466c-4ea3-b4a1-aa794ed5dd6d req-221ed655-6c95-4f0f-a628-88a0b18463c3 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:47.410788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-2a8f5bb2-466c-4ea3-b4a1-aa794ed5dd6d req-221ed655-6c95-4f0f-a628-88a0b18463c3 service nova] Creating event network-vif-plugged:79654163-e203-4648-9bf6-ad925378a698 for instance 15537672-68be-4fae-8588-b9f6a56f9a88 on hv-cinder-82549 Jul 14 09:38:47.416140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-2a8f5bb2-466c-4ea3-b4a1-aa794ed5dd6d req-221ed655-6c95-4f0f-a628-88a0b18463c3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360040 Jul 14 09:38:47.416731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 86/178] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:47.952826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e01a76a1-2e68-4de1-a7ee-956b3d31b205 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:47.953494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e01a76a1-2e68-4de1-a7ee-956b3d31b205 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:47.966788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=99 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:47.969315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e01a76a1-2e68-4de1-a7ee-956b3d31b205 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:47.970922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e01a76a1-2e68-4de1-a7ee-956b3d31b205 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:47.971972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e01a76a1-2e68-4de1-a7ee-956b3d31b205 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:47.973128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e01a76a1-2e68-4de1-a7ee-956b3d31b205 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:48.072212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-621afeab-67e3-44ab-b3ee-8d53ced647b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:48.073138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-621afeab-67e3-44ab-b3ee-8d53ced647b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:48.088897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-621afeab-67e3-44ab-b3ee-8d53ced647b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:48.088897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-621afeab-67e3-44ab-b3ee-8d53ced647b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:48.090957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-621afeab-67e3-44ab-b3ee-8d53ced647b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:48.091794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-621afeab-67e3-44ab-b3ee-8d53ced647b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:48.271719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e01a76a1-2e68-4de1-a7ee-956b3d31b205 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:48.283976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e01a76a1-2e68-4de1-a7ee-956b3d31b205 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.340463 Jul 14 09:38:48.284726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 93/179] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:48.296054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:48.296818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:48.314811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:48.315543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:48.316545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:48.319787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:48.709243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-621afeab-67e3-44ab-b3ee-8d53ced647b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:48.720421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-621afeab-67e3-44ab-b3ee-8d53ced647b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.652521 Jul 14 09:38:48.724293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 87/180] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:48 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:48.729110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4a9087f7-fddb-43e6-81cf-1b0ecb11c8a0 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:48.733641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4a9087f7-fddb-43e6-81cf-1b0ecb11c8a0 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:48.752588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a9087f7-fddb-43e6-81cf-1b0ecb11c8a0 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:48.754799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a9087f7-fddb-43e6-81cf-1b0ecb11c8a0 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:48.757047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a9087f7-fddb-43e6-81cf-1b0ecb11c8a0 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:48.758047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a9087f7-fddb-43e6-81cf-1b0ecb11c8a0 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:48.788579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:48.798157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:48.801992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:48.803296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f3a2f825-d5eb-4bf9-98ec-397fd1e563b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.517277 Jul 14 09:38:48.804186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 94/181] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:48.938823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4a9087f7-fddb-43e6-81cf-1b0ecb11c8a0 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:48.951612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4a9087f7-fddb-43e6-81cf-1b0ecb11c8a0 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.225467 Jul 14 09:38:48.952235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 88/182] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:48 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:49.307510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e26ae953-9288-4ba6-8332-735212979b53 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:49.308126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e26ae953-9288-4ba6-8332-735212979b53 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:49.315074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e26ae953-9288-4ba6-8332-735212979b53 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:49.315534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e26ae953-9288-4ba6-8332-735212979b53 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:49.316308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e26ae953-9288-4ba6-8332-735212979b53 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:49.316905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e26ae953-9288-4ba6-8332-735212979b53 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:49.433181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-71d3dad6-4640-4464-ac4f-2b997715e82a req-b597bc08-4ce5-45d6-b2b3-16984a2580bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1", "name": "network-vif-plugged", "status": "completed", "tag": "2a9b746f-3a6c-4ff1-b675-838773cc6ee9"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:49.454011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-71d3dad6-4640-4464-ac4f-2b997715e82a req-b597bc08-4ce5-45d6-b2b3-16984a2580bc service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:49.454011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-71d3dad6-4640-4464-ac4f-2b997715e82a req-b597bc08-4ce5-45d6-b2b3-16984a2580bc service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:49.473267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-71d3dad6-4640-4464-ac4f-2b997715e82a req-b597bc08-4ce5-45d6-b2b3-16984a2580bc service nova] Creating event network-vif-plugged:2a9b746f-3a6c-4ff1-b675-838773cc6ee9 for instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 on hv-cinder-82549 Jul 14 09:38:49.500605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-71d3dad6-4640-4464-ac4f-2b997715e82a req-b597bc08-4ce5-45d6-b2b3-16984a2580bc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071062 Jul 14 09:38:49.502956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 89/183] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:38:49.507756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e26ae953-9288-4ba6-8332-735212979b53 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:49.516735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e26ae953-9288-4ba6-8332-735212979b53 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.215834 Jul 14 09:38:49.517301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 95/184] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:49 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:49.739177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ce3b8034-d0d9-408b-9feb-9d88298fdd8e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:49.740075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ce3b8034-d0d9-408b-9feb-9d88298fdd8e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:49.747942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce3b8034-d0d9-408b-9feb-9d88298fdd8e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:49.748668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce3b8034-d0d9-408b-9feb-9d88298fdd8e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:49.750236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce3b8034-d0d9-408b-9feb-9d88298fdd8e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:49.750923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce3b8034-d0d9-408b-9feb-9d88298fdd8e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:49.829576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:49.830522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:49.840019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:49.841290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:49.842934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:49.843572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:49.981568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ce3b8034-d0d9-408b-9feb-9d88298fdd8e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:49.993798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ce3b8034-d0d9-408b-9feb-9d88298fdd8e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.256644 Jul 14 09:38:49.998381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 90/185] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:49 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:50.002754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5e03f068-5c00-48e0-8bcd-9502b252d9a6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:50.003365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5e03f068-5c00-48e0-8bcd-9502b252d9a6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:50.013276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e03f068-5c00-48e0-8bcd-9502b252d9a6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:50.014065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e03f068-5c00-48e0-8bcd-9502b252d9a6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:50.015681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e03f068-5c00-48e0-8bcd-9502b252d9a6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:50.016724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e03f068-5c00-48e0-8bcd-9502b252d9a6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:50.066519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:50.074875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:50.076372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:50.077460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-15c00276-386c-45f5-93f2-9891ac06e5b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.253108 Jul 14 09:38:50.078211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 96/186] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:50.213737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5e03f068-5c00-48e0-8bcd-9502b252d9a6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:50.223821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5e03f068-5c00-48e0-8bcd-9502b252d9a6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.226739 Jul 14 09:38:50.224753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 91/187] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:49 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:50.539402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-55d3fba8-7775-4ad6-8050-936e7a8bc101 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:50.544006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-55d3fba8-7775-4ad6-8050-936e7a8bc101 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:50.551389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-55d3fba8-7775-4ad6-8050-936e7a8bc101 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:50.551831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-55d3fba8-7775-4ad6-8050-936e7a8bc101 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:50.552592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-55d3fba8-7775-4ad6-8050-936e7a8bc101 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:50.553121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-55d3fba8-7775-4ad6-8050-936e7a8bc101 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:50.710040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-55d3fba8-7775-4ad6-8050-936e7a8bc101 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:50.720689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-55d3fba8-7775-4ad6-8050-936e7a8bc101 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.190666 Jul 14 09:38:50.721276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 97/188] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:50 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:51.012931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5770a222-30d2-4e7b-b036-065cc3fd4097 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:51.014163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5770a222-30d2-4e7b-b036-065cc3fd4097 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:51.020976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5770a222-30d2-4e7b-b036-065cc3fd4097 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:51.021686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5770a222-30d2-4e7b-b036-065cc3fd4097 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:51.022558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5770a222-30d2-4e7b-b036-065cc3fd4097 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:51.023071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5770a222-30d2-4e7b-b036-065cc3fd4097 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:51.027382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:51.096584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:51.098858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:51.125435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:51.127619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:51.129029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:51.129482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:51.850890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5770a222-30d2-4e7b-b036-065cc3fd4097 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:51.859039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5770a222-30d2-4e7b-b036-065cc3fd4097 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.851713 Jul 14 09:38:51.859987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 92/189] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:51 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:51.865113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5696cb4f-0f66-43ad-b170-7e429a85f851 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:51.865670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5696cb4f-0f66-43ad-b170-7e429a85f851 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:51.876003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5696cb4f-0f66-43ad-b170-7e429a85f851 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:51.876649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5696cb4f-0f66-43ad-b170-7e429a85f851 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:51.877668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5696cb4f-0f66-43ad-b170-7e429a85f851 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:51.878347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5696cb4f-0f66-43ad-b170-7e429a85f851 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:51.965788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:51.976756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:51.978421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:51.980012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9535d475-62d8-4cce-a95f-320a5caa08b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.887866 Jul 14 09:38:51.981148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 98/190] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:51.989598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e80a16b8-347d-4445-a8fa-afc8fd04c58d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:51.990275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e80a16b8-347d-4445-a8fa-afc8fd04c58d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:51.996555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e80a16b8-347d-4445-a8fa-afc8fd04c58d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:51.997080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e80a16b8-347d-4445-a8fa-afc8fd04c58d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:51.997776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e80a16b8-347d-4445-a8fa-afc8fd04c58d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:51.998231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e80a16b8-347d-4445-a8fa-afc8fd04c58d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:52.002373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:52.191874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5696cb4f-0f66-43ad-b170-7e429a85f851 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:52.200769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5696cb4f-0f66-43ad-b170-7e429a85f851 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.339507 Jul 14 09:38:52.201556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 93/191] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:51 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:52.234722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e80a16b8-347d-4445-a8fa-afc8fd04c58d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:52.244000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e80a16b8-347d-4445-a8fa-afc8fd04c58d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.261318 Jul 14 09:38:52.244835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 99/192] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:51 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:52.878787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f6c389fb-9785-415c-93b7-a88fce674411 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:52.879403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f6c389fb-9785-415c-93b7-a88fce674411 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:52.881410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=97 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:38:52.887070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6c389fb-9785-415c-93b7-a88fce674411 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:52.887769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6c389fb-9785-415c-93b7-a88fce674411 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:52.888678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6c389fb-9785-415c-93b7-a88fce674411 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:52.889119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6c389fb-9785-415c-93b7-a88fce674411 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:52.999712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:53.000983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:53.007831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:53.008608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:53.017700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:53.018817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:53.060320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f6c389fb-9785-415c-93b7-a88fce674411 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:53.069998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f6c389fb-9785-415c-93b7-a88fce674411 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.195746 Jul 14 09:38:53.071047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 94/193] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:52 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:53.075958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-f3a8e8cc-11fc-4bd9-802f-fa96a902c419 req-42b5d13e-9346-40f9-8571-ac983ffc584e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00a0737-b755-4d07-a5a1-8b691911836f", "name": "network-vif-plugged", "status": "completed", "tag": "1975270c-eaaa-4443-9916-238cad412d51"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:53.084354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f3a8e8cc-11fc-4bd9-802f-fa96a902c419 req-42b5d13e-9346-40f9-8571-ac983ffc584e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:53.084799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f3a8e8cc-11fc-4bd9-802f-fa96a902c419 req-42b5d13e-9346-40f9-8571-ac983ffc584e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:53.098703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-f3a8e8cc-11fc-4bd9-802f-fa96a902c419 req-42b5d13e-9346-40f9-8571-ac983ffc584e service nova] Creating event network-vif-plugged:1975270c-eaaa-4443-9916-238cad412d51 for instance a00a0737-b755-4d07-a5a1-8b691911836f on hv-cinder-82549 Jul 14 09:38:53.105099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-f3a8e8cc-11fc-4bd9-802f-fa96a902c419 req-42b5d13e-9346-40f9-8571-ac983ffc584e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Jul 14 09:38:53.106835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 95/194] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:53.190812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:53.200401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:53.201930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:53.203077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-31bba2ea-109a-4ef8-91e3-f4e44b1548c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.208505 Jul 14 09:38:53.203631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 100/195] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:53.219051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c7ba91f7-43e1-470b-aebb-7fdd490e7a69 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:53.219734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c7ba91f7-43e1-470b-aebb-7fdd490e7a69 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:53.227737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7ba91f7-43e1-470b-aebb-7fdd490e7a69 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:53.228215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7ba91f7-43e1-470b-aebb-7fdd490e7a69 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:53.228968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7ba91f7-43e1-470b-aebb-7fdd490e7a69 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:53.229397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7ba91f7-43e1-470b-aebb-7fdd490e7a69 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:53.261343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b80b8cb-260e-4cf8-afaa-bc14c949fbfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:53.262431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b80b8cb-260e-4cf8-afaa-bc14c949fbfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:53.278453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b80b8cb-260e-4cf8-afaa-bc14c949fbfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:53.278907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b80b8cb-260e-4cf8-afaa-bc14c949fbfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:53.279682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b80b8cb-260e-4cf8-afaa-bc14c949fbfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:53.280114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b80b8cb-260e-4cf8-afaa-bc14c949fbfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:53.447840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c7ba91f7-43e1-470b-aebb-7fdd490e7a69 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:53.460800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c7ba91f7-43e1-470b-aebb-7fdd490e7a69 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.247343 Jul 14 09:38:53.464252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 96/196] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:53 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:53.488081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b80b8cb-260e-4cf8-afaa-bc14c949fbfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:53.496024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b80b8cb-260e-4cf8-afaa-bc14c949fbfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.239001 Jul 14 09:38:53.496593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 101/197] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:53 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:54.087670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-163a7c72-7f81-42aa-9f00-f8a9efab6df6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:54.088343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-163a7c72-7f81-42aa-9f00-f8a9efab6df6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:54.094461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-163a7c72-7f81-42aa-9f00-f8a9efab6df6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:54.094984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-163a7c72-7f81-42aa-9f00-f8a9efab6df6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:54.095840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-163a7c72-7f81-42aa-9f00-f8a9efab6df6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:54.096431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-163a7c72-7f81-42aa-9f00-f8a9efab6df6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:54.222418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:54.223029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:54.229240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:54.229686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:54.231095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:54.231537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:54.296694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-163a7c72-7f81-42aa-9f00-f8a9efab6df6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:54.307534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-163a7c72-7f81-42aa-9f00-f8a9efab6df6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.221013 Jul 14 09:38:54.307534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 97/198] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:54 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:54.448157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:54.459090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:54.460732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:54.461948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5fdbab27-b58a-49cf-9852-469be941fcb9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.243716 Jul 14 09:38:54.463242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 102/199] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:54.479465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-03ead7e8-e652-4e26-99b6-7a78c7dd9eb1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:54.480685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-03ead7e8-e652-4e26-99b6-7a78c7dd9eb1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:54.487304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03ead7e8-e652-4e26-99b6-7a78c7dd9eb1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:54.487832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03ead7e8-e652-4e26-99b6-7a78c7dd9eb1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:54.488825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03ead7e8-e652-4e26-99b6-7a78c7dd9eb1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:54.489501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03ead7e8-e652-4e26-99b6-7a78c7dd9eb1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:54.517683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c0b8dfa5-1408-4ecf-a217-c59e45a5c508 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:54.518451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c0b8dfa5-1408-4ecf-a217-c59e45a5c508 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:54.525938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0b8dfa5-1408-4ecf-a217-c59e45a5c508 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:54.526649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0b8dfa5-1408-4ecf-a217-c59e45a5c508 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:54.528216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0b8dfa5-1408-4ecf-a217-c59e45a5c508 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:54.528849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0b8dfa5-1408-4ecf-a217-c59e45a5c508 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:54.706021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-03ead7e8-e652-4e26-99b6-7a78c7dd9eb1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:54.716531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-03ead7e8-e652-4e26-99b6-7a78c7dd9eb1 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.240614 Jul 14 09:38:54.717871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 98/200] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:54 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:54.740547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c0b8dfa5-1408-4ecf-a217-c59e45a5c508 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:54.748181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c0b8dfa5-1408-4ecf-a217-c59e45a5c508 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.237853 Jul 14 09:38:54.753639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 103/201] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:54 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:55.206732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-f247966b-299c-4514-8deb-74e2209e3805 req-efea7a4b-a5b1-402a-b5de-60d70cb2f82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99819874-5159-49fd-81c9-78998c928020", "name": "network-vif-plugged", "status": "completed", "tag": "c1165b3f-8447-4ca2-8d04-05ed3e331d2a"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:55.217290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f247966b-299c-4514-8deb-74e2209e3805 req-efea7a4b-a5b1-402a-b5de-60d70cb2f82f service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.218080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f247966b-299c-4514-8deb-74e2209e3805 req-efea7a4b-a5b1-402a-b5de-60d70cb2f82f service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.232432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-f247966b-299c-4514-8deb-74e2209e3805 req-efea7a4b-a5b1-402a-b5de-60d70cb2f82f service nova] Creating event network-vif-plugged:c1165b3f-8447-4ca2-8d04-05ed3e331d2a for instance 99819874-5159-49fd-81c9-78998c928020 on hv-cinder-82549 Jul 14 09:38:55.240023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-f247966b-299c-4514-8deb-74e2209e3805 req-efea7a4b-a5b1-402a-b5de-60d70cb2f82f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036524 Jul 14 09:38:55.240917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 99/202] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:38:55.324063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e2f692c6-d0f6-41f7-bae4-922cead57999 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:55.325755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e2f692c6-d0f6-41f7-bae4-922cead57999 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:55.332456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2f692c6-d0f6-41f7-bae4-922cead57999 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.333050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2f692c6-d0f6-41f7-bae4-922cead57999 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.334228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2f692c6-d0f6-41f7-bae4-922cead57999 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.335048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2f692c6-d0f6-41f7-bae4-922cead57999 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.482861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:55.484513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:55.489254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e2f692c6-d0f6-41f7-bae4-922cead57999 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:55.503656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.504098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.504872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.505444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.509522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e2f692c6-d0f6-41f7-bae4-922cead57999 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.190972 Jul 14 09:38:55.510367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 104/203] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:55 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:55.711101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:55.719934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:55.721420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:55.722540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-da2eb316-3e5e-44af-b570-65aa8bb8ecbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.245989 Jul 14 09:38:55.723093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 100/204] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:55.733922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-79e83625-dca9-4276-b685-acbf975e344c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:55.733922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-79e83625-dca9-4276-b685-acbf975e344c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:55.740995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-79e83625-dca9-4276-b685-acbf975e344c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.741769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-79e83625-dca9-4276-b685-acbf975e344c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.742943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-79e83625-dca9-4276-b685-acbf975e344c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.747311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-79e83625-dca9-4276-b685-acbf975e344c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.765751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b5fdda68-6dc5-4fe3-8c99-01d2b42873e2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:55.766465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b5fdda68-6dc5-4fe3-8c99-01d2b42873e2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:55.773761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5fdda68-6dc5-4fe3-8c99-01d2b42873e2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.774304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5fdda68-6dc5-4fe3-8c99-01d2b42873e2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.775750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5fdda68-6dc5-4fe3-8c99-01d2b42873e2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:55.776747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5fdda68-6dc5-4fe3-8c99-01d2b42873e2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:55.936820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-79e83625-dca9-4276-b685-acbf975e344c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:55.945487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-79e83625-dca9-4276-b685-acbf975e344c tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.216206 Jul 14 09:38:55.946103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 105/205] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:55 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:55.992596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b5fdda68-6dc5-4fe3-8c99-01d2b42873e2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:56.000859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b5fdda68-6dc5-4fe3-8c99-01d2b42873e2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.239842 Jul 14 09:38:56.001443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 101/206] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:55 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:56.526456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7c22fec3-64ac-4d1e-b486-dccc93670ed5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:56.527718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7c22fec3-64ac-4d1e-b486-dccc93670ed5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:56.537467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c22fec3-64ac-4d1e-b486-dccc93670ed5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:56.537915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c22fec3-64ac-4d1e-b486-dccc93670ed5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:56.538747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c22fec3-64ac-4d1e-b486-dccc93670ed5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:56.539181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c22fec3-64ac-4d1e-b486-dccc93670ed5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:56.694045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7c22fec3-64ac-4d1e-b486-dccc93670ed5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:56.701974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7c22fec3-64ac-4d1e-b486-dccc93670ed5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.179603 Jul 14 09:38:56.702573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 106/207] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:56 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:56.742883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:56.743418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:56.751862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:56.752563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:56.753371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:56.753922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:56.888587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:56.897411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:56.898965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:56.900087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1fa856ab-9dfa-4753-be9c-ac74a151a30a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.162796 Jul 14 09:38:56.900713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 102/208] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:56.964681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6904e51e-c302-4330-8caa-0c52780cbf90 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:56.965285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6904e51e-c302-4330-8caa-0c52780cbf90 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:56.971672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6904e51e-c302-4330-8caa-0c52780cbf90 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:56.972315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6904e51e-c302-4330-8caa-0c52780cbf90 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:56.973228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6904e51e-c302-4330-8caa-0c52780cbf90 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:56.973667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6904e51e-c302-4330-8caa-0c52780cbf90 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:57.019232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5874aa80-35e2-459f-b011-2ed412f3f717 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:57.020101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5874aa80-35e2-459f-b011-2ed412f3f717 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:57.028936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5874aa80-35e2-459f-b011-2ed412f3f717 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:57.030031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5874aa80-35e2-459f-b011-2ed412f3f717 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:57.031088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5874aa80-35e2-459f-b011-2ed412f3f717 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:57.031563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5874aa80-35e2-459f-b011-2ed412f3f717 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:57.265184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6904e51e-c302-4330-8caa-0c52780cbf90 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:57.267430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5874aa80-35e2-459f-b011-2ed412f3f717 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:57.298012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6904e51e-c302-4330-8caa-0c52780cbf90 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1315 microversion: 2.1 time: 0.339616 Jul 14 09:38:57.316598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5874aa80-35e2-459f-b011-2ed412f3f717 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.300887 Jul 14 09:38:57.336472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 107/209] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:56 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:57.336718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 103/210] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:57 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:57.719236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7696813-aaa7-4a3c-93a6-6de2d552e0c5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:57.720637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d7696813-aaa7-4a3c-93a6-6de2d552e0c5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:57.727140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7696813-aaa7-4a3c-93a6-6de2d552e0c5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:57.727708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7696813-aaa7-4a3c-93a6-6de2d552e0c5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:57.728582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7696813-aaa7-4a3c-93a6-6de2d552e0c5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:57.729120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7696813-aaa7-4a3c-93a6-6de2d552e0c5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:57.870486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7696813-aaa7-4a3c-93a6-6de2d552e0c5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:57.878975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d7696813-aaa7-4a3c-93a6-6de2d552e0c5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.164091 Jul 14 09:38:57.882283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 108/211] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:57 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:57.918759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:57.919465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:57.925843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:57.926771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:57.927539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:57.928228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:58.160892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:58.170270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:58.172704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:58.173985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-78a0be40-2f65-4479-82aa-a9fcd797ca64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.259475 Jul 14 09:38:58.174686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 104/212] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:38:58.316137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ebbf6953-e204-4ee3-9676-77451a77f5a9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:58.316746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ebbf6953-e204-4ee3-9676-77451a77f5a9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:58.323324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebbf6953-e204-4ee3-9676-77451a77f5a9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:58.324631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebbf6953-e204-4ee3-9676-77451a77f5a9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:58.325726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebbf6953-e204-4ee3-9676-77451a77f5a9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:58.326251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebbf6953-e204-4ee3-9676-77451a77f5a9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:58.332794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-baeae8c3-07f0-40eb-a3b0-26e04f476758 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:58.333396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-baeae8c3-07f0-40eb-a3b0-26e04f476758 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:58.340190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baeae8c3-07f0-40eb-a3b0-26e04f476758 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:58.340694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baeae8c3-07f0-40eb-a3b0-26e04f476758 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:58.341590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baeae8c3-07f0-40eb-a3b0-26e04f476758 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:58.342069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baeae8c3-07f0-40eb-a3b0-26e04f476758 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:58.562330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ebbf6953-e204-4ee3-9676-77451a77f5a9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:58.565673 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-baeae8c3-07f0-40eb-a3b0-26e04f476758 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:58.570782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ebbf6953-e204-4ee3-9676-77451a77f5a9 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1503 microversion: 2.1 time: 0.259521 Jul 14 09:38:58.571565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 109/213] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:58 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:58.573757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-baeae8c3-07f0-40eb-a3b0-26e04f476758 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.244746 Jul 14 09:38:58.582944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 105/214] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:58 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:38:58.897772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0c9f7fdb-deac-4be4-9373-7fdcbc126934 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:58.900373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0c9f7fdb-deac-4be4-9373-7fdcbc126934 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:58.914173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c9f7fdb-deac-4be4-9373-7fdcbc126934 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:58.915920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c9f7fdb-deac-4be4-9373-7fdcbc126934 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:58.916917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c9f7fdb-deac-4be4-9373-7fdcbc126934 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:58.918241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c9f7fdb-deac-4be4-9373-7fdcbc126934 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:59.114106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c9f7fdb-deac-4be4-9373-7fdcbc126934 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:59.122441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0c9f7fdb-deac-4be4-9373-7fdcbc126934 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.228372 Jul 14 09:38:59.123024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 110/215] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:58 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:38:59.192727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:59.193763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:59.199821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:59.200261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:59.201009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:59.201434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:59.342344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:59.351273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:59.353356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:59.354689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-14cfd92d-f957-4c45-939e-5a46dec7715b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.165811 Jul 14 09:38:59.366156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 106/216] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:38:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:38:59.523983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-404c34e5-d2bf-4c6b-bb66-6cfade2f3c05 req-655abf13-74df-4198-ac29-553fd7409ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61bb2fe3-a0ee-48ce-996f-64ef966f6bcd", "name": "network-vif-plugged", "status": "completed", "tag": "48f22e3e-0aba-4714-8fb9-6f1f18ac1f69"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:38:59.536289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-404c34e5-d2bf-4c6b-bb66-6cfade2f3c05 req-655abf13-74df-4198-ac29-553fd7409ff9 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:59.537153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-404c34e5-d2bf-4c6b-bb66-6cfade2f3c05 req-655abf13-74df-4198-ac29-553fd7409ff9 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:59.554923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-404c34e5-d2bf-4c6b-bb66-6cfade2f3c05 req-655abf13-74df-4198-ac29-553fd7409ff9 service nova] Creating event network-vif-plugged:48f22e3e-0aba-4714-8fb9-6f1f18ac1f69 for instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd on hv-cinder-82549 Jul 14 09:38:59.560356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-404c34e5-d2bf-4c6b-bb66-6cfade2f3c05 req-655abf13-74df-4198-ac29-553fd7409ff9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041244 Jul 14 09:38:59.562326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 111/217] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:38:59.592965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-35fb915b-e46c-4e53-8063-ee2d1ece14a6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:38:59.594098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-35fb915b-e46c-4e53-8063-ee2d1ece14a6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:38:59.600569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-35fb915b-e46c-4e53-8063-ee2d1ece14a6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:59.601234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-35fb915b-e46c-4e53-8063-ee2d1ece14a6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:59.602017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-35fb915b-e46c-4e53-8063-ee2d1ece14a6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:38:59.602471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-35fb915b-e46c-4e53-8063-ee2d1ece14a6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:38:59.793124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-35fb915b-e46c-4e53-8063-ee2d1ece14a6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:38:59.801134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-35fb915b-e46c-4e53-8063-ee2d1ece14a6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.214291 Jul 14 09:38:59.802052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 107/218] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:38:59 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:00.158546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-01daa4fc-5fd2-4f66-9ae5-a94dc81167e9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:00.159796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-01daa4fc-5fd2-4f66-9ae5-a94dc81167e9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:00.172479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01daa4fc-5fd2-4f66-9ae5-a94dc81167e9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:00.173151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01daa4fc-5fd2-4f66-9ae5-a94dc81167e9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:00.174273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01daa4fc-5fd2-4f66-9ae5-a94dc81167e9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:00.175181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01daa4fc-5fd2-4f66-9ae5-a94dc81167e9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:00.317599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-01daa4fc-5fd2-4f66-9ae5-a94dc81167e9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:00.325547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-01daa4fc-5fd2-4f66-9ae5-a94dc81167e9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.189265 Jul 14 09:39:00.326042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 112/219] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:00 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:00.372839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:00.373444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:00.379595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:00.380035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:00.380911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:00.381340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:00.509351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:00.517891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:00.519416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:00.520507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7bdd8155-0147-4e55-91e5-16b08009c38e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.151609 Jul 14 09:39:00.521056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 108/220] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:39:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:39:00.817399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ef3ba872-dde9-4075-8fe8-1d6572bd1ff4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:00.818001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ef3ba872-dde9-4075-8fe8-1d6572bd1ff4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:00.824809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef3ba872-dde9-4075-8fe8-1d6572bd1ff4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:00.825257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef3ba872-dde9-4075-8fe8-1d6572bd1ff4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:00.826012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef3ba872-dde9-4075-8fe8-1d6572bd1ff4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:00.826473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef3ba872-dde9-4075-8fe8-1d6572bd1ff4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:00.954783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ef3ba872-dde9-4075-8fe8-1d6572bd1ff4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:00.962424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ef3ba872-dde9-4075-8fe8-1d6572bd1ff4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1364 microversion: 2.1 time: 0.148553 Jul 14 09:39:00.962977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 113/221] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:00 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:01.090414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a29ab1ab-f239-469f-993e-b58a415a3028 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76a2bf89-587c-48f4-89b8-96110cede4a4"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:01.091556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a29ab1ab-f239-469f-993e-b58a415a3028 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:01.097567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a29ab1ab-f239-469f-993e-b58a415a3028 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:01.098018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a29ab1ab-f239-469f-993e-b58a415a3028 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:01.098888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a29ab1ab-f239-469f-993e-b58a415a3028 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:01.099324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a29ab1ab-f239-469f-993e-b58a415a3028 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:01.342803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9c436a3c-5683-4ae7-a8ff-2da78cc6dbdf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:01.343456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9c436a3c-5683-4ae7-a8ff-2da78cc6dbdf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:01.349435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c436a3c-5683-4ae7-a8ff-2da78cc6dbdf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:01.349880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c436a3c-5683-4ae7-a8ff-2da78cc6dbdf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:01.350673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c436a3c-5683-4ae7-a8ff-2da78cc6dbdf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:01.351107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c436a3c-5683-4ae7-a8ff-2da78cc6dbdf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:01.482867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9c436a3c-5683-4ae7-a8ff-2da78cc6dbdf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:01.490131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9c436a3c-5683-4ae7-a8ff-2da78cc6dbdf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.151895 Jul 14 09:39:01.490715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 114/222] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:01 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:01.537435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:01.538048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:01.544636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:01.545086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:01.546375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:01.547046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:01.682344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:01.690322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:01.691894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:01.693051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8a7ccbb8-c00d-4ae5-94df-b93c47deb367 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1405 microversion: 2.20 time: 0.159554 Jul 14 09:39:01.693647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 115/223] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:39:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:39:01.978869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-75f69d2d-75f6-410a-95e3-a4c91f2fe793 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:01.979471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-75f69d2d-75f6-410a-95e3-a4c91f2fe793 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:01.985987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75f69d2d-75f6-410a-95e3-a4c91f2fe793 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:01.986470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75f69d2d-75f6-410a-95e3-a4c91f2fe793 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:01.987225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75f69d2d-75f6-410a-95e3-a4c91f2fe793 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:01.987653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75f69d2d-75f6-410a-95e3-a4c91f2fe793 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:02.006282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:02.125731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-75f69d2d-75f6-410a-95e3-a4c91f2fe793 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:02.133256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-75f69d2d-75f6-410a-95e3-a4c91f2fe793 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1550 microversion: 2.1 time: 0.158308 Jul 14 09:39:02.133815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 116/224] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:01 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:02.155645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f9b66339-209c-4393-b20f-58a6c7cdf4fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:02.156203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f9b66339-209c-4393-b20f-58a6c7cdf4fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:02.163843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9b66339-209c-4393-b20f-58a6c7cdf4fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:02.163950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9b66339-209c-4393-b20f-58a6c7cdf4fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:02.164643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9b66339-209c-4393-b20f-58a6c7cdf4fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:02.165074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9b66339-209c-4393-b20f-58a6c7cdf4fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:02.287631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f9b66339-209c-4393-b20f-58a6c7cdf4fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136642 Jul 14 09:39:02.288255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 117/225] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 09:39:02 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:02.507198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-361355f7-d6a3-4422-8858-7e7fd01e7c72 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:02.508508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-361355f7-d6a3-4422-8858-7e7fd01e7c72 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:02.515946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-361355f7-d6a3-4422-8858-7e7fd01e7c72 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:02.516589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-361355f7-d6a3-4422-8858-7e7fd01e7c72 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:02.517522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-361355f7-d6a3-4422-8858-7e7fd01e7c72 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:02.518098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-361355f7-d6a3-4422-8858-7e7fd01e7c72 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:03.180106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-361355f7-d6a3-4422-8858-7e7fd01e7c72 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:03.188195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-361355f7-d6a3-4422-8858-7e7fd01e7c72 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.684707 Jul 14 09:39:03.188966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 118/226] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:02 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:03.193749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:03.194567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:03.201145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:03.201543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:03.202338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:03.202765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:03.329865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:03.515389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a29ab1ab-f239-469f-993e-b58a415a3028 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "POST /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.429126 Jul 14 09:39:03.516009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 109/227] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 09:39:01 2022] POST /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88/os-volume_attachments => generated 194 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:03.625839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:03.634692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:03.636384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:03.637761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fa645ee2-556b-42fd-8428-b4742e94b82b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1598 microversion: 2.20 time: 0.447797 Jul 14 09:39:03.638699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 119/228] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:39:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1598 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:39:03.659147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef1d414c-ae96-4bce-a0f4-1fdc97e3e978 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:03.660704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ef1d414c-ae96-4bce-a0f4-1fdc97e3e978 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:03.670432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef1d414c-ae96-4bce-a0f4-1fdc97e3e978 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:03.671126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef1d414c-ae96-4bce-a0f4-1fdc97e3e978 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:03.672089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef1d414c-ae96-4bce-a0f4-1fdc97e3e978 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:03.672525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef1d414c-ae96-4bce-a0f4-1fdc97e3e978 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:03.817610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ef1d414c-ae96-4bce-a0f4-1fdc97e3e978 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.163951 Jul 14 09:39:03.818491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 110/229] 10.222.0.40 () {60 vars in 1315 bytes} [Thu Jul 14 09:39:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:39:04.213740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e18aad70-3eb0-45d3-83a6-2e641e78f143 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:04.215152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e18aad70-3eb0-45d3-83a6-2e641e78f143 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:04.221532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e18aad70-3eb0-45d3-83a6-2e641e78f143 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:04.221963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e18aad70-3eb0-45d3-83a6-2e641e78f143 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:04.222944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e18aad70-3eb0-45d3-83a6-2e641e78f143 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:04.223369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e18aad70-3eb0-45d3-83a6-2e641e78f143 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:04.815538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e18aad70-3eb0-45d3-83a6-2e641e78f143 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:04.828684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e18aad70-3eb0-45d3-83a6-2e641e78f143 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1322 microversion: 2.1 time: 0.626319 Jul 14 09:39:04.829371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 120/230] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:04 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:04.936410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-6ad8aad9-f421-4468-b593-3bb5e57198db req-36df5f28-790a-42cd-a6ba-2baf7f76d658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99819874-5159-49fd-81c9-78998c928020", "tag": "c1165b3f-8447-4ca2-8d04-05ed3e331d2a"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:04.950753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-6ad8aad9-f421-4468-b593-3bb5e57198db req-36df5f28-790a-42cd-a6ba-2baf7f76d658 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:04.951295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-6ad8aad9-f421-4468-b593-3bb5e57198db req-36df5f28-790a-42cd-a6ba-2baf7f76d658 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:04.965195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-6ad8aad9-f421-4468-b593-3bb5e57198db req-36df5f28-790a-42cd-a6ba-2baf7f76d658 service nova] Creating event network-changed:c1165b3f-8447-4ca2-8d04-05ed3e331d2a for instance 99819874-5159-49fd-81c9-78998c928020 on hv-cinder-82549 Jul 14 09:39:04.970773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-6ad8aad9-f421-4468-b593-3bb5e57198db req-36df5f28-790a-42cd-a6ba-2baf7f76d658 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041110 Jul 14 09:39:04.971781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 111/231] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:05.846716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d632a807-8486-4dfb-a9f3-09af4edeeebe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:05.847500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d632a807-8486-4dfb-a9f3-09af4edeeebe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:05.863044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d632a807-8486-4dfb-a9f3-09af4edeeebe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:05.863300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d632a807-8486-4dfb-a9f3-09af4edeeebe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:05.865761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d632a807-8486-4dfb-a9f3-09af4edeeebe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:05.866229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d632a807-8486-4dfb-a9f3-09af4edeeebe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:06.308232 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d632a807-8486-4dfb-a9f3-09af4edeeebe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:06.316654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d632a807-8486-4dfb-a9f3-09af4edeeebe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1517 microversion: 2.1 time: 0.474704 Jul 14 09:39:06.317625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 121/232] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:05 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1517 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:06.337849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f7ac15b-326f-46b5-a28e-aba09e8ccfb5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:06.342836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f7ac15b-326f-46b5-a28e-aba09e8ccfb5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:06.358769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7ac15b-326f-46b5-a28e-aba09e8ccfb5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:06.359413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7ac15b-326f-46b5-a28e-aba09e8ccfb5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:06.361079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7ac15b-326f-46b5-a28e-aba09e8ccfb5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:06.361636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7ac15b-326f-46b5-a28e-aba09e8ccfb5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:06.425551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-9f7ac15b-326f-46b5-a28e-aba09e8ccfb5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lazy-loading 'flavor' on Instance uuid 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:39:06.689156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f7ac15b-326f-46b5-a28e-aba09e8ccfb5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd/action" status: 200 len: 32 microversion: 2.1 time: 0.356836 Jul 14 09:39:06.694238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 112/233] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:39:06 2022] POST /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 09:39:06.699596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1003a8c8-44db-41fa-93be-4a02caf05c66 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:06.700714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1003a8c8-44db-41fa-93be-4a02caf05c66 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:06.712413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1003a8c8-44db-41fa-93be-4a02caf05c66 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:06.713627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1003a8c8-44db-41fa-93be-4a02caf05c66 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:06.716663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1003a8c8-44db-41fa-93be-4a02caf05c66 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:06.717214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1003a8c8-44db-41fa-93be-4a02caf05c66 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:06.977626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1003a8c8-44db-41fa-93be-4a02caf05c66 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:06.985556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1003a8c8-44db-41fa-93be-4a02caf05c66 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.289902 Jul 14 09:39:06.986667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 122/234] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:06 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:07.022490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-752540cb-4b64-4d80-ae6a-c909bc3583f8 req-44250368-2187-4a1f-bab5-ceb0251730dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00a0737-b755-4d07-a5a1-8b691911836f", "tag": "1975270c-eaaa-4443-9916-238cad412d51"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:07.033993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-752540cb-4b64-4d80-ae6a-c909bc3583f8 req-44250368-2187-4a1f-bab5-ceb0251730dc service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:07.034769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-752540cb-4b64-4d80-ae6a-c909bc3583f8 req-44250368-2187-4a1f-bab5-ceb0251730dc service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:07.058069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-752540cb-4b64-4d80-ae6a-c909bc3583f8 req-44250368-2187-4a1f-bab5-ceb0251730dc service nova] Creating event network-changed:1975270c-eaaa-4443-9916-238cad412d51 for instance a00a0737-b755-4d07-a5a1-8b691911836f on hv-cinder-82549 Jul 14 09:39:07.067919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-752540cb-4b64-4d80-ae6a-c909bc3583f8 req-44250368-2187-4a1f-bab5-ceb0251730dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049881 Jul 14 09:39:07.069130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 113/235] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:08.003227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cc056144-ba17-47f5-b670-42d31f980671 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:08.003820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cc056144-ba17-47f5-b670-42d31f980671 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:08.009785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc056144-ba17-47f5-b670-42d31f980671 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:08.010256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc056144-ba17-47f5-b670-42d31f980671 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:08.011015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc056144-ba17-47f5-b670-42d31f980671 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:08.011445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc056144-ba17-47f5-b670-42d31f980671 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:08.158301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cc056144-ba17-47f5-b670-42d31f980671 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:08.166757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cc056144-ba17-47f5-b670-42d31f980671 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.167376 Jul 14 09:39:08.167892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 123/236] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:07 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:09.185394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dfab8b1e-1345-447e-b32a-94af4459d8d7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:09.186089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dfab8b1e-1345-447e-b32a-94af4459d8d7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:09.192783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfab8b1e-1345-447e-b32a-94af4459d8d7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:09.193235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfab8b1e-1345-447e-b32a-94af4459d8d7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:09.193986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfab8b1e-1345-447e-b32a-94af4459d8d7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:09.194456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfab8b1e-1345-447e-b32a-94af4459d8d7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:09.326173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dfab8b1e-1345-447e-b32a-94af4459d8d7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:09.333639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dfab8b1e-1345-447e-b32a-94af4459d8d7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.153447 Jul 14 09:39:09.334209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 114/237] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:09 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:10.350907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-593346c9-cc98-4899-8511-7c30e3d9adc4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:10.351502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-593346c9-cc98-4899-8511-7c30e3d9adc4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:10.357502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-593346c9-cc98-4899-8511-7c30e3d9adc4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:10.357935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-593346c9-cc98-4899-8511-7c30e3d9adc4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:10.358715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-593346c9-cc98-4899-8511-7c30e3d9adc4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:10.359142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-593346c9-cc98-4899-8511-7c30e3d9adc4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:10.491215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-593346c9-cc98-4899-8511-7c30e3d9adc4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:10.499190 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-593346c9-cc98-4899-8511-7c30e3d9adc4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.152264 Jul 14 09:39:10.499742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 124/238] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:10 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:11.515634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7e4aaad4-361f-4464-b0ba-415414c8ffcd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:11.516237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7e4aaad4-361f-4464-b0ba-415414c8ffcd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:11.522763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e4aaad4-361f-4464-b0ba-415414c8ffcd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:11.523206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e4aaad4-361f-4464-b0ba-415414c8ffcd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:11.523960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e4aaad4-361f-4464-b0ba-415414c8ffcd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:11.524390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e4aaad4-361f-4464-b0ba-415414c8ffcd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:11.672906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7e4aaad4-361f-4464-b0ba-415414c8ffcd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:11.680248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7e4aaad4-361f-4464-b0ba-415414c8ffcd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.168883 Jul 14 09:39:11.680813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 115/239] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:11 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:12.697041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-013999b4-11a7-4adc-a551-9b65b89cf86d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:12.697648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-013999b4-11a7-4adc-a551-9b65b89cf86d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:12.703920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-013999b4-11a7-4adc-a551-9b65b89cf86d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:12.704364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-013999b4-11a7-4adc-a551-9b65b89cf86d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:12.705115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-013999b4-11a7-4adc-a551-9b65b89cf86d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:12.705546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-013999b4-11a7-4adc-a551-9b65b89cf86d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:12.830958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-013999b4-11a7-4adc-a551-9b65b89cf86d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:12.838557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-013999b4-11a7-4adc-a551-9b65b89cf86d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.145261 Jul 14 09:39:12.839143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 125/240] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:12 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:13.855871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bee86834-ed88-4f64-ab74-d7c2d2ca28fe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:13.856473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bee86834-ed88-4f64-ab74-d7c2d2ca28fe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:13.863120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bee86834-ed88-4f64-ab74-d7c2d2ca28fe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:13.863570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bee86834-ed88-4f64-ab74-d7c2d2ca28fe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:13.864330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bee86834-ed88-4f64-ab74-d7c2d2ca28fe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:13.864763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bee86834-ed88-4f64-ab74-d7c2d2ca28fe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:13.991752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bee86834-ed88-4f64-ab74-d7c2d2ca28fe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:13.999439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bee86834-ed88-4f64-ab74-d7c2d2ca28fe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.147894 Jul 14 09:39:14.000000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 116/241] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:13 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:15.017392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d2123ab7-2df0-4ce0-8598-57fbd5b5bf33 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:15.018102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d2123ab7-2df0-4ce0-8598-57fbd5b5bf33 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:15.024629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d2123ab7-2df0-4ce0-8598-57fbd5b5bf33 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:15.025140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d2123ab7-2df0-4ce0-8598-57fbd5b5bf33 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:15.026023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d2123ab7-2df0-4ce0-8598-57fbd5b5bf33 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:15.027382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d2123ab7-2df0-4ce0-8598-57fbd5b5bf33 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:15.155383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d2123ab7-2df0-4ce0-8598-57fbd5b5bf33 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:15.162900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d2123ab7-2df0-4ce0-8598-57fbd5b5bf33 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.149974 Jul 14 09:39:15.163459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 126/242] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:15 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:16.180017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-462d0ce7-445f-4553-8a20-5e8fe58b5053 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:16.180624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-462d0ce7-445f-4553-8a20-5e8fe58b5053 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:16.187234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-462d0ce7-445f-4553-8a20-5e8fe58b5053 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:16.187621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-462d0ce7-445f-4553-8a20-5e8fe58b5053 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:16.188379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-462d0ce7-445f-4553-8a20-5e8fe58b5053 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:16.188810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-462d0ce7-445f-4553-8a20-5e8fe58b5053 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:16.320726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-462d0ce7-445f-4553-8a20-5e8fe58b5053 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:16.328686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-462d0ce7-445f-4553-8a20-5e8fe58b5053 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.152506 Jul 14 09:39:16.329242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 117/243] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:16 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:17.344544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e5a7e228-b7c6-446d-8638-3c4e5530d6c3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:17.345146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e5a7e228-b7c6-446d-8638-3c4e5530d6c3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:17.351083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e5a7e228-b7c6-446d-8638-3c4e5530d6c3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:17.351530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e5a7e228-b7c6-446d-8638-3c4e5530d6c3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:17.352284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e5a7e228-b7c6-446d-8638-3c4e5530d6c3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:17.352715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e5a7e228-b7c6-446d-8638-3c4e5530d6c3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:17.480918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e5a7e228-b7c6-446d-8638-3c4e5530d6c3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:17.488292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e5a7e228-b7c6-446d-8638-3c4e5530d6c3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.147531 Jul 14 09:39:17.488848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 127/244] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:17 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:18.505421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e1efef5b-c90f-4e42-b952-364d0b88df1f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:18.506022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e1efef5b-c90f-4e42-b952-364d0b88df1f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:18.513161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1efef5b-c90f-4e42-b952-364d0b88df1f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:18.513606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1efef5b-c90f-4e42-b952-364d0b88df1f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:18.514384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1efef5b-c90f-4e42-b952-364d0b88df1f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:18.514818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1efef5b-c90f-4e42-b952-364d0b88df1f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:18.638948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e1efef5b-c90f-4e42-b952-364d0b88df1f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:18.646245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e1efef5b-c90f-4e42-b952-364d0b88df1f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.144571 Jul 14 09:39:18.646808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 118/245] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:18 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:19.664071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9ca6ec27-f6c8-4db6-b856-da91e2930990 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:19.667400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9ca6ec27-f6c8-4db6-b856-da91e2930990 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:19.673174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=70 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:19.675017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9ca6ec27-f6c8-4db6-b856-da91e2930990 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:19.675542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9ca6ec27-f6c8-4db6-b856-da91e2930990 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:19.676326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9ca6ec27-f6c8-4db6-b856-da91e2930990 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:19.676760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9ca6ec27-f6c8-4db6-b856-da91e2930990 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:19.820171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9ca6ec27-f6c8-4db6-b856-da91e2930990 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:19.827829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9ca6ec27-f6c8-4db6-b856-da91e2930990 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.167952 Jul 14 09:39:19.828386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 128/246] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:19 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:20.844931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7d25a786-a38c-4e48-bcb0-91b0bc4ad2d6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:20.845605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7d25a786-a38c-4e48-bcb0-91b0bc4ad2d6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:20.853005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d25a786-a38c-4e48-bcb0-91b0bc4ad2d6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:20.853450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d25a786-a38c-4e48-bcb0-91b0bc4ad2d6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:20.854232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d25a786-a38c-4e48-bcb0-91b0bc4ad2d6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:20.854665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d25a786-a38c-4e48-bcb0-91b0bc4ad2d6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:20.986607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7d25a786-a38c-4e48-bcb0-91b0bc4ad2d6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:20.994600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7d25a786-a38c-4e48-bcb0-91b0bc4ad2d6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.153569 Jul 14 09:39:21.000127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 119/247] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:20 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:21.644943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c5170aaf-5e73-4717-b34c-88722e141eec tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:21.645444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c5170aaf-5e73-4717-b34c-88722e141eec tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:21.651964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5170aaf-5e73-4717-b34c-88722e141eec tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:21.652408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5170aaf-5e73-4717-b34c-88722e141eec tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:21.653167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5170aaf-5e73-4717-b34c-88722e141eec tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:21.653603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5170aaf-5e73-4717-b34c-88722e141eec tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:21.678260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c5170aaf-5e73-4717-b34c-88722e141eec tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:39:21.777540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c5170aaf-5e73-4717-b34c-88722e141eec tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 204 len: 0 microversion: 2.1 time: 0.135994 Jul 14 09:39:21.778146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 129/248] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:39:21 2022] DELETE /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:39:21.786785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e28148ed-11e3-4522-afa4-e334229a976d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:21.787320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e28148ed-11e3-4522-afa4-e334229a976d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:21.793993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e28148ed-11e3-4522-afa4-e334229a976d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:21.794463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e28148ed-11e3-4522-afa4-e334229a976d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:21.795215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e28148ed-11e3-4522-afa4-e334229a976d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:21.795647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e28148ed-11e3-4522-afa4-e334229a976d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:21.931193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e28148ed-11e3-4522-afa4-e334229a976d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:21.940217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e28148ed-11e3-4522-afa4-e334229a976d tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1555 microversion: 2.1 time: 0.157305 Jul 14 09:39:21.940993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 120/249] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:21 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:22.013447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6823b3e4-80d6-48b3-b7a3-13518c7dbfe8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:22.014144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6823b3e4-80d6-48b3-b7a3-13518c7dbfe8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:22.020576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6823b3e4-80d6-48b3-b7a3-13518c7dbfe8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:22.021252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6823b3e4-80d6-48b3-b7a3-13518c7dbfe8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:22.022161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6823b3e4-80d6-48b3-b7a3-13518c7dbfe8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:22.022621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6823b3e4-80d6-48b3-b7a3-13518c7dbfe8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:22.396331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6823b3e4-80d6-48b3-b7a3-13518c7dbfe8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:22.406312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6823b3e4-80d6-48b3-b7a3-13518c7dbfe8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.397171 Jul 14 09:39:22.406905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 130/250] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:22 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:22.956498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ece90c42-09ac-4750-9a73-e8c29475e7ad tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:22.958120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ece90c42-09ac-4750-9a73-e8c29475e7ad tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:22.960553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=54 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:22.967041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ece90c42-09ac-4750-9a73-e8c29475e7ad tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:22.967477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ece90c42-09ac-4750-9a73-e8c29475e7ad tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:22.968233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ece90c42-09ac-4750-9a73-e8c29475e7ad tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:22.968654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ece90c42-09ac-4750-9a73-e8c29475e7ad tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:23.099127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ece90c42-09ac-4750-9a73-e8c29475e7ad tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:23.106894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ece90c42-09ac-4750-9a73-e8c29475e7ad tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1555 microversion: 2.1 time: 0.154130 Jul 14 09:39:23.107460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 121/251] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:22 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:23.429624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4b81c362-eeed-410f-b7b7-68da54f51abd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:23.430464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4b81c362-eeed-410f-b7b7-68da54f51abd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:23.437435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b81c362-eeed-410f-b7b7-68da54f51abd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:23.437955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b81c362-eeed-410f-b7b7-68da54f51abd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:23.438910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b81c362-eeed-410f-b7b7-68da54f51abd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:23.439339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b81c362-eeed-410f-b7b7-68da54f51abd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:23.641785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4b81c362-eeed-410f-b7b7-68da54f51abd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:23.645284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:23.649858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4b81c362-eeed-410f-b7b7-68da54f51abd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.225220 Jul 14 09:39:23.650476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 131/252] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:23 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:24.124389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4b281253-efcb-4098-a890-f277196f3acc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:24.125817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4b281253-efcb-4098-a890-f277196f3acc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:24.136304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b281253-efcb-4098-a890-f277196f3acc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:24.137123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b281253-efcb-4098-a890-f277196f3acc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:24.138068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b281253-efcb-4098-a890-f277196f3acc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:24.138798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b281253-efcb-4098-a890-f277196f3acc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:24.383074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4b281253-efcb-4098-a890-f277196f3acc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:24.392589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4b281253-efcb-4098-a890-f277196f3acc tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1555 microversion: 2.1 time: 0.273058 Jul 14 09:39:24.393258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 122/253] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:24 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:24.669092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-351c5e96-0908-4bbe-ba71-1c2c6c11cf8b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:24.670490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-351c5e96-0908-4bbe-ba71-1c2c6c11cf8b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:24.680135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-351c5e96-0908-4bbe-ba71-1c2c6c11cf8b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:24.680908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-351c5e96-0908-4bbe-ba71-1c2c6c11cf8b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:24.681968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-351c5e96-0908-4bbe-ba71-1c2c6c11cf8b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:24.690790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-351c5e96-0908-4bbe-ba71-1c2c6c11cf8b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:24.944005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-351c5e96-0908-4bbe-ba71-1c2c6c11cf8b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:24.952164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-351c5e96-0908-4bbe-ba71-1c2c6c11cf8b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.289252 Jul 14 09:39:24.952748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 132/254] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:24 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:25.410332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b7ec8811-f0d1-40c1-a51e-b85a83bcc0c6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:25.411049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b7ec8811-f0d1-40c1-a51e-b85a83bcc0c6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:25.418337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7ec8811-f0d1-40c1-a51e-b85a83bcc0c6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:25.418857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7ec8811-f0d1-40c1-a51e-b85a83bcc0c6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:25.419705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7ec8811-f0d1-40c1-a51e-b85a83bcc0c6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:25.420207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7ec8811-f0d1-40c1-a51e-b85a83bcc0c6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:25.636701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b7ec8811-f0d1-40c1-a51e-b85a83bcc0c6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:25.654749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b7ec8811-f0d1-40c1-a51e-b85a83bcc0c6 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1555 microversion: 2.1 time: 0.247730 Jul 14 09:39:25.662375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 123/255] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:25 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:25.969887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7ee8dcc4-8b19-4e64-9a04-020dddbf41eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:25.970664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7ee8dcc4-8b19-4e64-9a04-020dddbf41eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:25.984844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcc4-8b19-4e64-9a04-020dddbf41eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:25.985308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcc4-8b19-4e64-9a04-020dddbf41eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:25.986119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcc4-8b19-4e64-9a04-020dddbf41eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:25.986668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcc4-8b19-4e64-9a04-020dddbf41eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:26.588297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7ee8dcc4-8b19-4e64-9a04-020dddbf41eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:26.597603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7ee8dcc4-8b19-4e64-9a04-020dddbf41eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.631908 Jul 14 09:39:26.607768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 133/256] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:25 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:26.680097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-69370dd5-e29d-4402-8733-cec45d4fccb2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:26.681861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-69370dd5-e29d-4402-8733-cec45d4fccb2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:26.692245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69370dd5-e29d-4402-8733-cec45d4fccb2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:26.692970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69370dd5-e29d-4402-8733-cec45d4fccb2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:26.695262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69370dd5-e29d-4402-8733-cec45d4fccb2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:26.695918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69370dd5-e29d-4402-8733-cec45d4fccb2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:27.029535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-6faccb9d-a74e-42c5-a6e0-36f693f10445 req-d2920fca-f4d5-404e-94e9-98daad527731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15537672-68be-4fae-8588-b9f6a56f9a88", "name": "network-vif-deleted", "tag": "79654163-e203-4648-9bf6-ad925378a698"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:27.046334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-6faccb9d-a74e-42c5-a6e0-36f693f10445 req-d2920fca-f4d5-404e-94e9-98daad527731 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:27.047461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-6faccb9d-a74e-42c5-a6e0-36f693f10445 req-d2920fca-f4d5-404e-94e9-98daad527731 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:27.061234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-6faccb9d-a74e-42c5-a6e0-36f693f10445 req-d2920fca-f4d5-404e-94e9-98daad527731 service nova] Creating event network-vif-deleted:79654163-e203-4648-9bf6-ad925378a698 for instance 15537672-68be-4fae-8588-b9f6a56f9a88 on hv-cinder-82549 Jul 14 09:39:27.071893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-6faccb9d-a74e-42c5-a6e0-36f693f10445 req-d2920fca-f4d5-404e-94e9-98daad527731 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047117 Jul 14 09:39:27.073611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 134/257] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:27.087929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-69370dd5-e29d-4402-8733-cec45d4fccb2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:27.097700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-69370dd5-e29d-4402-8733-cec45d4fccb2 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1555 microversion: 2.1 time: 0.427307 Jul 14 09:39:27.102775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 124/258] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:26 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1555 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:27.614958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9bb5eaa7-3821-493f-ac5c-e0f98e83871a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:27.615685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9bb5eaa7-3821-493f-ac5c-e0f98e83871a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:27.625708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9bb5eaa7-3821-493f-ac5c-e0f98e83871a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:27.627898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9bb5eaa7-3821-493f-ac5c-e0f98e83871a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:27.628794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9bb5eaa7-3821-493f-ac5c-e0f98e83871a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:27.631583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9bb5eaa7-3821-493f-ac5c-e0f98e83871a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:27.945564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9bb5eaa7-3821-493f-ac5c-e0f98e83871a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:27.953150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9bb5eaa7-3821-493f-ac5c-e0f98e83871a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.342628 Jul 14 09:39:27.953717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 135/259] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:27 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:28.114696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:28.115332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:28.122644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:28.123137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:28.123907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:28.124334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:28.129173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:28.175889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:28.176641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:28.177239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lazy-loading 'fault' on Instance uuid 15537672-68be-4fae-8588-b9f6a56f9a88 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:39:28.369592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b6ae4ed064a44c882b44b07d5595665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ed99374b3b42b3b4cc3d68b2a67ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:28.381721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6ef238e2-2559-4299-90fd-a874a61e0861 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 200 len: 1351 microversion: 2.1 time: 0.270671 Jul 14 09:39:28.385295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 125/260] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:28 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:28.972623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cde1f325-17b1-4f7c-b5da-ce582a7a3778 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:28.974263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cde1f325-17b1-4f7c-b5da-ce582a7a3778 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:28.981771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cde1f325-17b1-4f7c-b5da-ce582a7a3778 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:28.982384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cde1f325-17b1-4f7c-b5da-ce582a7a3778 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:28.983289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cde1f325-17b1-4f7c-b5da-ce582a7a3778 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:28.983727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cde1f325-17b1-4f7c-b5da-ce582a7a3778 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:29.138824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cde1f325-17b1-4f7c-b5da-ce582a7a3778 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:29.153903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cde1f325-17b1-4f7c-b5da-ce582a7a3778 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.186906 Jul 14 09:39:29.154521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 136/261] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:28 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:29.399435 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:29.401850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:29.414979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:29.416959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:29.418056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:29.419444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:29.439765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] HTTP exception thrown: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Request method failure captured: Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 HTTP/1.1 Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P10UTl2dhhh6VSk1WYslr7WYI0OF8ShVhFhM96sgMj57VsD1IGDt-ZcIzrvtHSDQ-N_0uoVnhNKoASzkdKOOWTK8tIpC2A31chVTTman_6mVUkp21VRx_94ESHEDUaZSsifzn-Dg8k7k1eC5xMpH8X6SV5SjkBSBpK4AxEhD4wJ6w Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 84ed99374b3b42b3b4cc3d68b2a67ed5 Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:39:29.449884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 84ed99374b3b42b3b4cc3d68b2a67ed5 Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-DeleteServersTestJSON-1497348395-project Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 9b6ae4ed064a44c882b44b07d5595665 Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-DeleteServersTestJSON-1497348395-project Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.451352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '15537672-68be-4fae-8588-b9f6a56f9a88'} Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:39:29.452036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.453178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.455331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Returning 404 to user: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:39:29.456506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cbcbd8ee-0eb9-4df5-94da-548fbde8c865 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 404 len: 111 microversion: 2.1 time: 0.061042 Jul 14 09:39:29.458313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 126/262] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:29 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:39:29.617158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:29.618114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:29.624034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:29.624472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:29.625223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:29.625744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:29.638948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] HTTP exception thrown: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Request method failure captured: Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88/os-volume_attachments HTTP/1.1 Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P10UTl2dhhh6VSk1WYslr7WYI0OF8ShVhFhM96sgMj57VsD1IGDt-ZcIzrvtHSDQ-N_0uoVnhNKoASzkdKOOWTK8tIpC2A31chVTTman_6mVUkp21VRx_94ESHEDUaZSsifzn-Dg8k7k1eC5xMpH8X6SV5SjkBSBpK4AxEhD4wJ6w Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 84ed99374b3b42b3b4cc3d68b2a67ed5 Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:39:29.643002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 84ed99374b3b42b3b4cc3d68b2a67ed5 Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-DeleteServersTestJSON-1497348395-project Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 9b6ae4ed064a44c882b44b07d5595665 Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-DeleteServersTestJSON-1497348395-project Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.644228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '15537672-68be-4fae-8588-b9f6a56f9a88'} Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:39:29.644958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:29.646131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:29.647262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Returning 404 to user: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:39:29.647262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4eff9ea2-a805-416e-85bc-3ccefff5ee20 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031220 Jul 14 09:39:29.647262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 137/263] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:39:29 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:39:30.172869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-74e16e74-a3a2-4fca-9e6d-4c4846153d52 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:30.174424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-74e16e74-a3a2-4fca-9e6d-4c4846153d52 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:30.184914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-74e16e74-a3a2-4fca-9e6d-4c4846153d52 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:30.186000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-74e16e74-a3a2-4fca-9e6d-4c4846153d52 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:30.186989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-74e16e74-a3a2-4fca-9e6d-4c4846153d52 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:30.187638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-74e16e74-a3a2-4fca-9e6d-4c4846153d52 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:30.383642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-74e16e74-a3a2-4fca-9e6d-4c4846153d52 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:30.394568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-74e16e74-a3a2-4fca-9e6d-4c4846153d52 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.227082 Jul 14 09:39:30.395900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 127/264] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:30 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:31.413092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e284ed8a-5979-4eda-822e-71cf78aecbab tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:31.414476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e284ed8a-5979-4eda-822e-71cf78aecbab tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:31.421781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e284ed8a-5979-4eda-822e-71cf78aecbab tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:31.422431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e284ed8a-5979-4eda-822e-71cf78aecbab tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:31.423541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e284ed8a-5979-4eda-822e-71cf78aecbab tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:31.424120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e284ed8a-5979-4eda-822e-71cf78aecbab tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:31.577237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e284ed8a-5979-4eda-822e-71cf78aecbab tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:31.587343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e284ed8a-5979-4eda-822e-71cf78aecbab tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.178467 Jul 14 09:39:31.588536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 138/265] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:31 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:32.605648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-805dc203-2e07-41dc-aeb4-bc372250dc4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:32.606506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-805dc203-2e07-41dc-aeb4-bc372250dc4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:32.619875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-805dc203-2e07-41dc-aeb4-bc372250dc4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:32.620496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-805dc203-2e07-41dc-aeb4-bc372250dc4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:32.626343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-805dc203-2e07-41dc-aeb4-bc372250dc4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:32.626942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-805dc203-2e07-41dc-aeb4-bc372250dc4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:33.004421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-805dc203-2e07-41dc-aeb4-bc372250dc4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:33.016018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-805dc203-2e07-41dc-aeb4-bc372250dc4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.414917 Jul 14 09:39:33.019800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 128/266] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:32 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:34.038086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-71d2bad9-f353-4335-b4da-f0edbe5cf9cf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:34.039520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-71d2bad9-f353-4335-b4da-f0edbe5cf9cf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:34.048609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-71d2bad9-f353-4335-b4da-f0edbe5cf9cf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:34.049496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-71d2bad9-f353-4335-b4da-f0edbe5cf9cf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:34.050924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-71d2bad9-f353-4335-b4da-f0edbe5cf9cf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:34.051652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-71d2bad9-f353-4335-b4da-f0edbe5cf9cf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:34.385437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-71d2bad9-f353-4335-b4da-f0edbe5cf9cf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:34.395889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-71d2bad9-f353-4335-b4da-f0edbe5cf9cf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.362375 Jul 14 09:39:34.397044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 139/267] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:34 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:35.413015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-942a7b77-f5ea-4ca1-8e2c-5a57f422cf4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:35.413619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-942a7b77-f5ea-4ca1-8e2c-5a57f422cf4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:35.420671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-942a7b77-f5ea-4ca1-8e2c-5a57f422cf4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:35.421109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-942a7b77-f5ea-4ca1-8e2c-5a57f422cf4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:35.421892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-942a7b77-f5ea-4ca1-8e2c-5a57f422cf4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:35.422345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-942a7b77-f5ea-4ca1-8e2c-5a57f422cf4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:35.569424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-942a7b77-f5ea-4ca1-8e2c-5a57f422cf4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:35.578418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-942a7b77-f5ea-4ca1-8e2c-5a57f422cf4b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.169318 Jul 14 09:39:35.579324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 129/268] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:35 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:36.278769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:36.279813 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:36.287332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:36.287782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:36.288550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:36.289153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:36.304170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] HTTP exception thrown: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Request method failure captured: Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 HTTP/1.1 Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P10UTl2dhhh6VSk1WYslr7WYI0OF8ShVhFhM96sgMj57VsD1IGDt-ZcIzrvtHSDQ-N_0uoVnhNKoASzkdKOOWTK8tIpC2A31chVTTman_6mVUkp21VRx_94ESHEDUaZSsifzn-Dg8k7k1eC5xMpH8X6SV5SjkBSBpK4AxEhD4wJ6w Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 84ed99374b3b42b3b4cc3d68b2a67ed5 Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:39:36.306940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 84ed99374b3b42b3b4cc3d68b2a67ed5 Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-DeleteServersTestJSON-1497348395-project Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 9b6ae4ed064a44c882b44b07d5595665 Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-DeleteServersTestJSON-1497348395-project Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.308430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '15537672-68be-4fae-8588-b9f6a56f9a88'} Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:39:36.309420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.310583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.312451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Returning 404 to user: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:39:36.313789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a9379d94-e8a3-4fcc-bc77-585b96140971 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "DELETE /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 404 len: 111 microversion: 2.1 time: 0.040071 Jul 14 09:39:36.323592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:36.324585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] [instance: 15537672-68be-4fae-8588-b9f6a56f9a88] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:36.329921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 140/269] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:39:36 2022] DELETE /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:39:36.332165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:36.332775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:36.334034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:36.336324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:36.364740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] HTTP exception thrown: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Request method failure captured: Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 HTTP/1.1 Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P10UTl2dhhh6VSk1WYslr7WYI0OF8ShVhFhM96sgMj57VsD1IGDt-ZcIzrvtHSDQ-N_0uoVnhNKoASzkdKOOWTK8tIpC2A31chVTTman_6mVUkp21VRx_94ESHEDUaZSsifzn-Dg8k7k1eC5xMpH8X6SV5SjkBSBpK4AxEhD4wJ6w Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 84ed99374b3b42b3b4cc3d68b2a67ed5 Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:39:36.366604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_84ed99374b3b42b3b4cc3d68b2a67ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 84ed99374b3b42b3b4cc3d68b2a67ed5 Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-DeleteServersTestJSON-1497348395 Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-DeleteServersTestJSON-1497348395-project Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 9b6ae4ed064a44c882b44b07d5595665 Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-DeleteServersTestJSON-1497348395-project Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.368011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '15537672-68be-4fae-8588-b9f6a56f9a88'} Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:39:36.368765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. Jul 14 09:39:36.370009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:39:36.372541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] Returning 404 to user: Instance 15537672-68be-4fae-8588-b9f6a56f9a88 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:39:36.373414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-43215101-8a76-4712-89b2-3e7cc18126e5 tempest-DeleteServersTestJSON-1497348395 tempest-DeleteServersTestJSON-1497348395-project] 10.222.0.40 "GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88" status: 404 len: 111 microversion: 2.1 time: 0.054615 Jul 14 09:39:36.373980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 130/270] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:36 2022] GET /compute/v2.1/servers/15537672-68be-4fae-8588-b9f6a56f9a88 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:39:36.597737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3653a292-4f97-4b31-bcee-ae51a4f5c163 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:36.598846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3653a292-4f97-4b31-bcee-ae51a4f5c163 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:36.606035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3653a292-4f97-4b31-bcee-ae51a4f5c163 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:36.606796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3653a292-4f97-4b31-bcee-ae51a4f5c163 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:36.607852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3653a292-4f97-4b31-bcee-ae51a4f5c163 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:36.608495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3653a292-4f97-4b31-bcee-ae51a4f5c163 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:36.910359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3653a292-4f97-4b31-bcee-ae51a4f5c163 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:36.918616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3653a292-4f97-4b31-bcee-ae51a4f5c163 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.325348 Jul 14 09:39:36.922635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 141/271] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:36 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:37.557945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1952530511", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "networks": [{"uuid": "4bb73866-30c3-4157-ba3d-9cf479019596"}]}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:37.664047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] validate_networks() for [('4bb73866-30c3-4157-ba3d-9cf479019596', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:39:37.939829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-25d88acd-65b2-465f-8eba-9fe7c888d2fd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:37.940310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-25d88acd-65b2-465f-8eba-9fe7c888d2fd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:37.948477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25d88acd-65b2-465f-8eba-9fe7c888d2fd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:37.949746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25d88acd-65b2-465f-8eba-9fe7c888d2fd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:37.950840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25d88acd-65b2-465f-8eba-9fe7c888d2fd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:37.951435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25d88acd-65b2-465f-8eba-9fe7c888d2fd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:38.233839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-25d88acd-65b2-465f-8eba-9fe7c888d2fd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:38.247938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-25d88acd-65b2-465f-8eba-9fe7c888d2fd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.312133 Jul 14 09:39:38.258249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 142/272] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:37 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:38.672827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:39:38.673348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:39:38.673830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:39:38.674334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:39:38.674812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:39:38.694915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:38.695728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:38.696838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:38.697575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:38.746632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Getting quotas for project 8912a4453d094df58486417ebacfa14c. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:39:38.762267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Getting quotas for user 0b818be48fe94da3b7b0c1585d1a376b and project 8912a4453d094df58486417ebacfa14c. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:39:38.794024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:39:38.796927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:39:38.910426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fde9e546-3443-48c9-a82c-7d67aff13826 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356705 Jul 14 09:39:38.912231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 131/273] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:39:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:39:38.929479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-291201c6-2e16-4b45-8dc3-55d69d5f59f8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:38.930381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-291201c6-2e16-4b45-8dc3-55d69d5f59f8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:39.067218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-291201c6-2e16-4b45-8dc3-55d69d5f59f8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:39.079118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-291201c6-2e16-4b45-8dc3-55d69d5f59f8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1214 microversion: 2.1 time: 0.159964 Jul 14 09:39:39.093163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 143/274] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:38 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:39.267539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-18f84499-a985-4fb5-97fc-dc0e5ae012f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:39.268591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-18f84499-a985-4fb5-97fc-dc0e5ae012f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:39.284152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18f84499-a985-4fb5-97fc-dc0e5ae012f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:39.285016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18f84499-a985-4fb5-97fc-dc0e5ae012f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:39.288261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18f84499-a985-4fb5-97fc-dc0e5ae012f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:39.289112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18f84499-a985-4fb5-97fc-dc0e5ae012f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:39.615594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-18f84499-a985-4fb5-97fc-dc0e5ae012f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:39.626284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-18f84499-a985-4fb5-97fc-dc0e5ae012f9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.363619 Jul 14 09:39:39.627360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 132/275] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:39 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:40.097065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9b2d8159-0230-4ac4-83fd-f219134e5004 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:40.097654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9b2d8159-0230-4ac4-83fd-f219134e5004 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:40.108448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b2d8159-0230-4ac4-83fd-f219134e5004 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:40.108901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b2d8159-0230-4ac4-83fd-f219134e5004 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:40.123834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b2d8159-0230-4ac4-83fd-f219134e5004 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:40.124294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b2d8159-0230-4ac4-83fd-f219134e5004 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:40.279098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9b2d8159-0230-4ac4-83fd-f219134e5004 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:40.292976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9b2d8159-0230-4ac4-83fd-f219134e5004 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1266 microversion: 2.1 time: 0.199591 Jul 14 09:39:40.308462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 144/276] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:40 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:40.644094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b184f56c-bd99-4207-bfae-2bd1bb4f568d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:40.644881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b184f56c-bd99-4207-bfae-2bd1bb4f568d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:40.657632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b184f56c-bd99-4207-bfae-2bd1bb4f568d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:40.658234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b184f56c-bd99-4207-bfae-2bd1bb4f568d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:40.659207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b184f56c-bd99-4207-bfae-2bd1bb4f568d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:40.659733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b184f56c-bd99-4207-bfae-2bd1bb4f568d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:41.015224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b184f56c-bd99-4207-bfae-2bd1bb4f568d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:41.024230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b184f56c-bd99-4207-bfae-2bd1bb4f568d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.383806 Jul 14 09:39:41.026253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 133/277] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:40 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:41.310495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d8ce25c0-0e26-424b-a20d-5b6992bb9998 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:41.315670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d8ce25c0-0e26-424b-a20d-5b6992bb9998 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:41.322925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8ce25c0-0e26-424b-a20d-5b6992bb9998 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:41.323842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8ce25c0-0e26-424b-a20d-5b6992bb9998 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:41.324847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8ce25c0-0e26-424b-a20d-5b6992bb9998 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:41.325487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8ce25c0-0e26-424b-a20d-5b6992bb9998 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:41.443419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d8ce25c0-0e26-424b-a20d-5b6992bb9998 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:41.453764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d8ce25c0-0e26-424b-a20d-5b6992bb9998 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1272 microversion: 2.1 time: 0.147011 Jul 14 09:39:41.454699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 145/278] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:41 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:42.046918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3671305a-7d18-435e-9476-4e4838252ee4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:42.047545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3671305a-7d18-435e-9476-4e4838252ee4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:42.084303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3671305a-7d18-435e-9476-4e4838252ee4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:42.084819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3671305a-7d18-435e-9476-4e4838252ee4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:42.089636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3671305a-7d18-435e-9476-4e4838252ee4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:42.090101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3671305a-7d18-435e-9476-4e4838252ee4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:42.472778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-055d4ba7-949e-47ea-9558-e4c9e32fcff8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:42.474371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-055d4ba7-949e-47ea-9558-e4c9e32fcff8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:42.486358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-055d4ba7-949e-47ea-9558-e4c9e32fcff8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:42.487245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-055d4ba7-949e-47ea-9558-e4c9e32fcff8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:42.489239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-055d4ba7-949e-47ea-9558-e4c9e32fcff8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:42.489830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-055d4ba7-949e-47ea-9558-e4c9e32fcff8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:42.527184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3671305a-7d18-435e-9476-4e4838252ee4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:42.555682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3671305a-7d18-435e-9476-4e4838252ee4 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.512202 Jul 14 09:39:42.559564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 134/279] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:42 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:42.763934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-055d4ba7-949e-47ea-9558-e4c9e32fcff8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:42.787125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-055d4ba7-949e-47ea-9558-e4c9e32fcff8 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.309731 Jul 14 09:39:42.788365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 146/280] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:42 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:43.464895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-7e517e86-5b20-471b-b001-1cb310d93cea req-f579138a-4e62-400a-bb86-c38c94168eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38bbdc50-c193-494d-90b8-b884ba831ddb", "tag": "4171dd98-ff0a-4f83-8f31-e403d99b7ade"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:43.479401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-7e517e86-5b20-471b-b001-1cb310d93cea req-f579138a-4e62-400a-bb86-c38c94168eb3 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:43.480367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-7e517e86-5b20-471b-b001-1cb310d93cea req-f579138a-4e62-400a-bb86-c38c94168eb3 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:43.492730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-7e517e86-5b20-471b-b001-1cb310d93cea req-f579138a-4e62-400a-bb86-c38c94168eb3 service nova] Creating event network-changed:4171dd98-ff0a-4f83-8f31-e403d99b7ade for instance 38bbdc50-c193-494d-90b8-b884ba831ddb on hv-cinder-82549 Jul 14 09:39:43.497660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-7e517e86-5b20-471b-b001-1cb310d93cea req-f579138a-4e62-400a-bb86-c38c94168eb3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037312 Jul 14 09:39:43.498988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 135/281] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:43.576340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1923b97e-e435-456b-877c-c105e043b731 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:43.577519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1923b97e-e435-456b-877c-c105e043b731 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:43.584461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1923b97e-e435-456b-877c-c105e043b731 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:43.585428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1923b97e-e435-456b-877c-c105e043b731 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:43.586470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1923b97e-e435-456b-877c-c105e043b731 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:43.587624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1923b97e-e435-456b-877c-c105e043b731 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:43.784298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1923b97e-e435-456b-877c-c105e043b731 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:43.809054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2c8573b8-c6fa-4692-90ac-7308ac1624ef tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:43.809834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2c8573b8-c6fa-4692-90ac-7308ac1624ef tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:43.811433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1923b97e-e435-456b-877c-c105e043b731 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.239015 Jul 14 09:39:43.812008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 147/282] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:43 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:43.838386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c8573b8-c6fa-4692-90ac-7308ac1624ef tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:43.838862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c8573b8-c6fa-4692-90ac-7308ac1624ef tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:43.839599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c8573b8-c6fa-4692-90ac-7308ac1624ef tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:43.840036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c8573b8-c6fa-4692-90ac-7308ac1624ef tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:44.034145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2c8573b8-c6fa-4692-90ac-7308ac1624ef tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:44.042154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2c8573b8-c6fa-4692-90ac-7308ac1624ef tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.240567 Jul 14 09:39:44.042788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 136/283] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:43 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:44.829617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-818f6d67-d132-4396-9c96-c6653c506353 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:44.830992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-818f6d67-d132-4396-9c96-c6653c506353 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:44.841772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-818f6d67-d132-4396-9c96-c6653c506353 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:44.842669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-818f6d67-d132-4396-9c96-c6653c506353 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:44.843669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-818f6d67-d132-4396-9c96-c6653c506353 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:44.844288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-818f6d67-d132-4396-9c96-c6653c506353 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:45.060365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6cac8f07-e305-4d48-b5a3-25f20d20b390 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:45.061988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6cac8f07-e305-4d48-b5a3-25f20d20b390 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:45.074331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6cac8f07-e305-4d48-b5a3-25f20d20b390 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:45.075206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6cac8f07-e305-4d48-b5a3-25f20d20b390 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:45.076241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6cac8f07-e305-4d48-b5a3-25f20d20b390 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:45.076875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6cac8f07-e305-4d48-b5a3-25f20d20b390 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:45.080335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-818f6d67-d132-4396-9c96-c6653c506353 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:45.092902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-818f6d67-d132-4396-9c96-c6653c506353 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.267566 Jul 14 09:39:45.096567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 148/284] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:44 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:45.330237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6cac8f07-e305-4d48-b5a3-25f20d20b390 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:45.344179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6cac8f07-e305-4d48-b5a3-25f20d20b390 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.287847 Jul 14 09:39:45.345227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 137/285] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:45 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:46.114132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e37f5986-1f66-4a20-82c4-7d2332917ff2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:46.114735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e37f5986-1f66-4a20-82c4-7d2332917ff2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:46.128276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e37f5986-1f66-4a20-82c4-7d2332917ff2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:46.131608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e37f5986-1f66-4a20-82c4-7d2332917ff2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:46.133245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e37f5986-1f66-4a20-82c4-7d2332917ff2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:46.136022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e37f5986-1f66-4a20-82c4-7d2332917ff2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:46.367584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a104db34-9e3d-4f00-afe4-ff7ffdaa2a07 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:46.371559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a104db34-9e3d-4f00-afe4-ff7ffdaa2a07 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:46.384828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e37f5986-1f66-4a20-82c4-7d2332917ff2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:46.396448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a104db34-9e3d-4f00-afe4-ff7ffdaa2a07 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:46.398446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e37f5986-1f66-4a20-82c4-7d2332917ff2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.290477 Jul 14 09:39:46.400258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a104db34-9e3d-4f00-afe4-ff7ffdaa2a07 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:46.402132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a104db34-9e3d-4f00-afe4-ff7ffdaa2a07 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:46.403570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a104db34-9e3d-4f00-afe4-ff7ffdaa2a07 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:46.404024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 149/286] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:46 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:46.734247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a104db34-9e3d-4f00-afe4-ff7ffdaa2a07 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:46.745768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a104db34-9e3d-4f00-afe4-ff7ffdaa2a07 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.388487 Jul 14 09:39:46.754852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 138/287] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:46 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:47.431061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cf72bc0f-96bf-440b-a351-8d495a09be30 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:47.431660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cf72bc0f-96bf-440b-a351-8d495a09be30 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:47.440760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf72bc0f-96bf-440b-a351-8d495a09be30 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:47.441531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf72bc0f-96bf-440b-a351-8d495a09be30 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:47.445926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf72bc0f-96bf-440b-a351-8d495a09be30 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:47.446535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf72bc0f-96bf-440b-a351-8d495a09be30 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:47.763321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-44ae4484-a48b-4f71-a834-3061ab475481 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:47.764174 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-44ae4484-a48b-4f71-a834-3061ab475481 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:47.775672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44ae4484-a48b-4f71-a834-3061ab475481 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:47.781187 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44ae4484-a48b-4f71-a834-3061ab475481 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:47.784019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44ae4484-a48b-4f71-a834-3061ab475481 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:47.786085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44ae4484-a48b-4f71-a834-3061ab475481 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:48.002869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cf72bc0f-96bf-440b-a351-8d495a09be30 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:48.017052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cf72bc0f-96bf-440b-a351-8d495a09be30 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.600713 Jul 14 09:39:48.018461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 150/288] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:47 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:48.039514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-44ae4484-a48b-4f71-a834-3061ab475481 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:48.050152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-44ae4484-a48b-4f71-a834-3061ab475481 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.290690 Jul 14 09:39:48.051478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 139/289] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:47 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:48.369615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-62f2a1bd-b8da-4a70-8f8d-418256dfd9b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Action: 'create', calling method: .version_select at 0x7f7da26a1430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1030520148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/qBPSA72CWHoBN6aB6tkGkHdnlSxc1JcAEws4xH4/d9a9X70sbRwJ4tyTFC+1nTWra/O5m5RSdD3cpKojMJMW4wlH0us5NJfvsVeRduRUOdgeeI7XdDCBtoPPXmtu0+g=="}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:48.390986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-62f2a1bd-b8da-4a70-8f8d-418256dfd9b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Getting quotas for project 6d48c64f286a4510a83d07bd9eb9449e. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:39:48.395408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-62f2a1bd-b8da-4a70-8f8d-418256dfd9b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Getting quotas for user 93132e89a8ed42e58754ff9009d95a2b and project 6d48c64f286a4510a83d07bd9eb9449e. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:39:48.436509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-62f2a1bd-b8da-4a70-8f8d-418256dfd9b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.071136 Jul 14 09:39:48.438338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 151/290] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 09:39:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:48.653627 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1167169836", "imageRef": "97a6065e-7f5a-4b23-8fef-971514cc6abf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1030520148", "networks": [{"uuid": "d0f497fb-1207-413e-bbea-807df09ff2f2"}]}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:48.720500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:48.749909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] validate_networks() for [('d0f497fb-1207-413e-bbea-807df09ff2f2', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:39:48.779823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=6 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:49.036035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b66e2b11-9c08-448e-9bf0-bc45505533df tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:49.036877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b66e2b11-9c08-448e-9bf0-bc45505533df tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:49.043797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b66e2b11-9c08-448e-9bf0-bc45505533df tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:49.044265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b66e2b11-9c08-448e-9bf0-bc45505533df tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:49.045058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b66e2b11-9c08-448e-9bf0-bc45505533df tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:49.045516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b66e2b11-9c08-448e-9bf0-bc45505533df tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:49.065715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:49.437560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b66e2b11-9c08-448e-9bf0-bc45505533df tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:49.449122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b66e2b11-9c08-448e-9bf0-bc45505533df tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1523 microversion: 2.1 time: 0.415279 Jul 14 09:39:49.461475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 152/291] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:49 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:49.468338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-168a84f0-2c1e-4960-bc5e-8734181f867a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:49.469013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-168a84f0-2c1e-4960-bc5e-8734181f867a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:49.475876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-168a84f0-2c1e-4960-bc5e-8734181f867a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:49.476333 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-168a84f0-2c1e-4960-bc5e-8734181f867a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:49.477107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-168a84f0-2c1e-4960-bc5e-8734181f867a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:49.478510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-168a84f0-2c1e-4960-bc5e-8734181f867a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:49.849585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:39:49.850324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:39:49.855241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-168a84f0-2c1e-4960-bc5e-8734181f867a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:49.856646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:39:49.857307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:39:49.859073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:39:49.875225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-168a84f0-2c1e-4960-bc5e-8734181f867a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.412058 Jul 14 09:39:49.879457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 153/292] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:49 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:49.880733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:49.881429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:49.882474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:49.883125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:49.907239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Getting quotas for project 6d48c64f286a4510a83d07bd9eb9449e. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:39:49.935090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Getting quotas for user 93132e89a8ed42e58754ff9009d95a2b and project 6d48c64f286a4510a83d07bd9eb9449e. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:39:49.965193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:39:49.968179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='97a6065e-7f5a-4b23-8fef-971514cc6abf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:39:50.049475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ea684d96-308a-45cb-8c26-9997520cb0cc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.399725 Jul 14 09:39:50.050448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 140/293] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:39:50.062678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7c5c8f95-ed07-485f-8772-4ebcf9af588a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:50.068982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7c5c8f95-ed07-485f-8772-4ebcf9af588a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:50.075603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:50.472173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3ed0b0fd-a431-440d-80de-88c6824b9ab1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:50.472801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3ed0b0fd-a431-440d-80de-88c6824b9ab1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:50.482905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3ed0b0fd-a431-440d-80de-88c6824b9ab1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:50.483358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3ed0b0fd-a431-440d-80de-88c6824b9ab1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:50.490401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3ed0b0fd-a431-440d-80de-88c6824b9ab1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:50.491099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3ed0b0fd-a431-440d-80de-88c6824b9ab1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:50.604591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7c5c8f95-ed07-485f-8772-4ebcf9af588a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:50.613694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7c5c8f95-ed07-485f-8772-4ebcf9af588a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1259 microversion: 2.1 time: 0.556507 Jul 14 09:39:50.625617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 154/294] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1259 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:50.799942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3ed0b0fd-a431-440d-80de-88c6824b9ab1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:50.808372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3ed0b0fd-a431-440d-80de-88c6824b9ab1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1503 microversion: 2.1 time: 0.344724 Jul 14 09:39:50.809501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 141/295] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:50 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1503 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:50.828621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c1e30bc2-ff34-4176-b6d8-0f05610c856d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:50.830000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c1e30bc2-ff34-4176-b6d8-0f05610c856d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:50.843103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1e30bc2-ff34-4176-b6d8-0f05610c856d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:50.843898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1e30bc2-ff34-4176-b6d8-0f05610c856d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:50.845641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1e30bc2-ff34-4176-b6d8-0f05610c856d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:50.846475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1e30bc2-ff34-4176-b6d8-0f05610c856d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:50.895426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3f867187-21a6-403c-a5dd-068280336835 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:50.896027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3f867187-21a6-403c-a5dd-068280336835 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:50.906907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3f867187-21a6-403c-a5dd-068280336835 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:50.907354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3f867187-21a6-403c-a5dd-068280336835 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:50.908119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3f867187-21a6-403c-a5dd-068280336835 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:50.908583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3f867187-21a6-403c-a5dd-068280336835 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:51.299474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c1e30bc2-ff34-4176-b6d8-0f05610c856d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:51.307607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c1e30bc2-ff34-4176-b6d8-0f05610c856d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1516 microversion: 2.1 time: 0.484720 Jul 14 09:39:51.308258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 155/296] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:50 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1516 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:51.394531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3f867187-21a6-403c-a5dd-068280336835 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:51.403437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3f867187-21a6-403c-a5dd-068280336835 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.511843 Jul 14 09:39:51.404007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 142/297] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:50 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:51.639579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b5c0bf1e-841f-495f-8581-c8b74ada5bb7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:51.641122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b5c0bf1e-841f-495f-8581-c8b74ada5bb7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:51.664585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5c0bf1e-841f-495f-8581-c8b74ada5bb7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:51.666700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5c0bf1e-841f-495f-8581-c8b74ada5bb7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:51.669305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5c0bf1e-841f-495f-8581-c8b74ada5bb7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:51.674102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5c0bf1e-841f-495f-8581-c8b74ada5bb7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:51.885890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b5c0bf1e-841f-495f-8581-c8b74ada5bb7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:51.903199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b5c0bf1e-841f-495f-8581-c8b74ada5bb7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1319 microversion: 2.1 time: 0.273187 Jul 14 09:39:51.914305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 156/298] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:52.424413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1fc1f371-8b18-482c-b165-a10686777f22 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:52.425136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1fc1f371-8b18-482c-b165-a10686777f22 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:52.448230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1fc1f371-8b18-482c-b165-a10686777f22 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:52.449167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1fc1f371-8b18-482c-b165-a10686777f22 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:52.451411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1fc1f371-8b18-482c-b165-a10686777f22 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:52.452181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1fc1f371-8b18-482c-b165-a10686777f22 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:52.590411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-99060e99-cc06-4988-a263-b28c2ad24295 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: .version_select at 0x7f7da1e81160>, body: {"keypair": {"name": "tempest-keypair-1877304209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1kuVh+ahEuuxPltbEHDH9r9NjtWvqPrrI5w91SJkKmTtEiPgemZ07NEEPwIweG1ZahlSDhIU+gmqXikpZDPlTSfIXC9AXSkyNWbKMqWUVx5/KsP76aF6MEwfoY9tJSfw=="}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:52.608506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-99060e99-cc06-4988-a263-b28c2ad24295 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:39:52.613657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-99060e99-cc06-4988-a263-b28c2ad24295 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for user 1d7ae3d2f56a491baf26a83a34d86ccf and project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:39:52.641727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-99060e99-cc06-4988-a263-b28c2ad24295 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.244000 Jul 14 09:39:52.643298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 143/299] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 09:39:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:52.684454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1fc1f371-8b18-482c-b165-a10686777f22 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:52.711099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1fc1f371-8b18-482c-b165-a10686777f22 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.290698 Jul 14 09:39:52.712320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 157/300] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:52 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:52.768800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e79825ca-8d26-47e2-84dd-c3836d6619fb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:52.770287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e79825ca-8d26-47e2-84dd-c3836d6619fb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:52.780852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e79825ca-8d26-47e2-84dd-c3836d6619fb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:52.781443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e79825ca-8d26-47e2-84dd-c3836d6619fb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:52.782496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e79825ca-8d26-47e2-84dd-c3836d6619fb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:52.783004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e79825ca-8d26-47e2-84dd-c3836d6619fb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:52.809305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-e79825ca-8d26-47e2-84dd-c3836d6619fb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lazy-loading 'flavor' on Instance uuid 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:39:52.870921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:52.919245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-29418b68-ea71-4f60-83e2-cdfe252a6d83 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:52.920094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-29418b68-ea71-4f60-83e2-cdfe252a6d83 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:52.930351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-29418b68-ea71-4f60-83e2-cdfe252a6d83 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:52.931598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-29418b68-ea71-4f60-83e2-cdfe252a6d83 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:52.932628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-29418b68-ea71-4f60-83e2-cdfe252a6d83 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:52.933885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-29418b68-ea71-4f60-83e2-cdfe252a6d83 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:52.952588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e79825ca-8d26-47e2-84dd-c3836d6619fb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1/action" status: 200 len: 32 microversion: 2.1 time: 0.190685 Jul 14 09:39:52.959413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 144/301] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:39:52 2022] POST /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 09:39:52.974465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1f377d4d-18a1-484d-880c-c02cf41d6c3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:52.974465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1f377d4d-18a1-484d-880c-c02cf41d6c3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:52.988608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:39:52.996557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1f377d4d-18a1-484d-880c-c02cf41d6c3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:52.997249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1f377d4d-18a1-484d-880c-c02cf41d6c3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:52.998221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1f377d4d-18a1-484d-880c-c02cf41d6c3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:52.998642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1f377d4d-18a1-484d-880c-c02cf41d6c3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:53.257666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-29418b68-ea71-4f60-83e2-cdfe252a6d83 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:53.263234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1f377d4d-18a1-484d-880c-c02cf41d6c3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:53.277636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1f377d4d-18a1-484d-880c-c02cf41d6c3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.315791 Jul 14 09:39:53.280362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-29418b68-ea71-4f60-83e2-cdfe252a6d83 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.364751 Jul 14 09:39:53.281677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 158/302] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:53.290116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 145/303] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:52 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:53.729914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-96361696-c908-4503-ae40-4dd4187d1c9a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:53.730594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-96361696-c908-4503-ae40-4dd4187d1c9a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:53.740126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-96361696-c908-4503-ae40-4dd4187d1c9a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:53.740496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-96361696-c908-4503-ae40-4dd4187d1c9a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:53.743952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-96361696-c908-4503-ae40-4dd4187d1c9a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:53.744587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-96361696-c908-4503-ae40-4dd4187d1c9a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:53.999430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-96361696-c908-4503-ae40-4dd4187d1c9a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:54.008052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-96361696-c908-4503-ae40-4dd4187d1c9a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.282961 Jul 14 09:39:54.008966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 159/304] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:53 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:54.297527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b9a23979-9c1e-4c38-9c8f-72e8550c8e28 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:54.298123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b9a23979-9c1e-4c38-9c8f-72e8550c8e28 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:54.299544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-61d171e3-a55f-4db6-9a37-7c17c1746d60 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:54.300383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-61d171e3-a55f-4db6-9a37-7c17c1746d60 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:54.304931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a23979-9c1e-4c38-9c8f-72e8550c8e28 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:54.305415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a23979-9c1e-4c38-9c8f-72e8550c8e28 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:54.306216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a23979-9c1e-4c38-9c8f-72e8550c8e28 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:54.306631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a23979-9c1e-4c38-9c8f-72e8550c8e28 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:54.308533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61d171e3-a55f-4db6-9a37-7c17c1746d60 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:54.309195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61d171e3-a55f-4db6-9a37-7c17c1746d60 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:54.310160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61d171e3-a55f-4db6-9a37-7c17c1746d60 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:54.310969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61d171e3-a55f-4db6-9a37-7c17c1746d60 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:54.910629 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b9a23979-9c1e-4c38-9c8f-72e8550c8e28 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:54.913645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-61d171e3-a55f-4db6-9a37-7c17c1746d60 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:54.929289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-61d171e3-a55f-4db6-9a37-7c17c1746d60 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.634401 Jul 14 09:39:54.929920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 160/305] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:54.939751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b9a23979-9c1e-4c38-9c8f-72e8550c8e28 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.646470 Jul 14 09:39:54.948256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 146/306] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:54 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:55.034208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-505e26d3-8e52-4f90-b255-f24104e8ea86 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:55.037843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-505e26d3-8e52-4f90-b255-f24104e8ea86 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:55.057411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-505e26d3-8e52-4f90-b255-f24104e8ea86 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:55.057979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-505e26d3-8e52-4f90-b255-f24104e8ea86 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:55.062879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-505e26d3-8e52-4f90-b255-f24104e8ea86 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:55.063647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-505e26d3-8e52-4f90-b255-f24104e8ea86 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:55.241148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2092133062", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9dc9a66-299f-4d37-a369-9dec401232c3"}], "security_groups": [{"name": "tempest-securitygroup--1681583831"}], "key_name": "tempest-keypair-1877304209", "user_data": "}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:55.493223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-505e26d3-8e52-4f90-b255-f24104e8ea86 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:55.504008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-505e26d3-8e52-4f90-b255-f24104e8ea86 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.482956 Jul 14 09:39:55.517534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 161/307] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:55 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:55.539356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] validate_networks() for [('b9dc9a66-299f-4d37-a369-9dec401232c3', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:39:55.947756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ec803190-82ea-4d3e-9480-dbd738ddf383 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:55.950072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ec803190-82ea-4d3e-9480-dbd738ddf383 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:55.973484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec803190-82ea-4d3e-9480-dbd738ddf383 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:55.977757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec803190-82ea-4d3e-9480-dbd738ddf383 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:55.983896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec803190-82ea-4d3e-9480-dbd738ddf383 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:55.984861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec803190-82ea-4d3e-9480-dbd738ddf383 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:56.207380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:39:56.208160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:39:56.208773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:39:56.209441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:39:56.210516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:39:56.232803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:56.234501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:56.238103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:56.239062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:56.294599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:39:56.307911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for user 1d7ae3d2f56a491baf26a83a34d86ccf and project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:39:56.341334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:39:56.344133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:39:56.467887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1ba85009-c1ea-4a70-b18a-cdea8a9f170b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.229204 Jul 14 09:39:56.475682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 147/308] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:39:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:39:56.493315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-92763624-cc31-4170-a3d6-78b65dec7336 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:56.493863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-92763624-cc31-4170-a3d6-78b65dec7336 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:56.512919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-92763624-cc31-4170-a3d6-78b65dec7336 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:56.513370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-92763624-cc31-4170-a3d6-78b65dec7336 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:56.514155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-92763624-cc31-4170-a3d6-78b65dec7336 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:56.514623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-92763624-cc31-4170-a3d6-78b65dec7336 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:56.543222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ec803190-82ea-4d3e-9480-dbd738ddf383 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:56.554644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ec803190-82ea-4d3e-9480-dbd738ddf383 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.612100 Jul 14 09:39:56.555796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 162/309] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:56.562949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c7d34fdc-c907-4a4e-aff4-1d7f7eeb47fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:56.563752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c7d34fdc-c907-4a4e-aff4-1d7f7eeb47fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:56.704164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c7d34fdc-c907-4a4e-aff4-1d7f7eeb47fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:56.712050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c7d34fdc-c907-4a4e-aff4-1d7f7eeb47fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1242 microversion: 2.1 time: 0.155034 Jul 14 09:39:56.725226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 163/310] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:56 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1242 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:56.747795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b1c397a6-47e9-4c20-b495-081a7f6141af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:56.748516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b1c397a6-47e9-4c20-b495-081a7f6141af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:56.782427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b1c397a6-47e9-4c20-b495-081a7f6141af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:56.785092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b1c397a6-47e9-4c20-b495-081a7f6141af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:56.793122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b1c397a6-47e9-4c20-b495-081a7f6141af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:56.793814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b1c397a6-47e9-4c20-b495-081a7f6141af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:56.819183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-92763624-cc31-4170-a3d6-78b65dec7336 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:56.829606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-92763624-cc31-4170-a3d6-78b65dec7336 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.351185 Jul 14 09:39:56.830891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 148/311] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:56 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:56.843463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-ce2c12f2-a064-429b-831e-f89d44d0c591 req-3d0da555-afa6-4570-a57a-929e011b618a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e62e62e-be29-409c-a568-7269db0dba2d", "tag": "f3b4a515-5f24-4041-9e95-ef29a5325536"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:56.886776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-ce2c12f2-a064-429b-831e-f89d44d0c591 req-3d0da555-afa6-4570-a57a-929e011b618a service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:56.888391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-ce2c12f2-a064-429b-831e-f89d44d0c591 req-3d0da555-afa6-4570-a57a-929e011b618a service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:56.928626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-ce2c12f2-a064-429b-831e-f89d44d0c591 req-3d0da555-afa6-4570-a57a-929e011b618a service nova] Creating event network-changed:f3b4a515-5f24-4041-9e95-ef29a5325536 for instance 9e62e62e-be29-409c-a568-7269db0dba2d on hv-cinder-82549 Jul 14 09:39:56.950178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-ce2c12f2-a064-429b-831e-f89d44d0c591 req-3d0da555-afa6-4570-a57a-929e011b618a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115340 Jul 14 09:39:56.952015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 149/312] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:39:57.247439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b1c397a6-47e9-4c20-b495-081a7f6141af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:57.257347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b1c397a6-47e9-4c20-b495-081a7f6141af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.530680 Jul 14 09:39:57.258824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 164/313] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:56 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:57.573780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bcac7ab3-4340-4fc3-aaf3-6f828c9e6ae6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:57.574505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bcac7ab3-4340-4fc3-aaf3-6f828c9e6ae6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:57.581559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcac7ab3-4340-4fc3-aaf3-6f828c9e6ae6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:57.582017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcac7ab3-4340-4fc3-aaf3-6f828c9e6ae6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:57.582813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcac7ab3-4340-4fc3-aaf3-6f828c9e6ae6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:57.583312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcac7ab3-4340-4fc3-aaf3-6f828c9e6ae6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:57.729522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-992603a2-94fe-41ac-840f-f052efeeab64 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:57.730952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-992603a2-94fe-41ac-840f-f052efeeab64 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:57.740792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bcac7ab3-4340-4fc3-aaf3-6f828c9e6ae6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:57.743044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-992603a2-94fe-41ac-840f-f052efeeab64 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:57.743698 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-992603a2-94fe-41ac-840f-f052efeeab64 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:57.744640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-992603a2-94fe-41ac-840f-f052efeeab64 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:57.745679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-992603a2-94fe-41ac-840f-f052efeeab64 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:57.753157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bcac7ab3-4340-4fc3-aaf3-6f828c9e6ae6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.183843 Jul 14 09:39:57.762584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 150/314] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:57.829911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-992603a2-94fe-41ac-840f-f052efeeab64 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:57.837693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-992603a2-94fe-41ac-840f-f052efeeab64 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.112790 Jul 14 09:39:57.838272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 165/315] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:57 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:57.846650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-374b5697-f940-443a-9012-4349482c0991 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:57.847877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-374b5697-f940-443a-9012-4349482c0991 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:57.854578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-374b5697-f940-443a-9012-4349482c0991 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:57.855028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-374b5697-f940-443a-9012-4349482c0991 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:57.855799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-374b5697-f940-443a-9012-4349482c0991 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:57.856233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-374b5697-f940-443a-9012-4349482c0991 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:57.996255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-374b5697-f940-443a-9012-4349482c0991 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:58.003976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-374b5697-f940-443a-9012-4349482c0991 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.161107 Jul 14 09:39:58.004623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 151/316] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:57 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:58.277136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5edd2f9f-d016-4dc4-ac55-4cec3a9a5521 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:58.277771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5edd2f9f-d016-4dc4-ac55-4cec3a9a5521 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:58.284167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5edd2f9f-d016-4dc4-ac55-4cec3a9a5521 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:58.284620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5edd2f9f-d016-4dc4-ac55-4cec3a9a5521 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:58.285403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5edd2f9f-d016-4dc4-ac55-4cec3a9a5521 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:58.285833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5edd2f9f-d016-4dc4-ac55-4cec3a9a5521 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:58.429065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5edd2f9f-d016-4dc4-ac55-4cec3a9a5521 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:58.438475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5edd2f9f-d016-4dc4-ac55-4cec3a9a5521 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.166515 Jul 14 09:39:58.439314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 166/317] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:58 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:58.771163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7bded7e4-c637-48db-a587-6299a1904558 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:58.771776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7bded7e4-c637-48db-a587-6299a1904558 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:58.779072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bded7e4-c637-48db-a587-6299a1904558 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:58.779439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bded7e4-c637-48db-a587-6299a1904558 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:58.780218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bded7e4-c637-48db-a587-6299a1904558 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:58.780645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bded7e4-c637-48db-a587-6299a1904558 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:58.854929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a29c2381-c0c0-43f8-87a0-b018f11a4505 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:58.855574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a29c2381-c0c0-43f8-87a0-b018f11a4505 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:58.863630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a29c2381-c0c0-43f8-87a0-b018f11a4505 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:58.864112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a29c2381-c0c0-43f8-87a0-b018f11a4505 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:58.864902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a29c2381-c0c0-43f8-87a0-b018f11a4505 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:58.865505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a29c2381-c0c0-43f8-87a0-b018f11a4505 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:58.951982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a29c2381-c0c0-43f8-87a0-b018f11a4505 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:58.968217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a29c2381-c0c0-43f8-87a0-b018f11a4505 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.117326 Jul 14 09:39:58.972251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7bded7e4-c637-48db-a587-6299a1904558 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:58.979031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 167/318] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:58 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:39:58.984492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7bded7e4-c637-48db-a587-6299a1904558 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.217198 Jul 14 09:39:58.985049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 152/319] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:59.021991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4bd3c999-9e9e-41d2-8028-ba4f2e1e16b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:59.022621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4bd3c999-9e9e-41d2-8028-ba4f2e1e16b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:59.029856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4bd3c999-9e9e-41d2-8028-ba4f2e1e16b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:59.030562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4bd3c999-9e9e-41d2-8028-ba4f2e1e16b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:59.031656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4bd3c999-9e9e-41d2-8028-ba4f2e1e16b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:59.032345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4bd3c999-9e9e-41d2-8028-ba4f2e1e16b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:59.128647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-c0ec8532-c548-42d6-8914-b05786bf9b0b req-01fcf8a5-7de2-47fc-848d-4ea96bbd152e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bbdc50-c193-494d-90b8-b884ba831ddb", "name": "network-vif-plugged", "status": "completed", "tag": "4171dd98-ff0a-4f83-8f31-e403d99b7ade"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:39:59.156002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-c0ec8532-c548-42d6-8914-b05786bf9b0b req-01fcf8a5-7de2-47fc-848d-4ea96bbd152e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:59.156446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-c0ec8532-c548-42d6-8914-b05786bf9b0b req-01fcf8a5-7de2-47fc-848d-4ea96bbd152e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:59.176177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-c0ec8532-c548-42d6-8914-b05786bf9b0b req-01fcf8a5-7de2-47fc-848d-4ea96bbd152e service nova] Creating event network-vif-plugged:4171dd98-ff0a-4f83-8f31-e403d99b7ade for instance 38bbdc50-c193-494d-90b8-b884ba831ddb on hv-cinder-82549 Jul 14 09:39:59.181933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-c0ec8532-c548-42d6-8914-b05786bf9b0b req-01fcf8a5-7de2-47fc-848d-4ea96bbd152e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056934 Jul 14 09:39:59.183136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 153/320] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:39:59.219399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4bd3c999-9e9e-41d2-8028-ba4f2e1e16b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:59.229182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4bd3c999-9e9e-41d2-8028-ba4f2e1e16b5 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.211441 Jul 14 09:39:59.229850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 168/321] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:59 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:59.455772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-130154ad-6199-4d6a-adec-62ec2fd6b17b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:59.456450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-130154ad-6199-4d6a-adec-62ec2fd6b17b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:59.462966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-130154ad-6199-4d6a-adec-62ec2fd6b17b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:59.463415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-130154ad-6199-4d6a-adec-62ec2fd6b17b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:59.464172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-130154ad-6199-4d6a-adec-62ec2fd6b17b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:59.464597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-130154ad-6199-4d6a-adec-62ec2fd6b17b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:59.603191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-130154ad-6199-4d6a-adec-62ec2fd6b17b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:39:59.611901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-130154ad-6199-4d6a-adec-62ec2fd6b17b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.160048 Jul 14 09:39:59.612618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 154/322] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:59 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:39:59.984802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-faab398c-7933-4b26-a8e1-fbc0603aa7bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:39:59.985344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-faab398c-7933-4b26-a8e1-fbc0603aa7bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:39:59.992178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-faab398c-7933-4b26-a8e1-fbc0603aa7bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:59.992890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-faab398c-7933-4b26-a8e1-fbc0603aa7bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:39:59.994105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-faab398c-7933-4b26-a8e1-fbc0603aa7bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:39:59.995141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-faab398c-7933-4b26-a8e1-fbc0603aa7bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:00.004969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e247cb6f-cbda-4e89-8e9d-6d8e73f2dc4a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:00.007012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e247cb6f-cbda-4e89-8e9d-6d8e73f2dc4a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:00.015311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e247cb6f-cbda-4e89-8e9d-6d8e73f2dc4a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:00.015881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e247cb6f-cbda-4e89-8e9d-6d8e73f2dc4a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:00.017265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e247cb6f-cbda-4e89-8e9d-6d8e73f2dc4a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:00.017935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e247cb6f-cbda-4e89-8e9d-6d8e73f2dc4a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:00.075058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-faab398c-7933-4b26-a8e1-fbc0603aa7bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:00.085774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-faab398c-7933-4b26-a8e1-fbc0603aa7bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.104720 Jul 14 09:40:00.095839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 169/323] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:59 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:00.228766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e247cb6f-cbda-4e89-8e9d-6d8e73f2dc4a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:00.238527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e247cb6f-cbda-4e89-8e9d-6d8e73f2dc4a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.238032 Jul 14 09:40:00.249313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 155/324] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:39:59 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:00.252920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-27388867-198f-474a-b66e-dbba230d602d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:00.253691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-27388867-198f-474a-b66e-dbba230d602d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:00.266836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27388867-198f-474a-b66e-dbba230d602d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:00.267299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27388867-198f-474a-b66e-dbba230d602d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:00.268127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27388867-198f-474a-b66e-dbba230d602d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:00.268594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27388867-198f-474a-b66e-dbba230d602d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:00.589366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-27388867-198f-474a-b66e-dbba230d602d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:00.598507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-27388867-198f-474a-b66e-dbba230d602d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.356239 Jul 14 09:40:00.599304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 170/325] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:00 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:00.629823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21099a1b-3746-416c-94e1-2ac630e466af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:00.630451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-21099a1b-3746-416c-94e1-2ac630e466af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:00.637578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21099a1b-3746-416c-94e1-2ac630e466af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:00.638260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21099a1b-3746-416c-94e1-2ac630e466af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:00.639318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21099a1b-3746-416c-94e1-2ac630e466af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:00.639899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21099a1b-3746-416c-94e1-2ac630e466af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:00.789682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21099a1b-3746-416c-94e1-2ac630e466af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:00.797538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-21099a1b-3746-416c-94e1-2ac630e466af tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.171689 Jul 14 09:40:00.798103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 156/326] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:00 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:01.105249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d6dc0bd6-ffcd-41e8-9776-ebf25f58b580 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:01.105862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d6dc0bd6-ffcd-41e8-9776-ebf25f58b580 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:01.112107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6dc0bd6-ffcd-41e8-9776-ebf25f58b580 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:01.112642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6dc0bd6-ffcd-41e8-9776-ebf25f58b580 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:01.113419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6dc0bd6-ffcd-41e8-9776-ebf25f58b580 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:01.113853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6dc0bd6-ffcd-41e8-9776-ebf25f58b580 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:01.118695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:01.177485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d6dc0bd6-ffcd-41e8-9776-ebf25f58b580 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:01.185920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d6dc0bd6-ffcd-41e8-9776-ebf25f58b580 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.086637 Jul 14 09:40:01.186507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 171/327] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:01 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:01.256842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-064ce27d-1b85-45c7-9b44-16bed3e1e70a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:01.257798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-064ce27d-1b85-45c7-9b44-16bed3e1e70a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:01.265320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-064ce27d-1b85-45c7-9b44-16bed3e1e70a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:01.266032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-064ce27d-1b85-45c7-9b44-16bed3e1e70a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:01.266892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-064ce27d-1b85-45c7-9b44-16bed3e1e70a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:01.267525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-064ce27d-1b85-45c7-9b44-16bed3e1e70a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:01.428587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-064ce27d-1b85-45c7-9b44-16bed3e1e70a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:01.436880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-064ce27d-1b85-45c7-9b44-16bed3e1e70a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.184403 Jul 14 09:40:01.448460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 157/328] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:01.623590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8ba12d3d-ac6e-4e55-8efc-80f8ce409f88 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:01.624195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8ba12d3d-ac6e-4e55-8efc-80f8ce409f88 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:01.636844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ba12d3d-ac6e-4e55-8efc-80f8ce409f88 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:01.637192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ba12d3d-ac6e-4e55-8efc-80f8ce409f88 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:01.637986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ba12d3d-ac6e-4e55-8efc-80f8ce409f88 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:01.638487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ba12d3d-ac6e-4e55-8efc-80f8ce409f88 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:01.815530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8ba12d3d-ac6e-4e55-8efc-80f8ce409f88 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:01.817949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ea1ce603-4789-4f54-82ff-efa58c580877 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:01.818601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ea1ce603-4789-4f54-82ff-efa58c580877 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:01.825511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8ba12d3d-ac6e-4e55-8efc-80f8ce409f88 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.209279 Jul 14 09:40:01.825777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ea1ce603-4789-4f54-82ff-efa58c580877 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:01.826225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 172/329] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:01 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:01.826357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ea1ce603-4789-4f54-82ff-efa58c580877 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:01.827486 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ea1ce603-4789-4f54-82ff-efa58c580877 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:01.828194 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ea1ce603-4789-4f54-82ff-efa58c580877 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:01.965154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ea1ce603-4789-4f54-82ff-efa58c580877 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:01.972808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ea1ce603-4789-4f54-82ff-efa58c580877 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.160215 Jul 14 09:40:01.973374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 158/330] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:01 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:02.202590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ae2066c5-f4f4-4f80-88ac-89703557c636 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:02.203746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ae2066c5-f4f4-4f80-88ac-89703557c636 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:02.210635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ae2066c5-f4f4-4f80-88ac-89703557c636 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:02.211323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ae2066c5-f4f4-4f80-88ac-89703557c636 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:02.212141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ae2066c5-f4f4-4f80-88ac-89703557c636 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:02.212585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ae2066c5-f4f4-4f80-88ac-89703557c636 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:02.281064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ae2066c5-f4f4-4f80-88ac-89703557c636 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:02.301267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ae2066c5-f4f4-4f80-88ac-89703557c636 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.102546 Jul 14 09:40:02.303766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 173/331] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:02 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:02.455198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f2b5668e-f558-4745-be46-1f0d60c98127 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:02.455849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f2b5668e-f558-4745-be46-1f0d60c98127 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:02.462940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f2b5668e-f558-4745-be46-1f0d60c98127 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:02.463386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f2b5668e-f558-4745-be46-1f0d60c98127 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:02.464155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f2b5668e-f558-4745-be46-1f0d60c98127 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:02.464591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f2b5668e-f558-4745-be46-1f0d60c98127 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:02.603269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f2b5668e-f558-4745-be46-1f0d60c98127 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:02.615837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f2b5668e-f558-4745-be46-1f0d60c98127 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.164225 Jul 14 09:40:02.616806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 159/332] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:02 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:02.843088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7789086d-3e56-4361-80a6-3dfa60283acd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:02.843695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7789086d-3e56-4361-80a6-3dfa60283acd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:02.849686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7789086d-3e56-4361-80a6-3dfa60283acd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:02.850137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7789086d-3e56-4361-80a6-3dfa60283acd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:02.850980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7789086d-3e56-4361-80a6-3dfa60283acd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:02.851983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7789086d-3e56-4361-80a6-3dfa60283acd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:02.988402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7789086d-3e56-4361-80a6-3dfa60283acd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:02.989340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-836d32ef-5f2b-42bf-9b1c-3e0bc65a8979 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:02.990011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-836d32ef-5f2b-42bf-9b1c-3e0bc65a8979 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:02.996985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7789086d-3e56-4361-80a6-3dfa60283acd tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.157674 Jul 14 09:40:03.004837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 174/333] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:02 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:03.005005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-836d32ef-5f2b-42bf-9b1c-3e0bc65a8979 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:03.005005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-836d32ef-5f2b-42bf-9b1c-3e0bc65a8979 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:03.005005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-836d32ef-5f2b-42bf-9b1c-3e0bc65a8979 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:03.005005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-836d32ef-5f2b-42bf-9b1c-3e0bc65a8979 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:03.150427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-836d32ef-5f2b-42bf-9b1c-3e0bc65a8979 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:03.159168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-836d32ef-5f2b-42bf-9b1c-3e0bc65a8979 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.173230 Jul 14 09:40:03.159974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 160/334] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:02 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:03.319554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-52e47bf0-b7ed-4476-9849-6da946802e20 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:03.320707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-52e47bf0-b7ed-4476-9849-6da946802e20 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:03.326852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52e47bf0-b7ed-4476-9849-6da946802e20 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:03.327304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52e47bf0-b7ed-4476-9849-6da946802e20 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:03.328083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52e47bf0-b7ed-4476-9849-6da946802e20 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:03.328521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52e47bf0-b7ed-4476-9849-6da946802e20 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:03.391094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-52e47bf0-b7ed-4476-9849-6da946802e20 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:03.400111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-52e47bf0-b7ed-4476-9849-6da946802e20 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.084419 Jul 14 09:40:03.400689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 175/335] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:03 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:03.633516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a3011f9f-ae0f-4f59-a7b9-24ae8307621c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:03.634082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a3011f9f-ae0f-4f59-a7b9-24ae8307621c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:03.641383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3011f9f-ae0f-4f59-a7b9-24ae8307621c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:03.641864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3011f9f-ae0f-4f59-a7b9-24ae8307621c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:03.642757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3011f9f-ae0f-4f59-a7b9-24ae8307621c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:03.643221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3011f9f-ae0f-4f59-a7b9-24ae8307621c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:03.802580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3011f9f-ae0f-4f59-a7b9-24ae8307621c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:03.810814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a3011f9f-ae0f-4f59-a7b9-24ae8307621c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.181798 Jul 14 09:40:03.820727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 161/336] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:03 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:04.016003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8e415b42-7c4b-4020-a800-782e7444744a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:04.016969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8e415b42-7c4b-4020-a800-782e7444744a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:04.023978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e415b42-7c4b-4020-a800-782e7444744a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:04.024427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e415b42-7c4b-4020-a800-782e7444744a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:04.025189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e415b42-7c4b-4020-a800-782e7444744a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:04.025617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e415b42-7c4b-4020-a800-782e7444744a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:04.176934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e9b2605f-dd1f-4260-8471-43b747d1d583 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:04.177824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e9b2605f-dd1f-4260-8471-43b747d1d583 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:04.181083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8e415b42-7c4b-4020-a800-782e7444744a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:04.184682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9b2605f-dd1f-4260-8471-43b747d1d583 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:04.185193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9b2605f-dd1f-4260-8471-43b747d1d583 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:04.186021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9b2605f-dd1f-4260-8471-43b747d1d583 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:04.186583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9b2605f-dd1f-4260-8471-43b747d1d583 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:04.189536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8e415b42-7c4b-4020-a800-782e7444744a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.178753 Jul 14 09:40:04.190558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 176/337] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:04 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:04.206237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:04.327141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e9b2605f-dd1f-4260-8471-43b747d1d583 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:04.335171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e9b2605f-dd1f-4260-8471-43b747d1d583 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.162770 Jul 14 09:40:04.335768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 162/338] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:04 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:04.416750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ee674c3d-0b26-4535-9bfc-4fb460ce1e2b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:04.417371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ee674c3d-0b26-4535-9bfc-4fb460ce1e2b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:04.423578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee674c3d-0b26-4535-9bfc-4fb460ce1e2b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:04.424017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee674c3d-0b26-4535-9bfc-4fb460ce1e2b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:04.424778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee674c3d-0b26-4535-9bfc-4fb460ce1e2b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:04.425205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee674c3d-0b26-4535-9bfc-4fb460ce1e2b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:04.490114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ee674c3d-0b26-4535-9bfc-4fb460ce1e2b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:04.498041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ee674c3d-0b26-4535-9bfc-4fb460ce1e2b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.085193 Jul 14 09:40:04.498824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 177/339] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:04 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:04.828554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-330c529d-0634-4a7a-8414-cae38399c3e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:04.829339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-330c529d-0634-4a7a-8414-cae38399c3e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:04.836900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-330c529d-0634-4a7a-8414-cae38399c3e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:04.837380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-330c529d-0634-4a7a-8414-cae38399c3e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:04.838202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-330c529d-0634-4a7a-8414-cae38399c3e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:04.838690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-330c529d-0634-4a7a-8414-cae38399c3e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:04.970116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-330c529d-0634-4a7a-8414-cae38399c3e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:04.977559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-330c529d-0634-4a7a-8414-cae38399c3e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.152902 Jul 14 09:40:04.978112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 163/340] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:05.207201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-43505323-09c7-4216-8f81-cedc23d89a65 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:05.207903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-43505323-09c7-4216-8f81-cedc23d89a65 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:05.214925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43505323-09c7-4216-8f81-cedc23d89a65 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:05.215483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43505323-09c7-4216-8f81-cedc23d89a65 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:05.216455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43505323-09c7-4216-8f81-cedc23d89a65 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:05.216921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43505323-09c7-4216-8f81-cedc23d89a65 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:05.357058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-885be400-cab8-48df-aed8-2fb354ab7bbc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:05.358083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-885be400-cab8-48df-aed8-2fb354ab7bbc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:05.365992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-885be400-cab8-48df-aed8-2fb354ab7bbc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:05.367683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-885be400-cab8-48df-aed8-2fb354ab7bbc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:05.368741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-885be400-cab8-48df-aed8-2fb354ab7bbc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:05.369266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-885be400-cab8-48df-aed8-2fb354ab7bbc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:05.377297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-43505323-09c7-4216-8f81-cedc23d89a65 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:05.385472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-43505323-09c7-4216-8f81-cedc23d89a65 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.182008 Jul 14 09:40:05.386651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 178/341] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:05 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:05.514873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3db0f8bc-e3c1-4f1e-8d0f-6ca1eb3c8f7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:05.515486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3db0f8bc-e3c1-4f1e-8d0f-6ca1eb3c8f7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:05.524998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3db0f8bc-e3c1-4f1e-8d0f-6ca1eb3c8f7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:05.527439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3db0f8bc-e3c1-4f1e-8d0f-6ca1eb3c8f7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:05.530746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3db0f8bc-e3c1-4f1e-8d0f-6ca1eb3c8f7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:05.532385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3db0f8bc-e3c1-4f1e-8d0f-6ca1eb3c8f7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:05.570872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-885be400-cab8-48df-aed8-2fb354ab7bbc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:05.582627 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-885be400-cab8-48df-aed8-2fb354ab7bbc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.229432 Jul 14 09:40:05.595208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 164/342] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:05 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:05.635292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3db0f8bc-e3c1-4f1e-8d0f-6ca1eb3c8f7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:05.643003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3db0f8bc-e3c1-4f1e-8d0f-6ca1eb3c8f7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.132045 Jul 14 09:40:05.643585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 179/343] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:05 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:05.993950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c8e5822b-1ec7-4ea4-8e7a-2f56b085a33d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:05.994590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c8e5822b-1ec7-4ea4-8e7a-2f56b085a33d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:06.001014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8e5822b-1ec7-4ea4-8e7a-2f56b085a33d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:06.001464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8e5822b-1ec7-4ea4-8e7a-2f56b085a33d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:06.002249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8e5822b-1ec7-4ea4-8e7a-2f56b085a33d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:06.002687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8e5822b-1ec7-4ea4-8e7a-2f56b085a33d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:06.144314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c8e5822b-1ec7-4ea4-8e7a-2f56b085a33d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:06.152693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c8e5822b-1ec7-4ea4-8e7a-2f56b085a33d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.162621 Jul 14 09:40:06.153445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 165/344] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:06.403614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fdeff98b-98be-4be5-9e19-034f536086c9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:06.404295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fdeff98b-98be-4be5-9e19-034f536086c9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:06.411448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fdeff98b-98be-4be5-9e19-034f536086c9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:06.412067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fdeff98b-98be-4be5-9e19-034f536086c9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:06.412888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fdeff98b-98be-4be5-9e19-034f536086c9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:06.413368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fdeff98b-98be-4be5-9e19-034f536086c9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:06.557237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fdeff98b-98be-4be5-9e19-034f536086c9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:06.568424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fdeff98b-98be-4be5-9e19-034f536086c9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.168853 Jul 14 09:40:06.569006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 180/345] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:06 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:06.603774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5fcef85f-3d8d-4786-9a2c-2a53bc0819f6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:06.604578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5fcef85f-3d8d-4786-9a2c-2a53bc0819f6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:06.611909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:06.613274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=16 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:06.615084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fcef85f-3d8d-4786-9a2c-2a53bc0819f6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:06.618391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fcef85f-3d8d-4786-9a2c-2a53bc0819f6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:06.620042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fcef85f-3d8d-4786-9a2c-2a53bc0819f6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:06.620697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fcef85f-3d8d-4786-9a2c-2a53bc0819f6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:06.659233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-182e96a0-637c-4a9a-90b1-04e102c6e9bb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:06.659872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-182e96a0-637c-4a9a-90b1-04e102c6e9bb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:06.666853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-182e96a0-637c-4a9a-90b1-04e102c6e9bb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:06.667311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-182e96a0-637c-4a9a-90b1-04e102c6e9bb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:06.668086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-182e96a0-637c-4a9a-90b1-04e102c6e9bb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:06.668523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-182e96a0-637c-4a9a-90b1-04e102c6e9bb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:06.712037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=10 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:06.749996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-182e96a0-637c-4a9a-90b1-04e102c6e9bb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:06.759399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-182e96a0-637c-4a9a-90b1-04e102c6e9bb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.103958 Jul 14 09:40:06.759970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 181/346] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:06 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:06.818856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5fcef85f-3d8d-4786-9a2c-2a53bc0819f6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:06.828631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5fcef85f-3d8d-4786-9a2c-2a53bc0819f6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.229431 Jul 14 09:40:06.829269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 166/347] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:06 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:07.170798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f9dcbc49-7847-49bc-8712-0ed7c59a0845 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:07.171419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f9dcbc49-7847-49bc-8712-0ed7c59a0845 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:07.178320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9dcbc49-7847-49bc-8712-0ed7c59a0845 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:07.178771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9dcbc49-7847-49bc-8712-0ed7c59a0845 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:07.180226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9dcbc49-7847-49bc-8712-0ed7c59a0845 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:07.180575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9dcbc49-7847-49bc-8712-0ed7c59a0845 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:07.320676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f9dcbc49-7847-49bc-8712-0ed7c59a0845 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:07.328129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f9dcbc49-7847-49bc-8712-0ed7c59a0845 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.161254 Jul 14 09:40:07.328686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 182/348] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:07.587164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7db3cfad-324f-40c0-8c66-5e40da91b346 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:07.587775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7db3cfad-324f-40c0-8c66-5e40da91b346 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:07.594590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7db3cfad-324f-40c0-8c66-5e40da91b346 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:07.595038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7db3cfad-324f-40c0-8c66-5e40da91b346 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:07.596323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7db3cfad-324f-40c0-8c66-5e40da91b346 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:07.596763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7db3cfad-324f-40c0-8c66-5e40da91b346 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:07.735415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7db3cfad-324f-40c0-8c66-5e40da91b346 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:07.745878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7db3cfad-324f-40c0-8c66-5e40da91b346 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.163480 Jul 14 09:40:07.746492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 167/349] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:07 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:07.776429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-257a2fa5-aaf3-4359-9cdf-bbcb96fdb0a5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:07.777037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-257a2fa5-aaf3-4359-9cdf-bbcb96fdb0a5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:07.782953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-257a2fa5-aaf3-4359-9cdf-bbcb96fdb0a5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:07.783399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-257a2fa5-aaf3-4359-9cdf-bbcb96fdb0a5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:07.784156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-257a2fa5-aaf3-4359-9cdf-bbcb96fdb0a5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:07.784589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-257a2fa5-aaf3-4359-9cdf-bbcb96fdb0a5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:07.844433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-257a2fa5-aaf3-4359-9cdf-bbcb96fdb0a5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:07.848948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6603e418-46c1-42ad-bd57-185f9a36866e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:07.849656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6603e418-46c1-42ad-bd57-185f9a36866e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:07.851935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-257a2fa5-aaf3-4359-9cdf-bbcb96fdb0a5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.079853 Jul 14 09:40:07.852503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 183/350] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:07 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:07.857664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6603e418-46c1-42ad-bd57-185f9a36866e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:07.858115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6603e418-46c1-42ad-bd57-185f9a36866e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:07.858920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6603e418-46c1-42ad-bd57-185f9a36866e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:07.859388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6603e418-46c1-42ad-bd57-185f9a36866e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:07.988514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6603e418-46c1-42ad-bd57-185f9a36866e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:07.997657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6603e418-46c1-42ad-bd57-185f9a36866e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.152984 Jul 14 09:40:07.998246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 168/351] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:07 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:08.345463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4860b3ea-18c7-429c-aca1-659f0185e7f3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:08.346167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4860b3ea-18c7-429c-aca1-659f0185e7f3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:08.352831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4860b3ea-18c7-429c-aca1-659f0185e7f3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:08.353278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4860b3ea-18c7-429c-aca1-659f0185e7f3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:08.354031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4860b3ea-18c7-429c-aca1-659f0185e7f3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:08.354501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4860b3ea-18c7-429c-aca1-659f0185e7f3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:08.491491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4860b3ea-18c7-429c-aca1-659f0185e7f3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:08.499545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4860b3ea-18c7-429c-aca1-659f0185e7f3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.157861 Jul 14 09:40:08.500127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 184/352] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:08.763600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5f825d59-6170-4176-a89e-594700fba2d2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:08.764204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5f825d59-6170-4176-a89e-594700fba2d2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:08.771063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5f825d59-6170-4176-a89e-594700fba2d2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:08.771517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5f825d59-6170-4176-a89e-594700fba2d2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:08.772300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5f825d59-6170-4176-a89e-594700fba2d2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:08.772922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5f825d59-6170-4176-a89e-594700fba2d2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:08.868478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e2a2cfc8-fbac-4902-81e6-50c551b28282 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:08.869186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e2a2cfc8-fbac-4902-81e6-50c551b28282 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:08.875454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2a2cfc8-fbac-4902-81e6-50c551b28282 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:08.875981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2a2cfc8-fbac-4902-81e6-50c551b28282 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:08.876828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2a2cfc8-fbac-4902-81e6-50c551b28282 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:08.877325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2a2cfc8-fbac-4902-81e6-50c551b28282 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:08.907063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5f825d59-6170-4176-a89e-594700fba2d2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:08.915226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5f825d59-6170-4176-a89e-594700fba2d2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.155526 Jul 14 09:40:08.916215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 169/353] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:08 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:08.943468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e2a2cfc8-fbac-4902-81e6-50c551b28282 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:08.951005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e2a2cfc8-fbac-4902-81e6-50c551b28282 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1246 microversion: 2.1 time: 0.086445 Jul 14 09:40:08.951561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 185/354] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:08 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:09.014114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-442dc7fd-ced9-4a07-9df8-44492fb426f5 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:09.014755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-442dc7fd-ced9-4a07-9df8-44492fb426f5 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:09.020761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-442dc7fd-ced9-4a07-9df8-44492fb426f5 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:09.021205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-442dc7fd-ced9-4a07-9df8-44492fb426f5 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:09.021962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-442dc7fd-ced9-4a07-9df8-44492fb426f5 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:09.022449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-442dc7fd-ced9-4a07-9df8-44492fb426f5 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:09.159690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-442dc7fd-ced9-4a07-9df8-44492fb426f5 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:09.167077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-442dc7fd-ced9-4a07-9df8-44492fb426f5 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.156751 Jul 14 09:40:09.167818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 170/355] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:09 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:09.518448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f38603a6-043a-41be-aa4a-be3a938486d2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:09.519171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f38603a6-043a-41be-aa4a-be3a938486d2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:09.529149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f38603a6-043a-41be-aa4a-be3a938486d2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:09.534585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f38603a6-043a-41be-aa4a-be3a938486d2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:09.535522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f38603a6-043a-41be-aa4a-be3a938486d2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:09.535996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f38603a6-043a-41be-aa4a-be3a938486d2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:09.838767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f38603a6-043a-41be-aa4a-be3a938486d2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:09.846586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f38603a6-043a-41be-aa4a-be3a938486d2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.333522 Jul 14 09:40:09.847168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 186/356] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:09.933013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4e12b98b-b1d9-425e-8340-daeb22b97200 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:09.933617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4e12b98b-b1d9-425e-8340-daeb22b97200 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:09.940120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e12b98b-b1d9-425e-8340-daeb22b97200 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:09.940563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e12b98b-b1d9-425e-8340-daeb22b97200 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:09.941370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e12b98b-b1d9-425e-8340-daeb22b97200 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:09.941746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e12b98b-b1d9-425e-8340-daeb22b97200 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:09.968183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8ca6d49a-8371-4a80-b490-05f7794139ac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:09.968886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8ca6d49a-8371-4a80-b490-05f7794139ac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:09.975038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ca6d49a-8371-4a80-b490-05f7794139ac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:09.975487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ca6d49a-8371-4a80-b490-05f7794139ac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:09.976786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ca6d49a-8371-4a80-b490-05f7794139ac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:09.977222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ca6d49a-8371-4a80-b490-05f7794139ac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:10.051082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8ca6d49a-8371-4a80-b490-05f7794139ac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:10.055041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:10.059930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8ca6d49a-8371-4a80-b490-05f7794139ac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1294 microversion: 2.1 time: 0.095709 Jul 14 09:40:10.069712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 187/357] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:09 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:10.093119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4e12b98b-b1d9-425e-8340-daeb22b97200 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:10.100526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4e12b98b-b1d9-425e-8340-daeb22b97200 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.172142 Jul 14 09:40:10.101088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 171/358] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:09 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:10.188326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a5776730-5592-4879-9be0-412f9bc90184 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:10.188935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a5776730-5592-4879-9be0-412f9bc90184 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:10.195933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5776730-5592-4879-9be0-412f9bc90184 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:10.196308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5776730-5592-4879-9be0-412f9bc90184 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:10.197070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5776730-5592-4879-9be0-412f9bc90184 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:10.197499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5776730-5592-4879-9be0-412f9bc90184 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:10.328141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a5776730-5592-4879-9be0-412f9bc90184 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:10.336977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a5776730-5592-4879-9be0-412f9bc90184 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.156533 Jul 14 09:40:10.337704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 188/359] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:10 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:10.863735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c9a1b05e-832c-4d5b-85fb-5ff8a43d0c08 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:10.864254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c9a1b05e-832c-4d5b-85fb-5ff8a43d0c08 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:10.871230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9a1b05e-832c-4d5b-85fb-5ff8a43d0c08 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:10.871669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9a1b05e-832c-4d5b-85fb-5ff8a43d0c08 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:10.872423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9a1b05e-832c-4d5b-85fb-5ff8a43d0c08 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:10.872848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9a1b05e-832c-4d5b-85fb-5ff8a43d0c08 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:11.001223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9a1b05e-832c-4d5b-85fb-5ff8a43d0c08 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:11.009121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c9a1b05e-832c-4d5b-85fb-5ff8a43d0c08 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.149299 Jul 14 09:40:11.009672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 172/360] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:11.076930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3dd326b6-8bdf-40e4-baeb-79de6c9711ad tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:11.077599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3dd326b6-8bdf-40e4-baeb-79de6c9711ad tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:11.083937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3dd326b6-8bdf-40e4-baeb-79de6c9711ad tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:11.084654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3dd326b6-8bdf-40e4-baeb-79de6c9711ad tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:11.085425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3dd326b6-8bdf-40e4-baeb-79de6c9711ad tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:11.085861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3dd326b6-8bdf-40e4-baeb-79de6c9711ad tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:11.118655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-27357107-0859-4154-bedb-e5dcf16016bb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:11.119174 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-27357107-0859-4154-bedb-e5dcf16016bb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:11.125152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27357107-0859-4154-bedb-e5dcf16016bb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:11.125593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27357107-0859-4154-bedb-e5dcf16016bb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:11.126379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27357107-0859-4154-bedb-e5dcf16016bb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:11.126810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27357107-0859-4154-bedb-e5dcf16016bb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:11.145727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3dd326b6-8bdf-40e4-baeb-79de6c9711ad tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:11.153232 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3dd326b6-8bdf-40e4-baeb-79de6c9711ad tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1302 microversion: 2.1 time: 0.080117 Jul 14 09:40:11.153815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 189/361] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:11 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1302 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:11.258166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-27357107-0859-4154-bedb-e5dcf16016bb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:11.265516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-27357107-0859-4154-bedb-e5dcf16016bb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.151322 Jul 14 09:40:11.266063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 173/362] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:11 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:11.354573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da7fe213-0641-4c39-be8b-3216a360e931 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:11.355199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da7fe213-0641-4c39-be8b-3216a360e931 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:11.361216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da7fe213-0641-4c39-be8b-3216a360e931 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:11.361665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da7fe213-0641-4c39-be8b-3216a360e931 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:11.362447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da7fe213-0641-4c39-be8b-3216a360e931 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:11.362884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da7fe213-0641-4c39-be8b-3216a360e931 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:11.493106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da7fe213-0641-4c39-be8b-3216a360e931 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:11.500814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da7fe213-0641-4c39-be8b-3216a360e931 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.150686 Jul 14 09:40:11.501392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 190/363] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:11 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:12.026271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4559222c-eb75-4e1e-8ee2-bdba1117bcaf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:12.026802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4559222c-eb75-4e1e-8ee2-bdba1117bcaf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:12.033195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4559222c-eb75-4e1e-8ee2-bdba1117bcaf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:12.033635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4559222c-eb75-4e1e-8ee2-bdba1117bcaf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:12.034471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4559222c-eb75-4e1e-8ee2-bdba1117bcaf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:12.034989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4559222c-eb75-4e1e-8ee2-bdba1117bcaf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:12.161918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4559222c-eb75-4e1e-8ee2-bdba1117bcaf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:12.169695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bbb1e8b2-4dc9-4ee2-8c94-103f2a6e63ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:12.170342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4559222c-eb75-4e1e-8ee2-bdba1117bcaf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.148324 Jul 14 09:40:12.170461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bbb1e8b2-4dc9-4ee2-8c94-103f2a6e63ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:12.170924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 174/364] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:12.176582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bbb1e8b2-4dc9-4ee2-8c94-103f2a6e63ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:12.177027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bbb1e8b2-4dc9-4ee2-8c94-103f2a6e63ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:12.177791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bbb1e8b2-4dc9-4ee2-8c94-103f2a6e63ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:12.178246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bbb1e8b2-4dc9-4ee2-8c94-103f2a6e63ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:12.244679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bbb1e8b2-4dc9-4ee2-8c94-103f2a6e63ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:12.252245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bbb1e8b2-4dc9-4ee2-8c94-103f2a6e63ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1302 microversion: 2.1 time: 0.086480 Jul 14 09:40:12.252801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 191/365] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:12 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:12.281934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2341ec95-dae5-44ed-b0ed-675933c54e54 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:12.282514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2341ec95-dae5-44ed-b0ed-675933c54e54 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:12.288487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2341ec95-dae5-44ed-b0ed-675933c54e54 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:12.288937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2341ec95-dae5-44ed-b0ed-675933c54e54 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:12.289694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2341ec95-dae5-44ed-b0ed-675933c54e54 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:12.290129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2341ec95-dae5-44ed-b0ed-675933c54e54 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:12.414643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2341ec95-dae5-44ed-b0ed-675933c54e54 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:12.422008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2341ec95-dae5-44ed-b0ed-675933c54e54 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.143956 Jul 14 09:40:12.422602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 175/366] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:12 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:12.516606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-37eec9ab-a7d4-499e-9a0c-e4ae1441a8db tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:12.517215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-37eec9ab-a7d4-499e-9a0c-e4ae1441a8db tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:12.523781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37eec9ab-a7d4-499e-9a0c-e4ae1441a8db tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:12.524146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37eec9ab-a7d4-499e-9a0c-e4ae1441a8db tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:12.524918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37eec9ab-a7d4-499e-9a0c-e4ae1441a8db tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:12.525363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37eec9ab-a7d4-499e-9a0c-e4ae1441a8db tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:12.662079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-37eec9ab-a7d4-499e-9a0c-e4ae1441a8db tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:12.669989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-37eec9ab-a7d4-499e-9a0c-e4ae1441a8db tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.157188 Jul 14 09:40:12.670818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 192/367] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:12 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:13.187594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-80d6795d-e40c-4ccf-867e-5f37b00106c1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:13.188205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-80d6795d-e40c-4ccf-867e-5f37b00106c1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:13.195083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80d6795d-e40c-4ccf-867e-5f37b00106c1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:13.195535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80d6795d-e40c-4ccf-867e-5f37b00106c1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:13.196301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80d6795d-e40c-4ccf-867e-5f37b00106c1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:13.196793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80d6795d-e40c-4ccf-867e-5f37b00106c1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:13.271177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1aaa21af-5dbf-45cf-bb7a-b22aa60233ae tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:13.272163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1aaa21af-5dbf-45cf-bb7a-b22aa60233ae tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:13.280325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1aaa21af-5dbf-45cf-bb7a-b22aa60233ae tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:13.281087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1aaa21af-5dbf-45cf-bb7a-b22aa60233ae tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:13.283307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1aaa21af-5dbf-45cf-bb7a-b22aa60233ae tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:13.283977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1aaa21af-5dbf-45cf-bb7a-b22aa60233ae tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:13.359787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1aaa21af-5dbf-45cf-bb7a-b22aa60233ae tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:13.362926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-80d6795d-e40c-4ccf-867e-5f37b00106c1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:13.367018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1aaa21af-5dbf-45cf-bb7a-b22aa60233ae tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1302 microversion: 2.1 time: 0.101860 Jul 14 09:40:13.378436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 193/368] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:13 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:13.378807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-80d6795d-e40c-4ccf-867e-5f37b00106c1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.187316 Jul 14 09:40:13.378807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 176/369] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:13 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:13.438667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-450781dd-5b55-4060-ae27-576237b346ce tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:13.439274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-450781dd-5b55-4060-ae27-576237b346ce tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:13.445241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-450781dd-5b55-4060-ae27-576237b346ce tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:13.445688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-450781dd-5b55-4060-ae27-576237b346ce tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:13.446484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-450781dd-5b55-4060-ae27-576237b346ce tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:13.446920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-450781dd-5b55-4060-ae27-576237b346ce tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:13.581697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-450781dd-5b55-4060-ae27-576237b346ce tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:13.590033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-450781dd-5b55-4060-ae27-576237b346ce tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.155175 Jul 14 09:40:13.590637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 194/370] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:13 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:13.687561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a52a5be9-5423-458c-9d30-4697059b86b9 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:13.688243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a52a5be9-5423-458c-9d30-4697059b86b9 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:13.695219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a52a5be9-5423-458c-9d30-4697059b86b9 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:13.695735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a52a5be9-5423-458c-9d30-4697059b86b9 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:13.696560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a52a5be9-5423-458c-9d30-4697059b86b9 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:13.697077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a52a5be9-5423-458c-9d30-4697059b86b9 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:13.834482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a52a5be9-5423-458c-9d30-4697059b86b9 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:13.842546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a52a5be9-5423-458c-9d30-4697059b86b9 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1314 microversion: 2.1 time: 0.159028 Jul 14 09:40:13.843477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 177/371] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:13 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:14.383209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f310c3ba-e6b6-4780-8398-fa1a86ab5917 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:14.383820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f310c3ba-e6b6-4780-8398-fa1a86ab5917 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:14.390107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f310c3ba-e6b6-4780-8398-fa1a86ab5917 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:14.390610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f310c3ba-e6b6-4780-8398-fa1a86ab5917 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:14.391383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f310c3ba-e6b6-4780-8398-fa1a86ab5917 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:14.391820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f310c3ba-e6b6-4780-8398-fa1a86ab5917 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:14.392445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb9c8fed-7768-4d69-aa54-4b7fd4a353e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:14.393122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eb9c8fed-7768-4d69-aa54-4b7fd4a353e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:14.399460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb9c8fed-7768-4d69-aa54-4b7fd4a353e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:14.400188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb9c8fed-7768-4d69-aa54-4b7fd4a353e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:14.401097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb9c8fed-7768-4d69-aa54-4b7fd4a353e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:14.401715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb9c8fed-7768-4d69-aa54-4b7fd4a353e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:14.508532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f310c3ba-e6b6-4780-8398-fa1a86ab5917 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:14.515960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f310c3ba-e6b6-4780-8398-fa1a86ab5917 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1302 microversion: 2.1 time: 0.136614 Jul 14 09:40:14.516523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 195/372] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:14 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1302 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:14.610155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4cdc713f-23f5-4339-bbfa-be3293bddb36 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:14.611100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4cdc713f-23f5-4339-bbfa-be3293bddb36 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:14.621098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cdc713f-23f5-4339-bbfa-be3293bddb36 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:14.622138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cdc713f-23f5-4339-bbfa-be3293bddb36 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:14.623364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cdc713f-23f5-4339-bbfa-be3293bddb36 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:14.624022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cdc713f-23f5-4339-bbfa-be3293bddb36 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:14.780420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-eb9c8fed-7768-4d69-aa54-4b7fd4a353e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:14.790094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eb9c8fed-7768-4d69-aa54-4b7fd4a353e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.402648 Jul 14 09:40:14.791354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 178/373] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:14.859364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ada41a16-566b-440d-a19a-ab2f413bf0c6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:14.859580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4cdc713f-23f5-4339-bbfa-be3293bddb36 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:14.860484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ada41a16-566b-440d-a19a-ab2f413bf0c6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:14.867362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada41a16-566b-440d-a19a-ab2f413bf0c6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:14.868125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada41a16-566b-440d-a19a-ab2f413bf0c6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:14.868608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4cdc713f-23f5-4339-bbfa-be3293bddb36 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.263539 Jul 14 09:40:14.869497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 196/374] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:14 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:14.878907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada41a16-566b-440d-a19a-ab2f413bf0c6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:14.879780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada41a16-566b-440d-a19a-ab2f413bf0c6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:14.886341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:15.027642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ada41a16-566b-440d-a19a-ab2f413bf0c6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:15.037456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ada41a16-566b-440d-a19a-ab2f413bf0c6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1497 microversion: 2.1 time: 0.182107 Jul 14 09:40:15.040375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 179/375] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:14 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:15.535331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b721ffdf-611f-4780-8f53-782e94acf481 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:15.535970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b721ffdf-611f-4780-8f53-782e94acf481 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:15.543358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b721ffdf-611f-4780-8f53-782e94acf481 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:15.548114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b721ffdf-611f-4780-8f53-782e94acf481 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:15.549629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b721ffdf-611f-4780-8f53-782e94acf481 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:15.550329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b721ffdf-611f-4780-8f53-782e94acf481 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:15.657229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-12fe9233-5c65-4ada-b33c-4c857bd5e6a6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:15.658332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-12fe9233-5c65-4ada-b33c-4c857bd5e6a6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:15.667788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12fe9233-5c65-4ada-b33c-4c857bd5e6a6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:15.668571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12fe9233-5c65-4ada-b33c-4c857bd5e6a6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:15.669536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12fe9233-5c65-4ada-b33c-4c857bd5e6a6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:15.671214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12fe9233-5c65-4ada-b33c-4c857bd5e6a6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:15.728954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-12fe9233-5c65-4ada-b33c-4c857bd5e6a6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:40:15.768263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b721ffdf-611f-4780-8f53-782e94acf481 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:15.780131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b721ffdf-611f-4780-8f53-782e94acf481 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1300 microversion: 2.1 time: 0.248455 Jul 14 09:40:15.780743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 197/376] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:15 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1300 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:15.815235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5fdf86ec-658c-4c80-bc5e-be9a82a52937 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:15.816171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5fdf86ec-658c-4c80-bc5e-be9a82a52937 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:15.828319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fdf86ec-658c-4c80-bc5e-be9a82a52937 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:15.829907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fdf86ec-658c-4c80-bc5e-be9a82a52937 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:15.831726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fdf86ec-658c-4c80-bc5e-be9a82a52937 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:15.833885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fdf86ec-658c-4c80-bc5e-be9a82a52937 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:15.862565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-12fe9233-5c65-4ada-b33c-4c857bd5e6a6 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "DELETE /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 204 len: 0 microversion: 2.1 time: 0.210212 Jul 14 09:40:15.868540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 180/377] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:40:15 2022] DELETE /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:40:15.877326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-72e6695f-5d89-4713-beac-51e32555b3f1 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:15.880542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-72e6695f-5d89-4713-beac-51e32555b3f1 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:15.890427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72e6695f-5d89-4713-beac-51e32555b3f1 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:15.891240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72e6695f-5d89-4713-beac-51e32555b3f1 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:15.892216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72e6695f-5d89-4713-beac-51e32555b3f1 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:15.892646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72e6695f-5d89-4713-beac-51e32555b3f1 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:16.189378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5fdf86ec-658c-4c80-bc5e-be9a82a52937 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:16.205042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5fdf86ec-658c-4c80-bc5e-be9a82a52937 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.401475 Jul 14 09:40:16.207375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 198/378] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:16.221074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-db708d06-2955-48e3-827b-fe21818a49f3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:16.222394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-db708d06-2955-48e3-827b-fe21818a49f3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:16.231880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-72e6695f-5d89-4713-beac-51e32555b3f1 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:16.243052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-72e6695f-5d89-4713-beac-51e32555b3f1 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1503 microversion: 2.1 time: 0.372250 Jul 14 09:40:16.248066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 181/379] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:15 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1503 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:16.249659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db708d06-2955-48e3-827b-fe21818a49f3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:16.250820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db708d06-2955-48e3-827b-fe21818a49f3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:16.251825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db708d06-2955-48e3-827b-fe21818a49f3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:16.252452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db708d06-2955-48e3-827b-fe21818a49f3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:16.484901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-db708d06-2955-48e3-827b-fe21818a49f3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:16.495076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-db708d06-2955-48e3-827b-fe21818a49f3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.286327 Jul 14 09:40:16.502298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 199/380] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:16 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:16.799334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f6b15fe0-6e1e-453b-a29b-65bf175991f7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:16.799949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f6b15fe0-6e1e-453b-a29b-65bf175991f7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:16.807937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6b15fe0-6e1e-453b-a29b-65bf175991f7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:16.808646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6b15fe0-6e1e-453b-a29b-65bf175991f7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:16.809881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6b15fe0-6e1e-453b-a29b-65bf175991f7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:16.810346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6b15fe0-6e1e-453b-a29b-65bf175991f7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:16.995023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f6b15fe0-6e1e-453b-a29b-65bf175991f7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:17.003648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f6b15fe0-6e1e-453b-a29b-65bf175991f7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.208727 Jul 14 09:40:17.004236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 182/381] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:16 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:17.229353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ab4472b7-42a9-4c7f-90f8-a3698fbcdc28 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:17.230668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ab4472b7-42a9-4c7f-90f8-a3698fbcdc28 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:17.236796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab4472b7-42a9-4c7f-90f8-a3698fbcdc28 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:17.237242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab4472b7-42a9-4c7f-90f8-a3698fbcdc28 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:17.238001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab4472b7-42a9-4c7f-90f8-a3698fbcdc28 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:17.238465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab4472b7-42a9-4c7f-90f8-a3698fbcdc28 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:17.266473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32b0ae9b-a421-43e3-8776-a320247e4fb0 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:17.267155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-32b0ae9b-a421-43e3-8776-a320247e4fb0 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:17.276719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32b0ae9b-a421-43e3-8776-a320247e4fb0 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:17.277155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32b0ae9b-a421-43e3-8776-a320247e4fb0 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:17.281736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32b0ae9b-a421-43e3-8776-a320247e4fb0 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:17.282303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32b0ae9b-a421-43e3-8776-a320247e4fb0 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:17.836895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ab4472b7-42a9-4c7f-90f8-a3698fbcdc28 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:17.855686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ab4472b7-42a9-4c7f-90f8-a3698fbcdc28 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.631109 Jul 14 09:40:17.865534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 200/382] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:17.874347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32b0ae9b-a421-43e3-8776-a320247e4fb0 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:17.890599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-32b0ae9b-a421-43e3-8776-a320247e4fb0 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1503 microversion: 2.1 time: 0.628162 Jul 14 09:40:17.893945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4da41c44-bdb9-4c62-b3ff-a5a03e5ada3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:17.894853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4da41c44-bdb9-4c62-b3ff-a5a03e5ada3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:17.895656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 183/383] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:17 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1503 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:17.908106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4da41c44-bdb9-4c62-b3ff-a5a03e5ada3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:17.908559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4da41c44-bdb9-4c62-b3ff-a5a03e5ada3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:17.912212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4da41c44-bdb9-4c62-b3ff-a5a03e5ada3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:17.912917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4da41c44-bdb9-4c62-b3ff-a5a03e5ada3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:18.025028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2ec8c4ee-7e4f-41c3-bf54-396a60c4c2e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:18.026101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2ec8c4ee-7e4f-41c3-bf54-396a60c4c2e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:18.038147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:18.041993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ec8c4ee-7e4f-41c3-bf54-396a60c4c2e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:18.043344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ec8c4ee-7e4f-41c3-bf54-396a60c4c2e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:18.045499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ec8c4ee-7e4f-41c3-bf54-396a60c4c2e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:18.046115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ec8c4ee-7e4f-41c3-bf54-396a60c4c2e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:18.369393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4da41c44-bdb9-4c62-b3ff-a5a03e5ada3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:18.393016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4da41c44-bdb9-4c62-b3ff-a5a03e5ada3a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.524798 Jul 14 09:40:18.395236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 201/384] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:17 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:18.417110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-a965da30-dc78-40b9-b1d5-d33450078f48 req-7ca6c4a5-605e-4ab4-967d-2c042af1ffc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e62e62e-be29-409c-a568-7269db0dba2d", "name": "network-vif-plugged", "status": "completed", "tag": "f3b4a515-5f24-4041-9e95-ef29a5325536"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:18.430952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:18.434544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-a965da30-dc78-40b9-b1d5-d33450078f48 req-7ca6c4a5-605e-4ab4-967d-2c042af1ffc3 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:18.436098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-a965da30-dc78-40b9-b1d5-d33450078f48 req-7ca6c4a5-605e-4ab4-967d-2c042af1ffc3 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:18.459806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2ec8c4ee-7e4f-41c3-bf54-396a60c4c2e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:18.461318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-a965da30-dc78-40b9-b1d5-d33450078f48 req-7ca6c4a5-605e-4ab4-967d-2c042af1ffc3 service nova] Creating event network-vif-plugged:f3b4a515-5f24-4041-9e95-ef29a5325536 for instance 9e62e62e-be29-409c-a568-7269db0dba2d on hv-cinder-82549 Jul 14 09:40:18.470209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-a965da30-dc78-40b9-b1d5-d33450078f48 req-7ca6c4a5-605e-4ab4-967d-2c042af1ffc3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058846 Jul 14 09:40:18.471556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2ec8c4ee-7e4f-41c3-bf54-396a60c4c2e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.454368 Jul 14 09:40:18.472003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 202/385] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:18.481535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 184/386] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:18 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:18.874873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-574095a5-6284-424a-afc3-841dbb971e01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:18.876194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-574095a5-6284-424a-afc3-841dbb971e01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:18.891655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-574095a5-6284-424a-afc3-841dbb971e01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:18.892392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-574095a5-6284-424a-afc3-841dbb971e01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:18.893336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-574095a5-6284-424a-afc3-841dbb971e01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:18.894059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-574095a5-6284-424a-afc3-841dbb971e01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:18.914468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-833cf498-8849-4e72-adf5-a4023271d7ea tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:18.915226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-833cf498-8849-4e72-adf5-a4023271d7ea tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:18.929683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-833cf498-8849-4e72-adf5-a4023271d7ea tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:18.930859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-833cf498-8849-4e72-adf5-a4023271d7ea tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:18.932248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-833cf498-8849-4e72-adf5-a4023271d7ea tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:18.934402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-833cf498-8849-4e72-adf5-a4023271d7ea tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:19.192609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-833cf498-8849-4e72-adf5-a4023271d7ea tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:19.211096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-833cf498-8849-4e72-adf5-a4023271d7ea tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1461 microversion: 2.1 time: 0.295724 Jul 14 09:40:19.212442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 185/387] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:18 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1461 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:19.225427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-574095a5-6284-424a-afc3-841dbb971e01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:19.233894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-8cf9d433-d8ab-48ca-bfbd-1d0c37d386c3 req-a0ed792f-eef0-430e-bbfe-fba9a511481f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f265cbd-76a7-486d-873c-085ab051c168", "tag": "dd8d169f-9a71-4f5d-a383-3bbcf7e20150"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:19.239897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-574095a5-6284-424a-afc3-841dbb971e01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.370690 Jul 14 09:40:19.241065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 203/388] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:18 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:19.248767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-8cf9d433-d8ab-48ca-bfbd-1d0c37d386c3 req-a0ed792f-eef0-430e-bbfe-fba9a511481f service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:19.249418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-8cf9d433-d8ab-48ca-bfbd-1d0c37d386c3 req-a0ed792f-eef0-430e-bbfe-fba9a511481f service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:19.276845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-8cf9d433-d8ab-48ca-bfbd-1d0c37d386c3 req-a0ed792f-eef0-430e-bbfe-fba9a511481f service nova] Creating event network-changed:dd8d169f-9a71-4f5d-a383-3bbcf7e20150 for instance 7f265cbd-76a7-486d-873c-085ab051c168 on hv-cinder-82549 Jul 14 09:40:19.285191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-8cf9d433-d8ab-48ca-bfbd-1d0c37d386c3 req-a0ed792f-eef0-430e-bbfe-fba9a511481f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059321 Jul 14 09:40:19.285875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 186/389] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:19.371310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-e0889dd3-84c4-45ad-b115-0e9e70506348 req-01f06ec0-f934-4671-9f89-c474fa58c65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bbdc50-c193-494d-90b8-b884ba831ddb", "name": "network-vif-deleted", "tag": "4171dd98-ff0a-4f83-8f31-e403d99b7ade"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:19.385509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-e0889dd3-84c4-45ad-b115-0e9e70506348 req-01f06ec0-f934-4671-9f89-c474fa58c65e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:19.386315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-e0889dd3-84c4-45ad-b115-0e9e70506348 req-01f06ec0-f934-4671-9f89-c474fa58c65e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:19.404479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-e0889dd3-84c4-45ad-b115-0e9e70506348 req-01f06ec0-f934-4671-9f89-c474fa58c65e service nova] Creating event network-vif-deleted:4171dd98-ff0a-4f83-8f31-e403d99b7ade for instance 38bbdc50-c193-494d-90b8-b884ba831ddb on hv-cinder-82549 Jul 14 09:40:19.410923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-e0889dd3-84c4-45ad-b115-0e9e70506348 req-01f06ec0-f934-4671-9f89-c474fa58c65e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043159 Jul 14 09:40:19.412203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 204/390] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:19.414021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f8a2e4c0-a597-4742-b36f-c4296ec34ebf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:19.414739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f8a2e4c0-a597-4742-b36f-c4296ec34ebf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:19.426177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f8a2e4c0-a597-4742-b36f-c4296ec34ebf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:19.431377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f8a2e4c0-a597-4742-b36f-c4296ec34ebf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:19.432569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f8a2e4c0-a597-4742-b36f-c4296ec34ebf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:19.435102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f8a2e4c0-a597-4742-b36f-c4296ec34ebf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:19.494311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-98360db2-d310-496b-acd1-105d941ec78d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:19.495333 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-98360db2-d310-496b-acd1-105d941ec78d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:19.511315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98360db2-d310-496b-acd1-105d941ec78d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:19.512500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98360db2-d310-496b-acd1-105d941ec78d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:19.520774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98360db2-d310-496b-acd1-105d941ec78d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:19.531744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98360db2-d310-496b-acd1-105d941ec78d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:19.670867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f8a2e4c0-a597-4742-b36f-c4296ec34ebf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:19.681428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f8a2e4c0-a597-4742-b36f-c4296ec34ebf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.272389 Jul 14 09:40:19.682143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 187/391] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:19 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:19.742156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98360db2-d310-496b-acd1-105d941ec78d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:19.746548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:19.753469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-98360db2-d310-496b-acd1-105d941ec78d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.265059 Jul 14 09:40:19.754158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 205/392] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:19 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:20.229787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:20.231760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:20.239007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.239603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.240532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.241168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.257692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1e6067b6-d570-4b64-8186-d6129fde24d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:20.258691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1e6067b6-d570-4b64-8186-d6129fde24d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:20.269742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e6067b6-d570-4b64-8186-d6129fde24d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.272984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e6067b6-d570-4b64-8186-d6129fde24d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.277030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e6067b6-d570-4b64-8186-d6129fde24d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.277601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e6067b6-d570-4b64-8186-d6129fde24d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.330633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.331097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.331549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lazy-loading 'fault' on Instance uuid 38bbdc50-c193-494d-90b8-b884ba831ddb {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:40:20.427663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:20.442546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a22ed6f3-12e6-4a4a-9617-14d9b2aee082 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 200 len: 1304 microversion: 2.1 time: 0.217294 Jul 14 09:40:20.443320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 188/393] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:20 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 1304 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:20.561578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1e6067b6-d570-4b64-8186-d6129fde24d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:20.570507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1e6067b6-d570-4b64-8186-d6129fde24d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1359 microversion: 2.1 time: 0.316778 Jul 14 09:40:20.571090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 206/394] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:20.699611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-af6dcbe8-f142-43d0-8d44-5e97325230b7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:20.700491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af6dcbe8-f142-43d0-8d44-5e97325230b7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:20.716089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af6dcbe8-f142-43d0-8d44-5e97325230b7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.716585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af6dcbe8-f142-43d0-8d44-5e97325230b7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.717451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af6dcbe8-f142-43d0-8d44-5e97325230b7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.717885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af6dcbe8-f142-43d0-8d44-5e97325230b7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.770010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4ae3628e-d4f3-41a4-aade-326e45ab7eac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:20.770656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4ae3628e-d4f3-41a4-aade-326e45ab7eac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:20.778089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4ae3628e-d4f3-41a4-aade-326e45ab7eac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.783750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4ae3628e-d4f3-41a4-aade-326e45ab7eac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.784822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4ae3628e-d4f3-41a4-aade-326e45ab7eac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:20.785879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4ae3628e-d4f3-41a4-aade-326e45ab7eac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:20.985065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af6dcbe8-f142-43d0-8d44-5e97325230b7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:20.997705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-af6dcbe8-f142-43d0-8d44-5e97325230b7 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.302220 Jul 14 09:40:20.998878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 189/395] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:20 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:21.011909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4ae3628e-d4f3-41a4-aade-326e45ab7eac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:21.019706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4ae3628e-d4f3-41a4-aade-326e45ab7eac tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.253934 Jul 14 09:40:21.021158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 207/396] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:20 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:21.461776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:21.463041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: 38bbdc50-c193-494d-90b8-b884ba831ddb] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:21.469714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:21.470166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:21.470975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:21.471607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:21.492894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] HTTP exception thrown: Instance 38bbdc50-c193-494d-90b8-b884ba831ddb could not be found. Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Request method failure captured: Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb HTTP/1.1 Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-RV4xBh3ZK21QRVnVBmAwBAb5inz132zRuArNyRHz2JCcVBdTrz02kkuJhXdwWsoy7zbDmz6Mo2ZKLge6y5ZFznSy-or9YHlzU4ElBflcMcnudB3YUNGBKqDp2AemlCcO6YL9x4TVmwxcUchk2agLd2FQ0984m7i6FK3ZOlQlb__QU Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 8912a4453d094df58486417ebacfa14c Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-VolumesActionsTest-803952969 Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:40:21.497296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8912a4453d094df58486417ebacfa14c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8912a4453d094df58486417ebacfa14c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8912a4453d094df58486417ebacfa14c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8912a4453d094df58486417ebacfa14c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-VolumesActionsTest-803952969 Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 8912a4453d094df58486417ebacfa14c Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-VolumesActionsTest-803952969 Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-VolumesActionsTest-803952969-project Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 0b818be48fe94da3b7b0c1585d1a376b Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-VolumesActionsTest-803952969-project Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 38bbdc50-c193-494d-90b8-b884ba831ddb could not be found. Jul 14 09:40:21.503520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '38bbdc50-c193-494d-90b8-b884ba831ddb'} Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38bbdc50-c193-494d-90b8-b884ba831ddb could not be found. Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:40:21.504247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38bbdc50-c193-494d-90b8-b884ba831ddb could not be found. Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38bbdc50-c193-494d-90b8-b884ba831ddb could not be found. Jul 14 09:40:21.505425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:21.508409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Returning 404 to user: Instance 38bbdc50-c193-494d-90b8-b884ba831ddb could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:40:21.508409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b7881b90-06d6-4781-a6cb-68f6af80880b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb" status: 404 len: 111 microversion: 2.1 time: 0.041775 Jul 14 09:40:21.508409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 190/397] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:21 2022] GET /compute/v2.1/servers/38bbdc50-c193-494d-90b8-b884ba831ddb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:40:21.595622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0f4448ad-3539-4fcb-a0e5-56555f883d42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:21.596852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0f4448ad-3539-4fcb-a0e5-56555f883d42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:21.608864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f4448ad-3539-4fcb-a0e5-56555f883d42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:21.609657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f4448ad-3539-4fcb-a0e5-56555f883d42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:21.614463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f4448ad-3539-4fcb-a0e5-56555f883d42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:21.615122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f4448ad-3539-4fcb-a0e5-56555f883d42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:21.646599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1617419437", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "networks": [{"uuid": "4bb73866-30c3-4157-ba3d-9cf479019596"}]}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:21.742611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] validate_networks() for [('4bb73866-30c3-4157-ba3d-9cf479019596', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:40:21.931095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0f4448ad-3539-4fcb-a0e5-56555f883d42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:21.943615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0f4448ad-3539-4fcb-a0e5-56555f883d42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1549 microversion: 2.1 time: 0.357316 Jul 14 09:40:21.950551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 208/398] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1549 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:21.966257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-011ad09d-a72c-4271-b528-e84d9094cfe7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:21.971105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-011ad09d-a72c-4271-b528-e84d9094cfe7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:21.984368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-011ad09d-a72c-4271-b528-e84d9094cfe7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:21.986700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-011ad09d-a72c-4271-b528-e84d9094cfe7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:21.987523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-011ad09d-a72c-4271-b528-e84d9094cfe7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:21.989135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-011ad09d-a72c-4271-b528-e84d9094cfe7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:22.635244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-011ad09d-a72c-4271-b528-e84d9094cfe7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:22.645098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-011ad09d-a72c-4271-b528-e84d9094cfe7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1549 microversion: 2.1 time: 0.683781 Jul 14 09:40:22.646642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 209/399] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1549 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:22.659117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-befa5454-2426-4d82-87b3-d52836b961a0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:22.659935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-befa5454-2426-4d82-87b3-d52836b961a0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:22.676419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-befa5454-2426-4d82-87b3-d52836b961a0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:22.677552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-befa5454-2426-4d82-87b3-d52836b961a0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:22.679775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-befa5454-2426-4d82-87b3-d52836b961a0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:22.680387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-befa5454-2426-4d82-87b3-d52836b961a0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:22.698873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:40:22.699469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:40:22.699742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:40:22.700142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:40:22.700544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:40:22.713038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:22.713559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:22.714453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:22.714865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:22.747088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Getting quotas for project 8912a4453d094df58486417ebacfa14c. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:40:22.756666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Getting quotas for user 0b818be48fe94da3b7b0c1585d1a376b and project 8912a4453d094df58486417ebacfa14c. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:40:22.788865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:40:22.798360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:40:22.832118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-befa5454-2426-4d82-87b3-d52836b961a0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:22.845124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-befa5454-2426-4d82-87b3-d52836b961a0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.197100 Jul 14 09:40:22.845829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 210/400] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:22 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:22.852564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f0dde0c3-800d-4f46-8b7c-83586bc72b25 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:22.859146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f0dde0c3-800d-4f46-8b7c-83586bc72b25 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:22.867443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0dde0c3-800d-4f46-8b7c-83586bc72b25 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:22.867891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0dde0c3-800d-4f46-8b7c-83586bc72b25 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:22.868670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0dde0c3-800d-4f46-8b7c-83586bc72b25 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:22.869103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0dde0c3-800d-4f46-8b7c-83586bc72b25 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:22.869480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9603e4fd-5e65-4986-9071-5234d526268e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.237356 Jul 14 09:40:22.878375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 191/401] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:40:22.883616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:22.893110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:22.894909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Searching by: {'deleted': False, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e'} {{(pid=129537) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 09:40:22.913355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:22.913603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:22.915755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:22.916197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:23.105544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f0dde0c3-800d-4f46-8b7c-83586bc72b25 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:23.115244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f0dde0c3-800d-4f46-8b7c-83586bc72b25 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.267992 Jul 14 09:40:23.115836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 211/402] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:22 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:23.127455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-19e58ef9-c0f2-428e-bd14-550a42a1faff tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:23.128415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-19e58ef9-c0f2-428e-bd14-550a42a1faff tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:23.153613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.multi_cell_list [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129537) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 09:40:23.246586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-19e58ef9-c0f2-428e-bd14-550a42a1faff tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:23.253687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-19e58ef9-c0f2-428e-bd14-550a42a1faff tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1214 microversion: 2.1 time: 0.136564 Jul 14 09:40:23.257614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 212/403] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:23 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:23.367474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b8a37376-f607-436c-8d30-d984b7126b4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.487865 Jul 14 09:40:23.368427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 192/404] 10.222.0.40 () {58 vars in 1124 bytes} [Thu Jul 14 09:40:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:23.379478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-47a1f564-490e-4217-8152-81896aea8c58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:23.382933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-47a1f564-490e-4217-8152-81896aea8c58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:23.391181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-47a1f564-490e-4217-8152-81896aea8c58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:23.391866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-47a1f564-490e-4217-8152-81896aea8c58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:23.392355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-47a1f564-490e-4217-8152-81896aea8c58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:23.392745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-47a1f564-490e-4217-8152-81896aea8c58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:23.683845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-47a1f564-490e-4217-8152-81896aea8c58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:23.692533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-47a1f564-490e-4217-8152-81896aea8c58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1549 microversion: 2.1 time: 0.316911 Jul 14 09:40:23.693111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 213/405] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1549 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:23.863301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f521b65e-8d73-4704-bec7-6d7b62bc8933 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:23.863917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f521b65e-8d73-4704-bec7-6d7b62bc8933 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:23.877670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f521b65e-8d73-4704-bec7-6d7b62bc8933 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:23.878575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f521b65e-8d73-4704-bec7-6d7b62bc8933 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:23.879723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f521b65e-8d73-4704-bec7-6d7b62bc8933 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:23.880929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f521b65e-8d73-4704-bec7-6d7b62bc8933 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:24.133833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-257b7f37-39b7-4e82-afe7-61a669ef2030 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:24.134243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-257b7f37-39b7-4e82-afe7-61a669ef2030 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:24.153032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-257b7f37-39b7-4e82-afe7-61a669ef2030 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:24.153685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-257b7f37-39b7-4e82-afe7-61a669ef2030 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:24.154683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-257b7f37-39b7-4e82-afe7-61a669ef2030 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:24.162919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-257b7f37-39b7-4e82-afe7-61a669ef2030 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:24.192721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f521b65e-8d73-4704-bec7-6d7b62bc8933 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:24.214983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f521b65e-8d73-4704-bec7-6d7b62bc8933 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.355793 Jul 14 09:40:24.225999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 193/406] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:23 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:24.279140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9ed3d69f-5dc8-4b58-93d9-1a64e2a90a1c tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:24.280837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9ed3d69f-5dc8-4b58-93d9-1a64e2a90a1c tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:24.307884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ed3d69f-5dc8-4b58-93d9-1a64e2a90a1c tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:24.312470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ed3d69f-5dc8-4b58-93d9-1a64e2a90a1c tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:24.318035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ed3d69f-5dc8-4b58-93d9-1a64e2a90a1c tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:24.320480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ed3d69f-5dc8-4b58-93d9-1a64e2a90a1c tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:24.476047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-257b7f37-39b7-4e82-afe7-61a669ef2030 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:24.503191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-257b7f37-39b7-4e82-afe7-61a669ef2030 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.369724 Jul 14 09:40:24.506060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 214/407] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:24 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:24.526298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9ed3d69f-5dc8-4b58-93d9-1a64e2a90a1c tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:24.540579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9ed3d69f-5dc8-4b58-93d9-1a64e2a90a1c tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1218 microversion: 2.1 time: 0.267755 Jul 14 09:40:24.541479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 194/408] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:24 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1218 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:25.245273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dbe54385-5af4-430d-be44-4ee8cf8ef53e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:25.245891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dbe54385-5af4-430d-be44-4ee8cf8ef53e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:25.254371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dbe54385-5af4-430d-be44-4ee8cf8ef53e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:25.254830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dbe54385-5af4-430d-be44-4ee8cf8ef53e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:25.255712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dbe54385-5af4-430d-be44-4ee8cf8ef53e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:25.256151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dbe54385-5af4-430d-be44-4ee8cf8ef53e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:25.457672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dbe54385-5af4-430d-be44-4ee8cf8ef53e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:25.470542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dbe54385-5af4-430d-be44-4ee8cf8ef53e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.226181 Jul 14 09:40:25.482931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 215/409] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:25 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:25.525022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-68551683-89f4-44dc-a09a-ee372fa62a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:25.528055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-68551683-89f4-44dc-a09a-ee372fa62a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:25.539172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68551683-89f4-44dc-a09a-ee372fa62a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:25.540229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68551683-89f4-44dc-a09a-ee372fa62a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:25.540954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68551683-89f4-44dc-a09a-ee372fa62a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:25.542032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68551683-89f4-44dc-a09a-ee372fa62a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:25.562154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4e84fbbb-3371-4405-94db-31bc6847e1dd tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:25.562807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4e84fbbb-3371-4405-94db-31bc6847e1dd tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:25.576728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e84fbbb-3371-4405-94db-31bc6847e1dd tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:25.577260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e84fbbb-3371-4405-94db-31bc6847e1dd tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:25.578055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e84fbbb-3371-4405-94db-31bc6847e1dd tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:25.582940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e84fbbb-3371-4405-94db-31bc6847e1dd tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:25.594175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:25.756925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-68551683-89f4-44dc-a09a-ee372fa62a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:25.764714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-68551683-89f4-44dc-a09a-ee372fa62a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.245675 Jul 14 09:40:25.768789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 195/410] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:25 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:25.776725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4e84fbbb-3371-4405-94db-31bc6847e1dd tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:25.781941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-81969ae8-1896-43e3-a90e-51ea59178082 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecf82858-1f8b-4a2f-ace7-782f73848dc8"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:25.784407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-81969ae8-1896-43e3-a90e-51ea59178082 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:25.787349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4e84fbbb-3371-4405-94db-31bc6847e1dd tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1266 microversion: 2.1 time: 0.230041 Jul 14 09:40:25.794745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81969ae8-1896-43e3-a90e-51ea59178082 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:25.795551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81969ae8-1896-43e3-a90e-51ea59178082 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:25.796533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81969ae8-1896-43e3-a90e-51ea59178082 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:25.797109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81969ae8-1896-43e3-a90e-51ea59178082 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:25.798958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 216/411] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:25 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:26.190721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-81969ae8-1896-43e3-a90e-51ea59178082 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418764 Jul 14 09:40:26.191703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 196/412] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 09:40:25 2022] POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:26.489783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-70b51952-40e6-4734-8d68-312136b22ef1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:26.490498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-70b51952-40e6-4734-8d68-312136b22ef1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:26.498483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-70b51952-40e6-4734-8d68-312136b22ef1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:26.499049 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-70b51952-40e6-4734-8d68-312136b22ef1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:26.499886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-70b51952-40e6-4734-8d68-312136b22ef1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:26.500407 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-70b51952-40e6-4734-8d68-312136b22ef1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:26.685205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-70b51952-40e6-4734-8d68-312136b22ef1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:26.695445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-70b51952-40e6-4734-8d68-312136b22ef1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.209333 Jul 14 09:40:26.696491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 217/413] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:26 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:26.784796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8c86da1b-4e00-4a96-bd7d-59e750f05129 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:26.785696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8c86da1b-4e00-4a96-bd7d-59e750f05129 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:26.792672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c86da1b-4e00-4a96-bd7d-59e750f05129 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:26.793687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c86da1b-4e00-4a96-bd7d-59e750f05129 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:26.795974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c86da1b-4e00-4a96-bd7d-59e750f05129 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:26.796691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c86da1b-4e00-4a96-bd7d-59e750f05129 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:26.987391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8c86da1b-4e00-4a96-bd7d-59e750f05129 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:26.989707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-08bbd2c0-6401-4733-8202-a3ff633526cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Action: 'create', calling method: .version_select at 0x7f7da1d92160>, body: {"keypair": {"name": "tempest-TestShelveInstance-123116946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHSlAWzBKU6zrWmvxvmGrpp5YGmDlRbdDNJAEFilYAy94kIjMyF9IxMvOfhK+nTDthbi330Wk+o0ck6qhk51Ez09mqcfK1qDeEJwBKQXXsDlT4KZTFPku3Ik39ehR+GAg=="}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:26.997095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8c86da1b-4e00-4a96-bd7d-59e750f05129 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.216020 Jul 14 09:40:26.998442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 218/414] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:26 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:27.003694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f30f3bda-c2a6-41ea-9d23-907957ce275f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:27.004590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f30f3bda-c2a6-41ea-9d23-907957ce275f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:27.012415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f30f3bda-c2a6-41ea-9d23-907957ce275f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:27.013377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f30f3bda-c2a6-41ea-9d23-907957ce275f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:27.014410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f30f3bda-c2a6-41ea-9d23-907957ce275f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:27.015288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f30f3bda-c2a6-41ea-9d23-907957ce275f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:27.023407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-08bbd2c0-6401-4733-8202-a3ff633526cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Getting quotas for project a28617ad1f8d40faa7d2e317b32951ab. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:40:27.029138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-08bbd2c0-6401-4733-8202-a3ff633526cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Getting quotas for user 27cfaef90a5048569453430e75c4c42b and project a28617ad1f8d40faa7d2e317b32951ab. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:40:27.060266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-08bbd2c0-6401-4733-8202-a3ff633526cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.307390 Jul 14 09:40:27.067971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 197/415] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 09:40:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:27.090039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f30f3bda-c2a6-41ea-9d23-907957ce275f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:27.111388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f30f3bda-c2a6-41ea-9d23-907957ce275f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1272 microversion: 2.1 time: 0.108243 Jul 14 09:40:27.122248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 219/416] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:26 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:27.713108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d1f934af-1c3e-4558-b35c-4a268d552003 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:27.713825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d1f934af-1c3e-4558-b35c-4a268d552003 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:27.721189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1f934af-1c3e-4558-b35c-4a268d552003 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:27.721780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1f934af-1c3e-4558-b35c-4a268d552003 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:27.722499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1f934af-1c3e-4558-b35c-4a268d552003 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:27.722929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1f934af-1c3e-4558-b35c-4a268d552003 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:27.922669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d1f934af-1c3e-4558-b35c-4a268d552003 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:27.931024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d1f934af-1c3e-4558-b35c-4a268d552003 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.222292 Jul 14 09:40:27.931914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 198/417] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:27 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:28.016004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9687a5a7-55b2-4700-8688-cfb22a436a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:28.016617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9687a5a7-55b2-4700-8688-cfb22a436a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:28.023309 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9687a5a7-55b2-4700-8688-cfb22a436a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:28.023752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9687a5a7-55b2-4700-8688-cfb22a436a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:28.024547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9687a5a7-55b2-4700-8688-cfb22a436a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:28.025038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9687a5a7-55b2-4700-8688-cfb22a436a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:28.139191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1d46f4eb-f2f4-435c-9d99-51b75efb17ee tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:28.139808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1d46f4eb-f2f4-435c-9d99-51b75efb17ee tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:28.146357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d46f4eb-f2f4-435c-9d99-51b75efb17ee tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:28.146830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d46f4eb-f2f4-435c-9d99-51b75efb17ee tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:28.147785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d46f4eb-f2f4-435c-9d99-51b75efb17ee tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:28.148217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d46f4eb-f2f4-435c-9d99-51b75efb17ee tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:28.266812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9687a5a7-55b2-4700-8688-cfb22a436a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:28.315068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9687a5a7-55b2-4700-8688-cfb22a436a48 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.304467 Jul 14 09:40:28.316571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 220/418] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:28 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:28.381023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1d46f4eb-f2f4-435c-9d99-51b75efb17ee tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:28.389230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1d46f4eb-f2f4-435c-9d99-51b75efb17ee tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.254073 Jul 14 09:40:28.390102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 199/419] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:28 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:28.954766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-657a1e42-213a-4e16-9984-0e3feecb063a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:28.955391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-657a1e42-213a-4e16-9984-0e3feecb063a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:28.967777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-657a1e42-213a-4e16-9984-0e3feecb063a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:28.968448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-657a1e42-213a-4e16-9984-0e3feecb063a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:28.969400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-657a1e42-213a-4e16-9984-0e3feecb063a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:28.969832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-657a1e42-213a-4e16-9984-0e3feecb063a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:29.162039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-657a1e42-213a-4e16-9984-0e3feecb063a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:29.174040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-657a1e42-213a-4e16-9984-0e3feecb063a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.229311 Jul 14 09:40:29.177965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 221/420] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:28 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:29.332946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-82a4e6f9-e3a7-4efe-944b-22bb8ae5ce4c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:29.333810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-82a4e6f9-e3a7-4efe-944b-22bb8ae5ce4c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:29.341533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82a4e6f9-e3a7-4efe-944b-22bb8ae5ce4c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:29.342265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82a4e6f9-e3a7-4efe-944b-22bb8ae5ce4c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:29.343019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82a4e6f9-e3a7-4efe-944b-22bb8ae5ce4c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:29.343605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82a4e6f9-e3a7-4efe-944b-22bb8ae5ce4c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:29.410158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-693f90a2-782a-49d2-bd54-f1626546ff0b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:29.411915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-693f90a2-782a-49d2-bd54-f1626546ff0b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:29.419758 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-693f90a2-782a-49d2-bd54-f1626546ff0b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:29.420318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-693f90a2-782a-49d2-bd54-f1626546ff0b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:29.422284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-693f90a2-782a-49d2-bd54-f1626546ff0b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:29.423019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-693f90a2-782a-49d2-bd54-f1626546ff0b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:29.534831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-82a4e6f9-e3a7-4efe-944b-22bb8ae5ce4c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:29.562761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-82a4e6f9-e3a7-4efe-944b-22bb8ae5ce4c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.233366 Jul 14 09:40:29.564349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 200/421] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:29 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:29.636059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-693f90a2-782a-49d2-bd54-f1626546ff0b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:29.645395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-693f90a2-782a-49d2-bd54-f1626546ff0b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.241558 Jul 14 09:40:29.646145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 222/422] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:29 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:29.729954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-95def913-2249-4316-971b-d89d224122e0 req-ea9c2aff-7611-4ea9-a259-825de5bc3a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f5dc6c-cabd-4614-8070-a592be81bf9b", "tag": "72db6974-621b-4392-a68d-a40c3296c41a"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:29.745083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-95def913-2249-4316-971b-d89d224122e0 req-ea9c2aff-7611-4ea9-a259-825de5bc3a8c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:29.745814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-95def913-2249-4316-971b-d89d224122e0 req-ea9c2aff-7611-4ea9-a259-825de5bc3a8c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:29.753735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-87fe694a-aa1e-49ff-8bfd-3d5c0af245e7 req-c58ee799-bf78-4fa4-bf18-888d3afe93cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f265cbd-76a7-486d-873c-085ab051c168", "name": "network-vif-plugged", "status": "completed", "tag": "dd8d169f-9a71-4f5d-a383-3bbcf7e20150"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:29.758623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-95def913-2249-4316-971b-d89d224122e0 req-ea9c2aff-7611-4ea9-a259-825de5bc3a8c service nova] Creating event network-changed:72db6974-621b-4392-a68d-a40c3296c41a for instance c7f5dc6c-cabd-4614-8070-a592be81bf9b on hv-cinder-82549 Jul 14 09:40:29.763239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-95def913-2249-4316-971b-d89d224122e0 req-ea9c2aff-7611-4ea9-a259-825de5bc3a8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038850 Jul 14 09:40:29.763854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-87fe694a-aa1e-49ff-8bfd-3d5c0af245e7 req-c58ee799-bf78-4fa4-bf18-888d3afe93cc service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:29.764197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 201/423] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:29.764574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-87fe694a-aa1e-49ff-8bfd-3d5c0af245e7 req-c58ee799-bf78-4fa4-bf18-888d3afe93cc service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:29.777799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-87fe694a-aa1e-49ff-8bfd-3d5c0af245e7 req-c58ee799-bf78-4fa4-bf18-888d3afe93cc service nova] Creating event network-vif-plugged:dd8d169f-9a71-4f5d-a383-3bbcf7e20150 for instance 7f265cbd-76a7-486d-873c-085ab051c168 on hv-cinder-82549 Jul 14 09:40:29.785209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-87fe694a-aa1e-49ff-8bfd-3d5c0af245e7 req-c58ee799-bf78-4fa4-bf18-888d3afe93cc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035345 Jul 14 09:40:29.786176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 223/424] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:30.191962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-709ce42a-da02-4b69-a0b4-041392f62ed2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:30.192690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-709ce42a-da02-4b69-a0b4-041392f62ed2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:30.199253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-709ce42a-da02-4b69-a0b4-041392f62ed2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:30.199698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-709ce42a-da02-4b69-a0b4-041392f62ed2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:30.200465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-709ce42a-da02-4b69-a0b4-041392f62ed2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:30.200898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-709ce42a-da02-4b69-a0b4-041392f62ed2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:30.338397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-709ce42a-da02-4b69-a0b4-041392f62ed2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:30.351001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-709ce42a-da02-4b69-a0b4-041392f62ed2 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.163387 Jul 14 09:40:30.351585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 202/425] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:30 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:30.581167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6f0fa719-fbeb-44ec-bcb7-5354dda60fd6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:30.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6f0fa719-fbeb-44ec-bcb7-5354dda60fd6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:30.589940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f0fa719-fbeb-44ec-bcb7-5354dda60fd6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:30.590794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f0fa719-fbeb-44ec-bcb7-5354dda60fd6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:30.592266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f0fa719-fbeb-44ec-bcb7-5354dda60fd6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:30.592707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f0fa719-fbeb-44ec-bcb7-5354dda60fd6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:30.597669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:30.664183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-05d6aeb0-64db-42e1-881f-f0d38045d1a4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:30.665205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-05d6aeb0-64db-42e1-881f-f0d38045d1a4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:30.672274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-05d6aeb0-64db-42e1-881f-f0d38045d1a4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:30.672806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-05d6aeb0-64db-42e1-881f-f0d38045d1a4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:30.673681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-05d6aeb0-64db-42e1-881f-f0d38045d1a4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:30.674330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-05d6aeb0-64db-42e1-881f-f0d38045d1a4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:30.832747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6f0fa719-fbeb-44ec-bcb7-5354dda60fd6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:30.841170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6f0fa719-fbeb-44ec-bcb7-5354dda60fd6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.264465 Jul 14 09:40:30.841731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 224/426] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:30 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:30.860361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-05d6aeb0-64db-42e1-881f-f0d38045d1a4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:30.867861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-05d6aeb0-64db-42e1-881f-f0d38045d1a4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.208611 Jul 14 09:40:30.868434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 203/427] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:30 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:31.368066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6ea314de-ea5d-4446-bac0-2a09192cf3e8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:31.368683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6ea314de-ea5d-4446-bac0-2a09192cf3e8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:31.374945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ea314de-ea5d-4446-bac0-2a09192cf3e8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:31.375431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ea314de-ea5d-4446-bac0-2a09192cf3e8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:31.376207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ea314de-ea5d-4446-bac0-2a09192cf3e8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:31.376652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ea314de-ea5d-4446-bac0-2a09192cf3e8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:31.515909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6ea314de-ea5d-4446-bac0-2a09192cf3e8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:31.524922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6ea314de-ea5d-4446-bac0-2a09192cf3e8 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.161124 Jul 14 09:40:31.526855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 225/428] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:31 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:31.859524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d6ff23fe-f6d9-4aa9-bc1d-7d9446b05faf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:31.860062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d6ff23fe-f6d9-4aa9-bc1d-7d9446b05faf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:31.867211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6ff23fe-f6d9-4aa9-bc1d-7d9446b05faf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:31.867659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6ff23fe-f6d9-4aa9-bc1d-7d9446b05faf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:31.868421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6ff23fe-f6d9-4aa9-bc1d-7d9446b05faf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:31.868883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6ff23fe-f6d9-4aa9-bc1d-7d9446b05faf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:31.883724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ea7ac7b5-7189-443d-a01a-65ac8b0487cf tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:31.884387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ea7ac7b5-7189-443d-a01a-65ac8b0487cf tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:31.891193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea7ac7b5-7189-443d-a01a-65ac8b0487cf tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:31.891655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea7ac7b5-7189-443d-a01a-65ac8b0487cf tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:31.892405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea7ac7b5-7189-443d-a01a-65ac8b0487cf tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:31.892836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea7ac7b5-7189-443d-a01a-65ac8b0487cf tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:32.074641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d6ff23fe-f6d9-4aa9-bc1d-7d9446b05faf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:32.084051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d6ff23fe-f6d9-4aa9-bc1d-7d9446b05faf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.228107 Jul 14 09:40:32.085700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 204/429] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:31 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:32.115027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ea7ac7b5-7189-443d-a01a-65ac8b0487cf tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:32.123807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ea7ac7b5-7189-443d-a01a-65ac8b0487cf tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.243957 Jul 14 09:40:32.124490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 226/430] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:31 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:32.542083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6640c9bc-3026-4eba-aba1-8b3a3794f4ee tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:32.542730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6640c9bc-3026-4eba-aba1-8b3a3794f4ee tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:32.549419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6640c9bc-3026-4eba-aba1-8b3a3794f4ee tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:32.549868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6640c9bc-3026-4eba-aba1-8b3a3794f4ee tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:32.550792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6640c9bc-3026-4eba-aba1-8b3a3794f4ee tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:32.551233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6640c9bc-3026-4eba-aba1-8b3a3794f4ee tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:32.771475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6640c9bc-3026-4eba-aba1-8b3a3794f4ee tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:32.779899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6640c9bc-3026-4eba-aba1-8b3a3794f4ee tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1502 microversion: 2.1 time: 0.241783 Jul 14 09:40:32.782824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 205/431] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:32 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:32.798731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b64f848-aa2d-4787-84ef-a21c372147e1"}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:32.800224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:32.807694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:32.808483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:32.809512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:32.810163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:32.845179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Cannot 'attach_volume' instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 while it is in vm_state rescued Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: POST /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1/os-volume_attachments HTTP/1.1 Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 74 Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:40:32.847304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {"volumeAttachment": {"volumeId": "3b64f848-aa2d-4787-84ef-a21c372147e1"}} Jul 14 09:40:32.848785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Cannot 'attach_volume' instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 while it is in vm_state rescued Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1', 'body': {'volumeAttachment': {'volumeId': '3b64f848-aa2d-4787-84ef-a21c372147e1'}}} Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:40:32.849662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 while it is in vm_state rescued Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:40:32.851306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:40:32.852845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:40:32.852845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:40:32.852845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 while it is in vm_state rescued Jul 14 09:40:32.852845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:40:32.854170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 409 to user: Cannot 'attach_volume' instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 while it is in vm_state rescued {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:40:32.855220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f21c1b16-7c17-4eac-af85-d16367d32231 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061481 Jul 14 09:40:32.866083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bbd12d10-2a1d-47b0-9b6d-57efec22d0bf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:32.866771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bbd12d10-2a1d-47b0-9b6d-57efec22d0bf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:32.870367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 227/432] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 09:40:32 2022] POST /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1/os-volume_attachments => generated 152 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 09:40:32.874708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbd12d10-2a1d-47b0-9b6d-57efec22d0bf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:32.875466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbd12d10-2a1d-47b0-9b6d-57efec22d0bf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:32.876611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbd12d10-2a1d-47b0-9b6d-57efec22d0bf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:32.877209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbd12d10-2a1d-47b0-9b6d-57efec22d0bf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:32.947744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bbd12d10-2a1d-47b0-9b6d-57efec22d0bf tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1/action" status: 202 len: 0 microversion: 2.1 time: 0.086126 Jul 14 09:40:32.948437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 206/433] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:40:32 2022] POST /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:40:32.956740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-be242647-a804-431f-be53-7779d26e5b81 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:32.957599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-be242647-a804-431f-be53-7779d26e5b81 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:32.965862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be242647-a804-431f-be53-7779d26e5b81 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:32.966346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be242647-a804-431f-be53-7779d26e5b81 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:32.967303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be242647-a804-431f-be53-7779d26e5b81 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:32.967738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be242647-a804-431f-be53-7779d26e5b81 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:33.097972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:33.103024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-11816741-0b64-418f-bd83-f38d132752e2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:33.103750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-11816741-0b64-418f-bd83-f38d132752e2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:33.111918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11816741-0b64-418f-bd83-f38d132752e2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:33.112357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11816741-0b64-418f-bd83-f38d132752e2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:33.113258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11816741-0b64-418f-bd83-f38d132752e2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:33.113686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11816741-0b64-418f-bd83-f38d132752e2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:33.150370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-be242647-a804-431f-be53-7779d26e5b81 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:33.159421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-be242647-a804-431f-be53-7779d26e5b81 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1510 microversion: 2.1 time: 0.206686 Jul 14 09:40:33.167581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 228/434] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:32 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:33.183878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7c95885c-4d65-487b-85d9-37e836f9ff9b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:33.184578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7c95885c-4d65-487b-85d9-37e836f9ff9b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:33.191012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c95885c-4d65-487b-85d9-37e836f9ff9b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:33.192034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c95885c-4d65-487b-85d9-37e836f9ff9b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:33.193804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c95885c-4d65-487b-85d9-37e836f9ff9b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:33.194531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c95885c-4d65-487b-85d9-37e836f9ff9b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:33.253271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:33.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-11816741-0b64-418f-bd83-f38d132752e2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:33.318955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-11816741-0b64-418f-bd83-f38d132752e2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.221724 Jul 14 09:40:33.319829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 207/435] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:33 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:33.373136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7c95885c-4d65-487b-85d9-37e836f9ff9b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:33.380888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7c95885c-4d65-487b-85d9-37e836f9ff9b tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.211978 Jul 14 09:40:33.381491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 229/436] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:33 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:34.178643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fb6cb62e-3478-444c-8cba-feb71bffdd19 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:34.179503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fb6cb62e-3478-444c-8cba-feb71bffdd19 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:34.185583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb6cb62e-3478-444c-8cba-feb71bffdd19 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:34.186022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb6cb62e-3478-444c-8cba-feb71bffdd19 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:34.186807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb6cb62e-3478-444c-8cba-feb71bffdd19 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:34.187229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb6cb62e-3478-444c-8cba-feb71bffdd19 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:34.320771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fb6cb62e-3478-444c-8cba-feb71bffdd19 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:34.328229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fb6cb62e-3478-444c-8cba-feb71bffdd19 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1510 microversion: 2.1 time: 0.153992 Jul 14 09:40:34.328812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 208/437] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:34 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:34.335374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bfd222f0-0fad-4cd7-983d-9528e99b3d94 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:34.335984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bfd222f0-0fad-4cd7-983d-9528e99b3d94 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:34.344960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd222f0-0fad-4cd7-983d-9528e99b3d94 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:34.345582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd222f0-0fad-4cd7-983d-9528e99b3d94 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:34.346583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd222f0-0fad-4cd7-983d-9528e99b3d94 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:34.347116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd222f0-0fad-4cd7-983d-9528e99b3d94 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:34.401052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7cdb0d7d-6b46-4ee0-a8d4-95b59c90c805 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:34.402093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7cdb0d7d-6b46-4ee0-a8d4-95b59c90c805 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:34.411900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cdb0d7d-6b46-4ee0-a8d4-95b59c90c805 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:34.412349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cdb0d7d-6b46-4ee0-a8d4-95b59c90c805 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:34.413116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cdb0d7d-6b46-4ee0-a8d4-95b59c90c805 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:34.413543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cdb0d7d-6b46-4ee0-a8d4-95b59c90c805 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:34.556748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bfd222f0-0fad-4cd7-983d-9528e99b3d94 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:34.564620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bfd222f0-0fad-4cd7-983d-9528e99b3d94 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.233280 Jul 14 09:40:34.565188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 230/438] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:34 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:34.593696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7cdb0d7d-6b46-4ee0-a8d4-95b59c90c805 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:34.602320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7cdb0d7d-6b46-4ee0-a8d4-95b59c90c805 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.208402 Jul 14 09:40:34.602897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 209/439] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:34 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:35.345639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cdcc75b6-aa2c-4ba4-91c5-cc9f6c59f4f0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:35.346298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cdcc75b6-aa2c-4ba4-91c5-cc9f6c59f4f0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:35.353039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cdcc75b6-aa2c-4ba4-91c5-cc9f6c59f4f0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:35.353485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cdcc75b6-aa2c-4ba4-91c5-cc9f6c59f4f0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:35.354278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cdcc75b6-aa2c-4ba4-91c5-cc9f6c59f4f0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:35.354721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cdcc75b6-aa2c-4ba4-91c5-cc9f6c59f4f0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:35.493551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cdcc75b6-aa2c-4ba4-91c5-cc9f6c59f4f0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:35.500951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cdcc75b6-aa2c-4ba4-91c5-cc9f6c59f4f0 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1510 microversion: 2.1 time: 0.159722 Jul 14 09:40:35.501496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 231/440] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:35 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:35.581958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-62e153f0-502a-4452-b71a-9183eba4218d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:35.582590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-62e153f0-502a-4452-b71a-9183eba4218d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:35.592079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-62e153f0-502a-4452-b71a-9183eba4218d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:35.593485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-62e153f0-502a-4452-b71a-9183eba4218d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:35.594299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-62e153f0-502a-4452-b71a-9183eba4218d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:35.594740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-62e153f0-502a-4452-b71a-9183eba4218d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:35.619269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e794fe7d-032f-4e10-bc8e-802eba76a71f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:35.619875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e794fe7d-032f-4e10-bc8e-802eba76a71f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:35.626037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e794fe7d-032f-4e10-bc8e-802eba76a71f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:35.626513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e794fe7d-032f-4e10-bc8e-802eba76a71f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:35.627275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e794fe7d-032f-4e10-bc8e-802eba76a71f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:35.627708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e794fe7d-032f-4e10-bc8e-802eba76a71f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:35.809375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-62e153f0-502a-4452-b71a-9183eba4218d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:35.817560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e794fe7d-032f-4e10-bc8e-802eba76a71f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:35.817922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-62e153f0-502a-4452-b71a-9183eba4218d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1368 microversion: 2.1 time: 0.239575 Jul 14 09:40:35.818792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 210/441] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:35 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:35.827632 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e794fe7d-032f-4e10-bc8e-802eba76a71f tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.211929 Jul 14 09:40:35.828679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 232/442] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:35 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:36.518825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-daad0353-4fbd-4ac6-9c57-f98265902dd3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:36.519430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-daad0353-4fbd-4ac6-9c57-f98265902dd3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:36.526153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-daad0353-4fbd-4ac6-9c57-f98265902dd3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:36.526689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-daad0353-4fbd-4ac6-9c57-f98265902dd3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:36.527500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-daad0353-4fbd-4ac6-9c57-f98265902dd3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:36.527934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-daad0353-4fbd-4ac6-9c57-f98265902dd3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:36.547788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:36.664198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-daad0353-4fbd-4ac6-9c57-f98265902dd3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:36.671985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-daad0353-4fbd-4ac6-9c57-f98265902dd3 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1510 microversion: 2.1 time: 0.157016 Jul 14 09:40:36.672550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 211/443] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:36 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:36.835771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-965f8f82-92da-4ce1-8f1e-d4e57e8e42a7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:36.836310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-965f8f82-92da-4ce1-8f1e-d4e57e8e42a7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:36.844627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-965f8f82-92da-4ce1-8f1e-d4e57e8e42a7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:36.845082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-965f8f82-92da-4ce1-8f1e-d4e57e8e42a7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:36.845841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-965f8f82-92da-4ce1-8f1e-d4e57e8e42a7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:36.845958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7cc4f7b7-5c7b-4d9a-ac6d-bb0df1232b2a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:36.846364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-965f8f82-92da-4ce1-8f1e-d4e57e8e42a7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:36.846527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7cc4f7b7-5c7b-4d9a-ac6d-bb0df1232b2a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:36.857449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cc4f7b7-5c7b-4d9a-ac6d-bb0df1232b2a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:36.857892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cc4f7b7-5c7b-4d9a-ac6d-bb0df1232b2a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:36.858707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cc4f7b7-5c7b-4d9a-ac6d-bb0df1232b2a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:36.859140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cc4f7b7-5c7b-4d9a-ac6d-bb0df1232b2a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:37.041504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=10 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:37.083443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-965f8f82-92da-4ce1-8f1e-d4e57e8e42a7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:37.087863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7cc4f7b7-5c7b-4d9a-ac6d-bb0df1232b2a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:37.092155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-965f8f82-92da-4ce1-8f1e-d4e57e8e42a7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1558 microversion: 2.1 time: 0.260545 Jul 14 09:40:37.092719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 233/444] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:36 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1558 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:37.095935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7cc4f7b7-5c7b-4d9a-ac6d-bb0df1232b2a tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.254171 Jul 14 09:40:37.096717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 212/445] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:36 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:37.108919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0ea2d351-5b6a-4125-aeaf-73944241b755 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:37.109408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0ea2d351-5b6a-4125-aeaf-73944241b755 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:37.117459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ea2d351-5b6a-4125-aeaf-73944241b755 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:37.117899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ea2d351-5b6a-4125-aeaf-73944241b755 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:37.118689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ea2d351-5b6a-4125-aeaf-73944241b755 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:37.119116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ea2d351-5b6a-4125-aeaf-73944241b755 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:37.197549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0ea2d351-5b6a-4125-aeaf-73944241b755 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092688 Jul 14 09:40:37.198138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 234/446] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 09:40:37 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:37.689503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4576ac43-6f22-4e49-8b24-64a3d8558493 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:37.690296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4576ac43-6f22-4e49-8b24-64a3d8558493 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:37.700862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4576ac43-6f22-4e49-8b24-64a3d8558493 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:37.700862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4576ac43-6f22-4e49-8b24-64a3d8558493 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:37.701462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4576ac43-6f22-4e49-8b24-64a3d8558493 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:37.702240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4576ac43-6f22-4e49-8b24-64a3d8558493 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:38.006597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4576ac43-6f22-4e49-8b24-64a3d8558493 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:38.014413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4576ac43-6f22-4e49-8b24-64a3d8558493 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1510 microversion: 2.1 time: 0.329365 Jul 14 09:40:38.014980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 213/447] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:37 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:38.113111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-64add178-2989-4c9f-b3a5-a33691e98a41 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:38.113812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-64add178-2989-4c9f-b3a5-a33691e98a41 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:38.119947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-64add178-2989-4c9f-b3a5-a33691e98a41 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:38.120388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-64add178-2989-4c9f-b3a5-a33691e98a41 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:38.121141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-64add178-2989-4c9f-b3a5-a33691e98a41 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:38.121576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-64add178-2989-4c9f-b3a5-a33691e98a41 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:38.677360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-64add178-2989-4c9f-b3a5-a33691e98a41 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:38.685487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-64add178-2989-4c9f-b3a5-a33691e98a41 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.576541 Jul 14 09:40:38.686092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 235/448] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:38 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:38.770019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-72c704fb-7a74-4a06-878f-18d881d754d3 req-94f948a4-afea-4578-a7e2-e1322902ed40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f265cbd-76a7-486d-873c-085ab051c168", "tag": "dd8d169f-9a71-4f5d-a383-3bbcf7e20150"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:38.780129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-72c704fb-7a74-4a06-878f-18d881d754d3 req-94f948a4-afea-4578-a7e2-e1322902ed40 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:38.780568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-72c704fb-7a74-4a06-878f-18d881d754d3 req-94f948a4-afea-4578-a7e2-e1322902ed40 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:38.795211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-72c704fb-7a74-4a06-878f-18d881d754d3 req-94f948a4-afea-4578-a7e2-e1322902ed40 service nova] Creating event network-changed:dd8d169f-9a71-4f5d-a383-3bbcf7e20150 for instance 7f265cbd-76a7-486d-873c-085ab051c168 on hv-cinder-82549 Jul 14 09:40:38.803175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-72c704fb-7a74-4a06-878f-18d881d754d3 req-94f948a4-afea-4578-a7e2-e1322902ed40 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037045 Jul 14 09:40:38.805272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 214/449] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:39.031706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-67f867fd-a53f-4da2-ad90-1b50ce900ed9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:39.032668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-67f867fd-a53f-4da2-ad90-1b50ce900ed9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:39.039703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-67f867fd-a53f-4da2-ad90-1b50ce900ed9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:39.040217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-67f867fd-a53f-4da2-ad90-1b50ce900ed9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:39.041058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-67f867fd-a53f-4da2-ad90-1b50ce900ed9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:39.041623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-67f867fd-a53f-4da2-ad90-1b50ce900ed9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:39.216520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-67f867fd-a53f-4da2-ad90-1b50ce900ed9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:39.224936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-67f867fd-a53f-4da2-ad90-1b50ce900ed9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1510 microversion: 2.1 time: 0.197036 Jul 14 09:40:39.226458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 236/450] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:39 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:39.313621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ddb64cf8-8fbd-4c34-bc96-04b8c880693b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:39.314469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ddb64cf8-8fbd-4c34-bc96-04b8c880693b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:39.320531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ddb64cf8-8fbd-4c34-bc96-04b8c880693b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:39.320974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ddb64cf8-8fbd-4c34-bc96-04b8c880693b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:39.321740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ddb64cf8-8fbd-4c34-bc96-04b8c880693b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:39.322168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ddb64cf8-8fbd-4c34-bc96-04b8c880693b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:39.467659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ddb64cf8-8fbd-4c34-bc96-04b8c880693b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:39.479522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ddb64cf8-8fbd-4c34-bc96-04b8c880693b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1595 microversion: 2.1 time: 0.169948 Jul 14 09:40:39.480457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 215/451] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1595 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:39.702852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-40abc0c7-f5be-4079-86cb-977fe6f873dc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:39.703464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-40abc0c7-f5be-4079-86cb-977fe6f873dc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:39.709853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-40abc0c7-f5be-4079-86cb-977fe6f873dc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:39.710939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-40abc0c7-f5be-4079-86cb-977fe6f873dc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:39.711718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-40abc0c7-f5be-4079-86cb-977fe6f873dc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:39.712149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-40abc0c7-f5be-4079-86cb-977fe6f873dc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:39.953761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-40abc0c7-f5be-4079-86cb-977fe6f873dc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:39.966024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-40abc0c7-f5be-4079-86cb-977fe6f873dc tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.267160 Jul 14 09:40:39.966824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 237/452] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:39 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:40.242933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3d347eea-94a4-4aa9-b956-c58010ff172d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:40.244090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3d347eea-94a4-4aa9-b956-c58010ff172d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:40.249884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-a8bf93c0-fcb5-49a4-ba02-7fde17019357 req-de5566ac-2a43-4dcc-b26b-9b77e138339a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f5dc6c-cabd-4614-8070-a592be81bf9b", "name": "network-vif-plugged", "status": "completed", "tag": "72db6974-621b-4392-a68d-a40c3296c41a"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:40.252495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d347eea-94a4-4aa9-b956-c58010ff172d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:40.253654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d347eea-94a4-4aa9-b956-c58010ff172d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:40.254948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d347eea-94a4-4aa9-b956-c58010ff172d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:40.256144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d347eea-94a4-4aa9-b956-c58010ff172d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:40.262506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-a8bf93c0-fcb5-49a4-ba02-7fde17019357 req-de5566ac-2a43-4dcc-b26b-9b77e138339a service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:40.263409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-a8bf93c0-fcb5-49a4-ba02-7fde17019357 req-de5566ac-2a43-4dcc-b26b-9b77e138339a service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:40.283241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-a8bf93c0-fcb5-49a4-ba02-7fde17019357 req-de5566ac-2a43-4dcc-b26b-9b77e138339a service nova] Creating event network-vif-plugged:72db6974-621b-4392-a68d-a40c3296c41a for instance c7f5dc6c-cabd-4614-8070-a592be81bf9b on hv-cinder-82549 Jul 14 09:40:40.291865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-a8bf93c0-fcb5-49a4-ba02-7fde17019357 req-de5566ac-2a43-4dcc-b26b-9b77e138339a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045651 Jul 14 09:40:40.292530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 238/453] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:40.506889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3d347eea-94a4-4aa9-b956-c58010ff172d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:40.515599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3d347eea-94a4-4aa9-b956-c58010ff172d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1510 microversion: 2.1 time: 0.276121 Jul 14 09:40:40.525058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 216/454] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:40 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:40.983528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ffe3359e-d6a2-4162-ae52-63da93d8969d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:40.984230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ffe3359e-d6a2-4162-ae52-63da93d8969d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:40.990475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffe3359e-d6a2-4162-ae52-63da93d8969d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:40.990924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffe3359e-d6a2-4162-ae52-63da93d8969d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:40.992198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffe3359e-d6a2-4162-ae52-63da93d8969d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:40.992636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffe3359e-d6a2-4162-ae52-63da93d8969d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:41.214842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ffe3359e-d6a2-4162-ae52-63da93d8969d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:41.222314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ffe3359e-d6a2-4162-ae52-63da93d8969d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.243049 Jul 14 09:40:41.228777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 239/455] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:40 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:41.487965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-96a24452-7222-41cc-a325-b152ca3c287f req-593adab8-a9e9-4c89-a9ec-306d00340ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e62e62e-be29-409c-a568-7269db0dba2d", "tag": "f3b4a515-5f24-4041-9e95-ef29a5325536"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:41.497220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-96a24452-7222-41cc-a325-b152ca3c287f req-593adab8-a9e9-4c89-a9ec-306d00340ac0 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:41.497651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-96a24452-7222-41cc-a325-b152ca3c287f req-593adab8-a9e9-4c89-a9ec-306d00340ac0 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:41.509151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-96a24452-7222-41cc-a325-b152ca3c287f req-593adab8-a9e9-4c89-a9ec-306d00340ac0 service nova] Creating event network-changed:f3b4a515-5f24-4041-9e95-ef29a5325536 for instance 9e62e62e-be29-409c-a568-7269db0dba2d on hv-cinder-82549 Jul 14 09:40:41.514792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-96a24452-7222-41cc-a325-b152ca3c287f req-593adab8-a9e9-4c89-a9ec-306d00340ac0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030386 Jul 14 09:40:41.518526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 217/456] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:41.532745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c3b092dd-05af-4700-a65f-6e96a9d51f69 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:41.533339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c3b092dd-05af-4700-a65f-6e96a9d51f69 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:41.540685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3b092dd-05af-4700-a65f-6e96a9d51f69 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:41.541099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3b092dd-05af-4700-a65f-6e96a9d51f69 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:41.542516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3b092dd-05af-4700-a65f-6e96a9d51f69 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:41.542955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3b092dd-05af-4700-a65f-6e96a9d51f69 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:41.735362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c3b092dd-05af-4700-a65f-6e96a9d51f69 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:41.744984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c3b092dd-05af-4700-a65f-6e96a9d51f69 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1510 microversion: 2.1 time: 0.216201 Jul 14 09:40:41.745800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 240/457] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:41 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:42.240911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d7c9c970-89af-4e2f-9819-307836311a8d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:42.241644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d7c9c970-89af-4e2f-9819-307836311a8d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:42.249380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7c9c970-89af-4e2f-9819-307836311a8d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:42.250530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7c9c970-89af-4e2f-9819-307836311a8d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:42.251439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7c9c970-89af-4e2f-9819-307836311a8d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:42.251814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7c9c970-89af-4e2f-9819-307836311a8d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:42.411414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d7c9c970-89af-4e2f-9819-307836311a8d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:42.419022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d7c9c970-89af-4e2f-9819-307836311a8d tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.182887 Jul 14 09:40:42.419889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 218/458] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:42 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:42.619711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-af95cd76-62af-4d0b-ba64-58080917d2f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-911171546"}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:42.620251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-af95cd76-62af-4d0b-ba64-58080917d2f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:42.629010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af95cd76-62af-4d0b-ba64-58080917d2f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:42.629574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af95cd76-62af-4d0b-ba64-58080917d2f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:42.630482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af95cd76-62af-4d0b-ba64-58080917d2f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:42.631030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af95cd76-62af-4d0b-ba64-58080917d2f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:42.763197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ed4d37b7-c357-4e13-bdb0-1887543d9a5c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:42.763738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ed4d37b7-c357-4e13-bdb0-1887543d9a5c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:42.770334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ed4d37b7-c357-4e13-bdb0-1887543d9a5c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:42.770974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ed4d37b7-c357-4e13-bdb0-1887543d9a5c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:42.771918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ed4d37b7-c357-4e13-bdb0-1887543d9a5c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:42.772536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ed4d37b7-c357-4e13-bdb0-1887543d9a5c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:42.772776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.network.security_group_api [None req-af95cd76-62af-4d0b-ba64-58080917d2f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Adding security group fbd19145-5841-42fb-ace0-5451917c968c to port f3b4a515-5f24-4041-9e95-ef29a5325536 Jul 14 09:40:43.274154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ed4d37b7-c357-4e13-bdb0-1887543d9a5c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:43.281755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ed4d37b7-c357-4e13-bdb0-1887543d9a5c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1516 microversion: 2.1 time: 0.522443 Jul 14 09:40:43.282346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 219/459] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:42 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1516 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:43.438797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f2c51917-cb25-44b3-bef7-1610cd8397d7 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:43.439405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f2c51917-cb25-44b3-bef7-1610cd8397d7 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:43.446047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f2c51917-cb25-44b3-bef7-1610cd8397d7 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:43.446851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f2c51917-cb25-44b3-bef7-1610cd8397d7 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:43.447798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f2c51917-cb25-44b3-bef7-1610cd8397d7 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:43.448432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f2c51917-cb25-44b3-bef7-1610cd8397d7 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:43.644043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-af95cd76-62af-4d0b-ba64-58080917d2f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/action" status: 202 len: 0 microversion: 2.1 time: 1.028941 Jul 14 09:40:43.644759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 241/460] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:40:42 2022] POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/action => generated 0 bytes in 1030 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:40:43.654064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ca4d498d-ff42-4389-8c0e-ad83c6f47b6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:43.654703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ca4d498d-ff42-4389-8c0e-ad83c6f47b6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:43.665243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ca4d498d-ff42-4389-8c0e-ad83c6f47b6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:43.665946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ca4d498d-ff42-4389-8c0e-ad83c6f47b6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:43.667000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ca4d498d-ff42-4389-8c0e-ad83c6f47b6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:43.667434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ca4d498d-ff42-4389-8c0e-ad83c6f47b6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:43.707803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:43.744383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f2c51917-cb25-44b3-bef7-1610cd8397d7 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:43.754249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f2c51917-cb25-44b3-bef7-1610cd8397d7 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.321855 Jul 14 09:40:43.755470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 220/461] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:43 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:43.760859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-eae56457-8a06-4b21-bf33-3a47c69bc5d2 req-0a2411bb-1bec-4cad-a0b4-4326a5b1aa8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e62e62e-be29-409c-a568-7269db0dba2d", "tag": "f3b4a515-5f24-4041-9e95-ef29a5325536"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:43.790375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:43.799502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-eae56457-8a06-4b21-bf33-3a47c69bc5d2 req-0a2411bb-1bec-4cad-a0b4-4326a5b1aa8c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:43.800223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-eae56457-8a06-4b21-bf33-3a47c69bc5d2 req-0a2411bb-1bec-4cad-a0b4-4326a5b1aa8c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:43.818075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-eae56457-8a06-4b21-bf33-3a47c69bc5d2 req-0a2411bb-1bec-4cad-a0b4-4326a5b1aa8c service nova] Creating event network-changed:f3b4a515-5f24-4041-9e95-ef29a5325536 for instance 9e62e62e-be29-409c-a568-7269db0dba2d on hv-cinder-82549 Jul 14 09:40:43.824411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-eae56457-8a06-4b21-bf33-3a47c69bc5d2 req-0a2411bb-1bec-4cad-a0b4-4326a5b1aa8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067660 Jul 14 09:40:43.825557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 221/462] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:43.941821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ca4d498d-ff42-4389-8c0e-ad83c6f47b6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:43.951029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ca4d498d-ff42-4389-8c0e-ad83c6f47b6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1641 microversion: 2.1 time: 0.300935 Jul 14 09:40:43.951840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 242/463] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1641 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:44.771483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-14db8500-7028-4291-84e6-5b90813322ad tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:44.772167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-14db8500-7028-4291-84e6-5b90813322ad tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:44.778373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14db8500-7028-4291-84e6-5b90813322ad tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:44.778816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14db8500-7028-4291-84e6-5b90813322ad tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:44.779815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14db8500-7028-4291-84e6-5b90813322ad tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:44.780251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14db8500-7028-4291-84e6-5b90813322ad tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:44.943979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14db8500-7028-4291-84e6-5b90813322ad tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:44.951935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-14db8500-7028-4291-84e6-5b90813322ad tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1314 microversion: 2.1 time: 0.184687 Jul 14 09:40:44.952492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 222/464] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:44 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:45.703026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-94468785-0562-498f-a9c8-df0677001062 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'create', calling method: .version_select at 0x7f7da26a33a0>, body: {"keypair": {"name": "tempest-keypair-362486394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdmKoylHfZ0pZ+PKmAiaRDt+V/Fd4koWpegFxjOQ7we6NVW4jN5fW5k2HSNOqjlL+yVeFfH5q8mzIy4BM0AhIaBI+ZH3LmWST0sOExEkZwxfn+lWljNngaFJc3xmilLMA=="}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:45.717915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-94468785-0562-498f-a9c8-df0677001062 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Getting quotas for project f35a70c5090a4570ad8ba3701dad3f80. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:40:45.721809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-94468785-0562-498f-a9c8-df0677001062 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Getting quotas for user f1d0b9390f474de79828a675d4e0646a and project f35a70c5090a4570ad8ba3701dad3f80. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:40:45.745635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-94468785-0562-498f-a9c8-df0677001062 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046393 Jul 14 09:40:45.746250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 243/465] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 09:40:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:45.969155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a59f0cea-d8a2-46c1-b72b-ddc7fa59df05 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:45.969848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a59f0cea-d8a2-46c1-b72b-ddc7fa59df05 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:45.976597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a59f0cea-d8a2-46c1-b72b-ddc7fa59df05 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:45.977033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a59f0cea-d8a2-46c1-b72b-ddc7fa59df05 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:45.977788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a59f0cea-d8a2-46c1-b72b-ddc7fa59df05 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:45.978241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a59f0cea-d8a2-46c1-b72b-ddc7fa59df05 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:46.208159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a59f0cea-d8a2-46c1-b72b-ddc7fa59df05 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:46.216621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a59f0cea-d8a2-46c1-b72b-ddc7fa59df05 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1497 microversion: 2.1 time: 0.251597 Jul 14 09:40:46.229579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 223/466] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:45 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:46.831426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-46b518ae-a3fd-4f7c-8b62-d96c19bab26e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:46.831949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-46b518ae-a3fd-4f7c-8b62-d96c19bab26e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:46.838755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46b518ae-a3fd-4f7c-8b62-d96c19bab26e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:46.839204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46b518ae-a3fd-4f7c-8b62-d96c19bab26e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:46.839956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46b518ae-a3fd-4f7c-8b62-d96c19bab26e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:46.840383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46b518ae-a3fd-4f7c-8b62-d96c19bab26e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:46.865876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-46b518ae-a3fd-4f7c-8b62-d96c19bab26e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:40:46.940224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:46.951398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-46b518ae-a3fd-4f7c-8b62-d96c19bab26e tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 204 len: 0 microversion: 2.1 time: 0.123608 Jul 14 09:40:46.951976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 244/467] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:40:46 2022] DELETE /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:40:46.960366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-79047097-7922-4d6b-b76d-1b5a15a49273 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:46.961044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-79047097-7922-4d6b-b76d-1b5a15a49273 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:46.967087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79047097-7922-4d6b-b76d-1b5a15a49273 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:46.967596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79047097-7922-4d6b-b76d-1b5a15a49273 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:46.968412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79047097-7922-4d6b-b76d-1b5a15a49273 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:46.968906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79047097-7922-4d6b-b76d-1b5a15a49273 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:47.206197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-79047097-7922-4d6b-b76d-1b5a15a49273 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:47.214290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-79047097-7922-4d6b-b76d-1b5a15a49273 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1503 microversion: 2.1 time: 0.258009 Jul 14 09:40:47.214852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 224/468] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:46 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:47.305906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-735928544", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f202f74-cfe8-4c79-b9f2-92b6b8371392"}], "security_groups": [{"name": "tempest-securitygroup--1102360989"}], "key_name": "tempest-keypair-362486394", "user_data": "}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:47.403994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] validate_networks() for [('9f202f74-cfe8-4c79-b9f2-92b6b8371392', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:40:47.774991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:40:47.775433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:40:47.775922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:40:47.776328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:40:47.776752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:40:47.785551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:47.785994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:47.786826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:47.787260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:47.804291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Getting quotas for project f35a70c5090a4570ad8ba3701dad3f80. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:40:47.808370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Getting quotas for user f1d0b9390f474de79828a675d4e0646a and project f35a70c5090a4570ad8ba3701dad3f80. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:40:47.819243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:40:47.821556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:40:47.867557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-109cbb63-eee8-4e20-96ef-f769ecf0a177 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.566873 Jul 14 09:40:47.873154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 245/469] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:40:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:40:47.878373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1f99d49c-1b10-4e99-bcdf-31da903dd036 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:47.879076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1f99d49c-1b10-4e99-bcdf-31da903dd036 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:47.937933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1f99d49c-1b10-4e99-bcdf-31da903dd036 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:47.946464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1f99d49c-1b10-4e99-bcdf-31da903dd036 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1244 microversion: 2.1 time: 0.071997 Jul 14 09:40:47.947601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 225/470] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:47 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1244 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:40:48.234619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dfd1e546-692b-4444-adbe-40c3bdfc48ab tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:48.235226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dfd1e546-692b-4444-adbe-40c3bdfc48ab tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:48.241305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dfd1e546-692b-4444-adbe-40c3bdfc48ab tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:48.241747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dfd1e546-692b-4444-adbe-40c3bdfc48ab tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:48.242533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dfd1e546-692b-4444-adbe-40c3bdfc48ab tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:48.242956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dfd1e546-692b-4444-adbe-40c3bdfc48ab tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:48.377235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dfd1e546-692b-4444-adbe-40c3bdfc48ab tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:48.385239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dfd1e546-692b-4444-adbe-40c3bdfc48ab tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1503 microversion: 2.1 time: 0.154491 Jul 14 09:40:48.385800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 246/471] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:48 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:48.964162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-701be498-bd9c-4545-abde-ec626b9ad78a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:48.964758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-701be498-bd9c-4545-abde-ec626b9ad78a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:48.971681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-701be498-bd9c-4545-abde-ec626b9ad78a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:48.972122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-701be498-bd9c-4545-abde-ec626b9ad78a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:48.972866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-701be498-bd9c-4545-abde-ec626b9ad78a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:48.973560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-701be498-bd9c-4545-abde-ec626b9ad78a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:49.033445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-701be498-bd9c-4545-abde-ec626b9ad78a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:49.041493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-701be498-bd9c-4545-abde-ec626b9ad78a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1240 microversion: 2.1 time: 0.081204 Jul 14 09:40:49.042048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 226/472] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:48 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:49.402089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-496650cf-0d7e-4a79-a884-95e66b206119 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:49.402731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-496650cf-0d7e-4a79-a884-95e66b206119 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:49.408841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-496650cf-0d7e-4a79-a884-95e66b206119 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:49.409317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-496650cf-0d7e-4a79-a884-95e66b206119 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:49.410069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-496650cf-0d7e-4a79-a884-95e66b206119 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:49.410532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-496650cf-0d7e-4a79-a884-95e66b206119 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:49.541756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-496650cf-0d7e-4a79-a884-95e66b206119 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:49.549173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-496650cf-0d7e-4a79-a884-95e66b206119 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1503 microversion: 2.1 time: 0.150933 Jul 14 09:40:49.549831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 247/473] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:49 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:50.058158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7bd56884-d9cf-4237-a9c9-9d5a66a13a08 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:50.058778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7bd56884-d9cf-4237-a9c9-9d5a66a13a08 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:50.065357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bd56884-d9cf-4237-a9c9-9d5a66a13a08 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:50.065799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bd56884-d9cf-4237-a9c9-9d5a66a13a08 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:50.066576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bd56884-d9cf-4237-a9c9-9d5a66a13a08 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:50.067002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bd56884-d9cf-4237-a9c9-9d5a66a13a08 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:50.128823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7bd56884-d9cf-4237-a9c9-9d5a66a13a08 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:50.136211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7bd56884-d9cf-4237-a9c9-9d5a66a13a08 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1296 microversion: 2.1 time: 0.081876 Jul 14 09:40:50.136769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 227/474] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:50 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:50.571099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-606cb068-c454-4fa1-980b-3726cbc4fa09 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:50.572446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-606cb068-c454-4fa1-980b-3726cbc4fa09 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:50.583157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-606cb068-c454-4fa1-980b-3726cbc4fa09 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:50.583862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-606cb068-c454-4fa1-980b-3726cbc4fa09 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:50.584993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-606cb068-c454-4fa1-980b-3726cbc4fa09 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:50.585650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-606cb068-c454-4fa1-980b-3726cbc4fa09 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:50.700300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-606cb068-c454-4fa1-980b-3726cbc4fa09 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b818be48fe94da3b7b0c1585d1a376b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8912a4453d094df58486417ebacfa14c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:50.709321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-606cb068-c454-4fa1-980b-3726cbc4fa09 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 200 len: 1461 microversion: 2.1 time: 0.144757 Jul 14 09:40:50.711153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 248/475] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:50 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 1461 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:50.746794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-60e10cce-8b66-48b7-a294-ada954482eb2 req-636cbc1b-87d7-4216-a7b6-52a5f844d682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f5dc6c-cabd-4614-8070-a592be81bf9b", "name": "network-vif-deleted", "tag": "72db6974-621b-4392-a68d-a40c3296c41a"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:50.756701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-60e10cce-8b66-48b7-a294-ada954482eb2 req-636cbc1b-87d7-4216-a7b6-52a5f844d682 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:50.757607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-60e10cce-8b66-48b7-a294-ada954482eb2 req-636cbc1b-87d7-4216-a7b6-52a5f844d682 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:50.769781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-60e10cce-8b66-48b7-a294-ada954482eb2 req-636cbc1b-87d7-4216-a7b6-52a5f844d682 service nova] Creating event network-vif-deleted:72db6974-621b-4392-a68d-a40c3296c41a for instance c7f5dc6c-cabd-4614-8070-a592be81bf9b on hv-cinder-82549 Jul 14 09:40:50.775312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-60e10cce-8b66-48b7-a294-ada954482eb2 req-636cbc1b-87d7-4216-a7b6-52a5f844d682 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 Jul 14 09:40:50.775908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 228/476] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:51.153593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c2dfb9d7-150d-4e39-90fb-7eea2896f63a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:51.154430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c2dfb9d7-150d-4e39-90fb-7eea2896f63a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:51.160929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2dfb9d7-150d-4e39-90fb-7eea2896f63a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:51.161464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2dfb9d7-150d-4e39-90fb-7eea2896f63a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:51.162334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2dfb9d7-150d-4e39-90fb-7eea2896f63a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:51.162931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2dfb9d7-150d-4e39-90fb-7eea2896f63a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:51.228459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c2dfb9d7-150d-4e39-90fb-7eea2896f63a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:51.235958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c2dfb9d7-150d-4e39-90fb-7eea2896f63a tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1302 microversion: 2.1 time: 0.086250 Jul 14 09:40:51.236524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 249/477] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:51 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:51.729198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:51.729881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] [instance: c7f5dc6c-cabd-4614-8070-a592be81bf9b] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:51.736264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:51.736711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:51.737541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:51.737879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:51.751704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] HTTP exception thrown: Instance c7f5dc6c-cabd-4614-8070-a592be81bf9b could not be found. Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Request method failure captured: Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b HTTP/1.1 Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-RV4xBh3ZK21QRVnVBmAwBAb5inz132zRuArNyRHz2JCcVBdTrz02kkuJhXdwWsoy7zbDmz6Mo2ZKLge6y5ZFznSy-or9YHlzU4ElBflcMcnudB3YUNGBKqDp2AemlCcO6YL9x4TVmwxcUchk2agLd2FQ0984m7i6FK3ZOlQlb__QU Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 8912a4453d094df58486417ebacfa14c Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-VolumesActionsTest-803952969 Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:40:51.753894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8912a4453d094df58486417ebacfa14c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8912a4453d094df58486417ebacfa14c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8912a4453d094df58486417ebacfa14c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8912a4453d094df58486417ebacfa14c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-VolumesActionsTest-803952969 Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 8912a4453d094df58486417ebacfa14c Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-VolumesActionsTest-803952969 Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-VolumesActionsTest-803952969-project Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 0b818be48fe94da3b7b0c1585d1a376b Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-VolumesActionsTest-803952969-project Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance c7f5dc6c-cabd-4614-8070-a592be81bf9b could not be found. Jul 14 09:40:51.755660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'c7f5dc6c-cabd-4614-8070-a592be81bf9b'} Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f5dc6c-cabd-4614-8070-a592be81bf9b could not be found. Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:40:51.757063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f5dc6c-cabd-4614-8070-a592be81bf9b could not be found. Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f5dc6c-cabd-4614-8070-a592be81bf9b could not be found. Jul 14 09:40:51.758801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:40:51.760057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] Returning 404 to user: Instance c7f5dc6c-cabd-4614-8070-a592be81bf9b could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:40:51.760057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0078c324-ea20-473b-8610-52ee09af03b4 tempest-VolumesActionsTest-803952969 tempest-VolumesActionsTest-803952969-project] 10.222.0.40 "GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b" status: 404 len: 111 microversion: 2.1 time: 0.031568 Jul 14 09:40:51.764052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 229/478] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:51 2022] GET /compute/v2.1/servers/c7f5dc6c-cabd-4614-8070-a592be81bf9b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:40:52.213621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-e1a1e5d2-173a-4a9d-8e84-e873d3e9bd77 req-4ffb1a39-5208-4465-9ed6-6e220a5ec123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251fb34b-1364-48f0-89fb-248c708b799d", "tag": "99dc9503-d87e-41e8-be83-144e940d4c66"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:52.222058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-e1a1e5d2-173a-4a9d-8e84-e873d3e9bd77 req-4ffb1a39-5208-4465-9ed6-6e220a5ec123 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:52.222734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-e1a1e5d2-173a-4a9d-8e84-e873d3e9bd77 req-4ffb1a39-5208-4465-9ed6-6e220a5ec123 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:52.253601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7872b741-3f08-46f4-874c-dbb6ec3a61cb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:52.255168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7872b741-3f08-46f4-874c-dbb6ec3a61cb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:52.262048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-e1a1e5d2-173a-4a9d-8e84-e873d3e9bd77 req-4ffb1a39-5208-4465-9ed6-6e220a5ec123 service nova] Creating event network-changed:99dc9503-d87e-41e8-be83-144e940d4c66 for instance 251fb34b-1364-48f0-89fb-248c708b799d on hv-cinder-82549 Jul 14 09:40:52.262781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7872b741-3f08-46f4-874c-dbb6ec3a61cb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:52.263239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7872b741-3f08-46f4-874c-dbb6ec3a61cb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:52.264352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7872b741-3f08-46f4-874c-dbb6ec3a61cb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:52.270840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-e1a1e5d2-173a-4a9d-8e84-e873d3e9bd77 req-4ffb1a39-5208-4465-9ed6-6e220a5ec123 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061485 Jul 14 09:40:52.271055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7872b741-3f08-46f4-874c-dbb6ec3a61cb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:52.271792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 250/479] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:40:52.438458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7872b741-3f08-46f4-874c-dbb6ec3a61cb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:52.448766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7872b741-3f08-46f4-874c-dbb6ec3a61cb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.199408 Jul 14 09:40:52.449351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 230/480] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:52 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:53.467102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ce73d3bf-ac06-4e32-a934-b100298f385d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:53.467721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ce73d3bf-ac06-4e32-a934-b100298f385d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:53.473873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce73d3bf-ac06-4e32-a934-b100298f385d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:53.474355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce73d3bf-ac06-4e32-a934-b100298f385d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:53.475107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce73d3bf-ac06-4e32-a934-b100298f385d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:53.475538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce73d3bf-ac06-4e32-a934-b100298f385d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:53.602469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ce73d3bf-ac06-4e32-a934-b100298f385d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:53.609826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ce73d3bf-ac06-4e32-a934-b100298f385d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.147259 Jul 14 09:40:53.610484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 251/481] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:53 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:54.626751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-83615b37-400a-44c4-aaf4-ba9ab985efde tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:54.627349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-83615b37-400a-44c4-aaf4-ba9ab985efde tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:54.633927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83615b37-400a-44c4-aaf4-ba9ab985efde tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:54.634404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83615b37-400a-44c4-aaf4-ba9ab985efde tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:54.635153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83615b37-400a-44c4-aaf4-ba9ab985efde tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:54.635583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83615b37-400a-44c4-aaf4-ba9ab985efde tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:54.765077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-83615b37-400a-44c4-aaf4-ba9ab985efde tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:54.772997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-83615b37-400a-44c4-aaf4-ba9ab985efde tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.150061 Jul 14 09:40:54.773555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 231/482] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:54 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:55.788808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7aea679-66f9-42d8-96ee-162ef2b896db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:55.789418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d7aea679-66f9-42d8-96ee-162ef2b896db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:55.795522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7aea679-66f9-42d8-96ee-162ef2b896db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:55.795974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7aea679-66f9-42d8-96ee-162ef2b896db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:55.796732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7aea679-66f9-42d8-96ee-162ef2b896db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:55.797170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7aea679-66f9-42d8-96ee-162ef2b896db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:55.924032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7aea679-66f9-42d8-96ee-162ef2b896db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:55.931982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d7aea679-66f9-42d8-96ee-162ef2b896db tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.146975 Jul 14 09:40:55.932537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 252/483] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:55 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:56.948725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0179250f-9991-4583-a541-725a783ef90b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:56.949256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0179250f-9991-4583-a541-725a783ef90b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:56.955844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0179250f-9991-4583-a541-725a783ef90b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:56.956267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0179250f-9991-4583-a541-725a783ef90b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:56.957022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0179250f-9991-4583-a541-725a783ef90b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:56.957720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0179250f-9991-4583-a541-725a783ef90b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:56.976877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:57.084997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0179250f-9991-4583-a541-725a783ef90b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:57.092468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0179250f-9991-4583-a541-725a783ef90b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.147715 Jul 14 09:40:57.093029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 232/484] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:56 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:58.108983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a06d9b73-d871-40bd-9db4-1cc2618dc479 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:58.109564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a06d9b73-d871-40bd-9db4-1cc2618dc479 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:58.111587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:58.112245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=10 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:58.118525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a06d9b73-d871-40bd-9db4-1cc2618dc479 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:58.118971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a06d9b73-d871-40bd-9db4-1cc2618dc479 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:58.119725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a06d9b73-d871-40bd-9db4-1cc2618dc479 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:58.120158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a06d9b73-d871-40bd-9db4-1cc2618dc479 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:58.250040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a06d9b73-d871-40bd-9db4-1cc2618dc479 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:58.257496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a06d9b73-d871-40bd-9db4-1cc2618dc479 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.152548 Jul 14 09:40:58.258050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 253/485] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:58 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:58.495061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1206025251", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-123116946", "security_groups": [{"name": "tempest-secgroup-smoke-1881863927"}], "networks": [{"uuid": "0af649f1-d199-4fe8-a389-cfcc3c3af0e5"}], "block_device_mapping_v2": [{"uuid": "38e8f9d3-f645-4ea7-9d5b-514f172c058a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:40:58.503352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:40:58.616614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] validate_networks() for [('0af649f1-d199-4fe8-a389-cfcc3c3af0e5', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:40:58.989975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:40:58.991072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:40:58.991543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:40:58.992096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:40:58.992528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:40:59.001935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:59.002620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:59.003595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:59.004021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:59.021805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Getting quotas for project a28617ad1f8d40faa7d2e317b32951ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:40:59.025792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Getting quotas for user 27cfaef90a5048569453430e75c4c42b and project a28617ad1f8d40faa7d2e317b32951ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:40:59.081423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:40:59.083991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38e8f9d3-f645-4ea7-9d5b-514f172c058a',volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:40:59.209649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-733ee0fe-44dc-40e2-b813-bb47e382a688 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718609 Jul 14 09:40:59.210344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 233/486] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:40:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:40:59.220354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da7ae5f1-c90f-44f1-8aab-2533682bf2ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:59.221040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da7ae5f1-c90f-44f1-8aab-2533682bf2ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:59.275896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da7ae5f1-c90f-44f1-8aab-2533682bf2ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:59.280351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-01f36ee3-5b09-45a4-b8d5-3f916b9b3b03 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:40:59.280968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-01f36ee3-5b09-45a4-b8d5-3f916b9b3b03 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:40:59.283178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da7ae5f1-c90f-44f1-8aab-2533682bf2ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1088 microversion: 2.1 time: 0.066649 Jul 14 09:40:59.284808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 254/487] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:59 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:40:59.288852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01f36ee3-5b09-45a4-b8d5-3f916b9b3b03 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:59.289406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01f36ee3-5b09-45a4-b8d5-3f916b9b3b03 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:59.290352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01f36ee3-5b09-45a4-b8d5-3f916b9b3b03 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:40:59.290781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01f36ee3-5b09-45a4-b8d5-3f916b9b3b03 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:40:59.429196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-01f36ee3-5b09-45a4-b8d5-3f916b9b3b03 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:40:59.436598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-01f36ee3-5b09-45a4-b8d5-3f916b9b3b03 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.161418 Jul 14 09:40:59.437158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 234/488] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:40:59 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:00.301202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ba309526-6d18-40b7-9af9-e9810910a870 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:00.302012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ba309526-6d18-40b7-9af9-e9810910a870 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:00.321270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba309526-6d18-40b7-9af9-e9810910a870 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:00.321807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba309526-6d18-40b7-9af9-e9810910a870 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:00.322675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba309526-6d18-40b7-9af9-e9810910a870 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:00.323244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba309526-6d18-40b7-9af9-e9810910a870 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:00.455075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0325acc8-f3d7-40dd-aad0-d64523401572 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:00.455685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0325acc8-f3d7-40dd-aad0-d64523401572 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:00.460120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ba309526-6d18-40b7-9af9-e9810910a870 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:00.474174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ba309526-6d18-40b7-9af9-e9810910a870 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1138 microversion: 2.1 time: 0.175654 Jul 14 09:41:00.476356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 255/489] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:00 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1138 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:41:00.477298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0325acc8-f3d7-40dd-aad0-d64523401572 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:00.479392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0325acc8-f3d7-40dd-aad0-d64523401572 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:00.481217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0325acc8-f3d7-40dd-aad0-d64523401572 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:00.482519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0325acc8-f3d7-40dd-aad0-d64523401572 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:00.679635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0325acc8-f3d7-40dd-aad0-d64523401572 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:00.690893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0325acc8-f3d7-40dd-aad0-d64523401572 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.240159 Jul 14 09:41:00.691492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 235/490] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:00 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:41:01.494756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a797a588-5d9d-472e-81e3-9d254bfbb826 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:01.497334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a797a588-5d9d-472e-81e3-9d254bfbb826 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:01.508429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a797a588-5d9d-472e-81e3-9d254bfbb826 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:01.509716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a797a588-5d9d-472e-81e3-9d254bfbb826 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:01.510958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a797a588-5d9d-472e-81e3-9d254bfbb826 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:01.511599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a797a588-5d9d-472e-81e3-9d254bfbb826 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:01.592528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a797a588-5d9d-472e-81e3-9d254bfbb826 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:01.603215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a797a588-5d9d-472e-81e3-9d254bfbb826 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1186 microversion: 2.1 time: 0.114385 Jul 14 09:41:01.613407 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 256/491] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:01 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1186 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:01.709759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9201de2f-6df1-49cc-b8bb-c154e10eb53c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:01.710792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9201de2f-6df1-49cc-b8bb-c154e10eb53c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:01.723156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9201de2f-6df1-49cc-b8bb-c154e10eb53c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:01.725224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9201de2f-6df1-49cc-b8bb-c154e10eb53c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:01.727257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9201de2f-6df1-49cc-b8bb-c154e10eb53c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:01.728288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9201de2f-6df1-49cc-b8bb-c154e10eb53c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:01.939786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9201de2f-6df1-49cc-b8bb-c154e10eb53c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:01.949506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9201de2f-6df1-49cc-b8bb-c154e10eb53c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.244816 Jul 14 09:41:01.950634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 236/492] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:01 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:02.621057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1781639b-4bc5-4520-b404-70a322849248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:02.621744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1781639b-4bc5-4520-b404-70a322849248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:02.628131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1781639b-4bc5-4520-b404-70a322849248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:02.628584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1781639b-4bc5-4520-b404-70a322849248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:02.629351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1781639b-4bc5-4520-b404-70a322849248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:02.629789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1781639b-4bc5-4520-b404-70a322849248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:02.808348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1781639b-4bc5-4520-b404-70a322849248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:02.817342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1781639b-4bc5-4520-b404-70a322849248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1272 microversion: 2.1 time: 0.200185 Jul 14 09:41:02.817919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 257/493] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:02 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:02.968903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1d4f48e5-e313-4edb-b52b-5a25d80e5250 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:02.975326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1d4f48e5-e313-4edb-b52b-5a25d80e5250 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:02.995776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d4f48e5-e313-4edb-b52b-5a25d80e5250 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:03.003764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d4f48e5-e313-4edb-b52b-5a25d80e5250 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:03.007024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d4f48e5-e313-4edb-b52b-5a25d80e5250 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:03.007922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d4f48e5-e313-4edb-b52b-5a25d80e5250 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:03.182423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-52145dbb-5110-427a-bfc8-82259ff40df2 req-f0ec83c3-dffb-473b-b727-edb90fa76461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251fb34b-1364-48f0-89fb-248c708b799d", "name": "network-vif-plugged", "status": "completed", "tag": "99dc9503-d87e-41e8-be83-144e940d4c66"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:03.199248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-52145dbb-5110-427a-bfc8-82259ff40df2 req-f0ec83c3-dffb-473b-b727-edb90fa76461 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:03.199697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-52145dbb-5110-427a-bfc8-82259ff40df2 req-f0ec83c3-dffb-473b-b727-edb90fa76461 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:03.249161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-52145dbb-5110-427a-bfc8-82259ff40df2 req-f0ec83c3-dffb-473b-b727-edb90fa76461 service nova] Creating event network-vif-plugged:99dc9503-d87e-41e8-be83-144e940d4c66 for instance 251fb34b-1364-48f0-89fb-248c708b799d on hv-cinder-82549 Jul 14 09:41:03.282673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-52145dbb-5110-427a-bfc8-82259ff40df2 req-f0ec83c3-dffb-473b-b727-edb90fa76461 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105734 Jul 14 09:41:03.291244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 258/494] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:41:03.313891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1d4f48e5-e313-4edb-b52b-5a25d80e5250 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:03.325565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1d4f48e5-e313-4edb-b52b-5a25d80e5250 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.360016 Jul 14 09:41:03.327118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 237/495] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:02 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:03.777894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-734c7872-9fcc-42eb-b059-e83abe24027b req-c35edcb5-ff3b-4ff0-b6e0-2d8eb1fe544c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a699dfcd-f703-4225-a432-860189583054", "tag": "f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:03.796029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-734c7872-9fcc-42eb-b059-e83abe24027b req-c35edcb5-ff3b-4ff0-b6e0-2d8eb1fe544c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:03.797898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-734c7872-9fcc-42eb-b059-e83abe24027b req-c35edcb5-ff3b-4ff0-b6e0-2d8eb1fe544c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:03.815971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-734c7872-9fcc-42eb-b059-e83abe24027b req-c35edcb5-ff3b-4ff0-b6e0-2d8eb1fe544c service nova] Creating event network-changed:f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659 for instance a699dfcd-f703-4225-a432-860189583054 on hv-cinder-82549 Jul 14 09:41:03.829188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-734c7872-9fcc-42eb-b059-e83abe24027b req-c35edcb5-ff3b-4ff0-b6e0-2d8eb1fe544c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058495 Jul 14 09:41:03.829188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 259/496] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:41:03.836527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-80231a05-bdea-4f05-b495-f8f0770489d8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:03.837219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-80231a05-bdea-4f05-b495-f8f0770489d8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:03.843968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80231a05-bdea-4f05-b495-f8f0770489d8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:03.844409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80231a05-bdea-4f05-b495-f8f0770489d8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:03.845171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80231a05-bdea-4f05-b495-f8f0770489d8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:03.845594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80231a05-bdea-4f05-b495-f8f0770489d8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:04.346769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-41026973-a7c8-4d97-b3c3-0d6dcec8a1bc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:04.347475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-41026973-a7c8-4d97-b3c3-0d6dcec8a1bc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:04.360371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41026973-a7c8-4d97-b3c3-0d6dcec8a1bc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:04.361273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41026973-a7c8-4d97-b3c3-0d6dcec8a1bc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:04.362297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41026973-a7c8-4d97-b3c3-0d6dcec8a1bc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:04.363065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41026973-a7c8-4d97-b3c3-0d6dcec8a1bc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:04.383664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-80231a05-bdea-4f05-b495-f8f0770489d8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:04.395168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-80231a05-bdea-4f05-b495-f8f0770489d8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.563153 Jul 14 09:41:04.395739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 238/497] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:03 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:04.540020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-41026973-a7c8-4d97-b3c3-0d6dcec8a1bc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:04.548168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-41026973-a7c8-4d97-b3c3-0d6dcec8a1bc tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.206014 Jul 14 09:41:04.559780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 260/498] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:04 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:05.413165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7e2074be-dd84-4b08-b0de-cd63ad6260ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:05.414374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7e2074be-dd84-4b08-b0de-cd63ad6260ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:05.423835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e2074be-dd84-4b08-b0de-cd63ad6260ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:05.424272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e2074be-dd84-4b08-b0de-cd63ad6260ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:05.425037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e2074be-dd84-4b08-b0de-cd63ad6260ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:05.425462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e2074be-dd84-4b08-b0de-cd63ad6260ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:05.566568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-60dcb557-32c9-4df8-9e82-a69272a33a10 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:05.568996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-60dcb557-32c9-4df8-9e82-a69272a33a10 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:05.578217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-60dcb557-32c9-4df8-9e82-a69272a33a10 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:05.579570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-60dcb557-32c9-4df8-9e82-a69272a33a10 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:05.580646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-60dcb557-32c9-4df8-9e82-a69272a33a10 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:05.581381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-60dcb557-32c9-4df8-9e82-a69272a33a10 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:05.803729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7e2074be-dd84-4b08-b0de-cd63ad6260ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:05.812691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7e2074be-dd84-4b08-b0de-cd63ad6260ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.403790 Jul 14 09:41:05.824617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 239/499] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:05 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:05.880151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-60dcb557-32c9-4df8-9e82-a69272a33a10 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:05.889643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-60dcb557-32c9-4df8-9e82-a69272a33a10 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1370 microversion: 2.1 time: 0.326985 Jul 14 09:41:05.890230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 261/500] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:05 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:06.831141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-18a4c617-4d8f-431a-a66b-f4ddbc7a233a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:06.831731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-18a4c617-4d8f-431a-a66b-f4ddbc7a233a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:06.840070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18a4c617-4d8f-431a-a66b-f4ddbc7a233a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:06.840622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18a4c617-4d8f-431a-a66b-f4ddbc7a233a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:06.841437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18a4c617-4d8f-431a-a66b-f4ddbc7a233a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:06.841857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18a4c617-4d8f-431a-a66b-f4ddbc7a233a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:06.907542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0f33948a-a450-4afe-adf0-14c3a35e8054 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:06.908889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0f33948a-a450-4afe-adf0-14c3a35e8054 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:06.922225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f33948a-a450-4afe-adf0-14c3a35e8054 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:06.922684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f33948a-a450-4afe-adf0-14c3a35e8054 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:06.923467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f33948a-a450-4afe-adf0-14c3a35e8054 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:06.923924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f33948a-a450-4afe-adf0-14c3a35e8054 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:06.935005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:07.049510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-18a4c617-4d8f-431a-a66b-f4ddbc7a233a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:07.058570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-18a4c617-4d8f-431a-a66b-f4ddbc7a233a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.231361 Jul 14 09:41:07.059570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 240/501] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:06 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:07.115225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0f33948a-a450-4afe-adf0-14c3a35e8054 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:07.137022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0f33948a-a450-4afe-adf0-14c3a35e8054 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 200 len: 1565 microversion: 2.1 time: 0.233993 Jul 14 09:41:07.137596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 262/502] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:06 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 1565 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:07.158754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-79726dd8-7a05-41fe-8cd7-f51cb0863703 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:07.159530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-79726dd8-7a05-41fe-8cd7-f51cb0863703 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:07.166500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79726dd8-7a05-41fe-8cd7-f51cb0863703 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:07.167015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79726dd8-7a05-41fe-8cd7-f51cb0863703 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:07.168061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79726dd8-7a05-41fe-8cd7-f51cb0863703 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:07.168487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79726dd8-7a05-41fe-8cd7-f51cb0863703 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:07.249845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-79726dd8-7a05-41fe-8cd7-f51cb0863703 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094907 Jul 14 09:41:07.255020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 241/503] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 09:41:07 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:41:08.075826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b84019c6-a3b2-4640-b8af-eef14d4851e1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:08.077164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b84019c6-a3b2-4640-b8af-eef14d4851e1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:08.086308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b84019c6-a3b2-4640-b8af-eef14d4851e1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:08.090908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b84019c6-a3b2-4640-b8af-eef14d4851e1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:08.092733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b84019c6-a3b2-4640-b8af-eef14d4851e1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:08.093200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b84019c6-a3b2-4640-b8af-eef14d4851e1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:08.355502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b84019c6-a3b2-4640-b8af-eef14d4851e1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:08.368394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b84019c6-a3b2-4640-b8af-eef14d4851e1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.295944 Jul 14 09:41:08.379602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 263/504] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:08 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:08.783862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-be689cba-3467-43b4-b260-c6a6a0b2d7fa req-2e5adca8-299c-40f6-8191-861798904d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251fb34b-1364-48f0-89fb-248c708b799d", "tag": "99dc9503-d87e-41e8-be83-144e940d4c66"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:08.793791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-be689cba-3467-43b4-b260-c6a6a0b2d7fa req-2e5adca8-299c-40f6-8191-861798904d04 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:08.794600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-be689cba-3467-43b4-b260-c6a6a0b2d7fa req-2e5adca8-299c-40f6-8191-861798904d04 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:08.812910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-be689cba-3467-43b4-b260-c6a6a0b2d7fa req-2e5adca8-299c-40f6-8191-861798904d04 service nova] Creating event network-changed:99dc9503-d87e-41e8-be83-144e940d4c66 for instance 251fb34b-1364-48f0-89fb-248c708b799d on hv-cinder-82549 Jul 14 09:41:08.820133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-be689cba-3467-43b4-b260-c6a6a0b2d7fa req-2e5adca8-299c-40f6-8191-861798904d04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040646 Jul 14 09:41:08.821058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 242/505] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:41:09.386905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4e855955-30d8-487f-858d-01c593bc8f29 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:09.388122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4e855955-30d8-487f-858d-01c593bc8f29 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:09.390328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:09.398981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e855955-30d8-487f-858d-01c593bc8f29 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:09.399950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e855955-30d8-487f-858d-01c593bc8f29 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:09.401154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e855955-30d8-487f-858d-01c593bc8f29 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:09.401944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e855955-30d8-487f-858d-01c593bc8f29 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:09.675461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4e855955-30d8-487f-858d-01c593bc8f29 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:09.684103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4e855955-30d8-487f-858d-01c593bc8f29 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.301009 Jul 14 09:41:09.685303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 264/506] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:09 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:10.698239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:10.699662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=6 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:10.705003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a228e04c-b9b9-42f0-a6e2-a3e642d4724f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:10.705710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a228e04c-b9b9-42f0-a6e2-a3e642d4724f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:10.713419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a228e04c-b9b9-42f0-a6e2-a3e642d4724f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:10.714100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a228e04c-b9b9-42f0-a6e2-a3e642d4724f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:10.715062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a228e04c-b9b9-42f0-a6e2-a3e642d4724f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:10.715648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a228e04c-b9b9-42f0-a6e2-a3e642d4724f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:10.870247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a228e04c-b9b9-42f0-a6e2-a3e642d4724f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:10.882467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a228e04c-b9b9-42f0-a6e2-a3e642d4724f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.184739 Jul 14 09:41:10.884343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 243/507] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:10 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:11.901420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b76beccd-be32-47fc-a489-fd0aed217d33 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:11.902236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b76beccd-be32-47fc-a489-fd0aed217d33 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:11.908359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b76beccd-be32-47fc-a489-fd0aed217d33 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:11.908948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b76beccd-be32-47fc-a489-fd0aed217d33 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:11.910859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b76beccd-be32-47fc-a489-fd0aed217d33 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:11.911486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b76beccd-be32-47fc-a489-fd0aed217d33 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:12.058448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b76beccd-be32-47fc-a489-fd0aed217d33 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:12.066945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b76beccd-be32-47fc-a489-fd0aed217d33 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.169822 Jul 14 09:41:12.068490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 265/508] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:11 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:13.086163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-50481a81-4bb6-4eae-8837-f8966c4c87fd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:13.087079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-50481a81-4bb6-4eae-8837-f8966c4c87fd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:13.095993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50481a81-4bb6-4eae-8837-f8966c4c87fd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:13.096737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50481a81-4bb6-4eae-8837-f8966c4c87fd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:13.097935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50481a81-4bb6-4eae-8837-f8966c4c87fd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:13.098512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50481a81-4bb6-4eae-8837-f8966c4c87fd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:13.247465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-50481a81-4bb6-4eae-8837-f8966c4c87fd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:13.257264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-50481a81-4bb6-4eae-8837-f8966c4c87fd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.177040 Jul 14 09:41:13.258310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 244/509] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:13 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:14.277165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-017bee02-f327-4f47-86bd-5e2f34c005cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:14.277819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-017bee02-f327-4f47-86bd-5e2f34c005cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:14.284320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-017bee02-f327-4f47-86bd-5e2f34c005cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:14.284770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-017bee02-f327-4f47-86bd-5e2f34c005cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:14.285609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-017bee02-f327-4f47-86bd-5e2f34c005cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:14.286592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-017bee02-f327-4f47-86bd-5e2f34c005cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:14.443314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-017bee02-f327-4f47-86bd-5e2f34c005cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:14.451663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-017bee02-f327-4f47-86bd-5e2f34c005cc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.178204 Jul 14 09:41:14.452292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 266/510] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:14 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:15.469251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c7a1356d-8fe5-4539-8708-6a89d2ac33c8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:15.470179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c7a1356d-8fe5-4539-8708-6a89d2ac33c8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:15.473082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:15.479295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7a1356d-8fe5-4539-8708-6a89d2ac33c8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:15.479927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7a1356d-8fe5-4539-8708-6a89d2ac33c8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:15.480706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7a1356d-8fe5-4539-8708-6a89d2ac33c8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:15.481161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7a1356d-8fe5-4539-8708-6a89d2ac33c8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:15.629999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c7a1356d-8fe5-4539-8708-6a89d2ac33c8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:15.638167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c7a1356d-8fe5-4539-8708-6a89d2ac33c8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.172813 Jul 14 09:41:15.638793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 245/511] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:15 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:16.654893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-175b61a6-fe75-449e-b480-cf544d3b9b02 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:16.655482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-175b61a6-fe75-449e-b480-cf544d3b9b02 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:16.661636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-175b61a6-fe75-449e-b480-cf544d3b9b02 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:16.662078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-175b61a6-fe75-449e-b480-cf544d3b9b02 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:16.662862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-175b61a6-fe75-449e-b480-cf544d3b9b02 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:16.663297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-175b61a6-fe75-449e-b480-cf544d3b9b02 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:16.799909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-175b61a6-fe75-449e-b480-cf544d3b9b02 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:16.807814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-175b61a6-fe75-449e-b480-cf544d3b9b02 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.156730 Jul 14 09:41:16.808427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 267/512] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:16 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:17.830858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8f0f525e-74ca-46ec-a627-a1f67d85ef62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:17.831879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8f0f525e-74ca-46ec-a627-a1f67d85ef62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:17.839235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8f0f525e-74ca-46ec-a627-a1f67d85ef62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:17.839734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8f0f525e-74ca-46ec-a627-a1f67d85ef62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:17.840528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8f0f525e-74ca-46ec-a627-a1f67d85ef62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:17.841074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8f0f525e-74ca-46ec-a627-a1f67d85ef62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:17.971170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8f0f525e-74ca-46ec-a627-a1f67d85ef62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:17.978480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8f0f525e-74ca-46ec-a627-a1f67d85ef62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.151447 Jul 14 09:41:17.979043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 246/513] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:17 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:18.995224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2c3aaee2-aac7-4d6a-b559-3b7330f09040 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:18.996623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2c3aaee2-aac7-4d6a-b559-3b7330f09040 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:19.002836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:19.005454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c3aaee2-aac7-4d6a-b559-3b7330f09040 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:19.006300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c3aaee2-aac7-4d6a-b559-3b7330f09040 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:19.007072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c3aaee2-aac7-4d6a-b559-3b7330f09040 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:19.007531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c3aaee2-aac7-4d6a-b559-3b7330f09040 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:19.168444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2c3aaee2-aac7-4d6a-b559-3b7330f09040 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:19.168653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-b48bfdec-73d2-49e8-bcc4-dba9f7dccc20 req-d0fa76b9-9ef9-48e8-a550-fded3dec1924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a699dfcd-f703-4225-a432-860189583054", "name": "network-vif-plugged", "status": "completed", "tag": "f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:19.180695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-b48bfdec-73d2-49e8-bcc4-dba9f7dccc20 req-d0fa76b9-9ef9-48e8-a550-fded3dec1924 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:19.181405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-b48bfdec-73d2-49e8-bcc4-dba9f7dccc20 req-d0fa76b9-9ef9-48e8-a550-fded3dec1924 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:19.186518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2c3aaee2-aac7-4d6a-b559-3b7330f09040 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.195144 Jul 14 09:41:19.196430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 268/514] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:18 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:19.196615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-b48bfdec-73d2-49e8-bcc4-dba9f7dccc20 req-d0fa76b9-9ef9-48e8-a550-fded3dec1924 service nova] Creating event network-vif-plugged:f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659 for instance a699dfcd-f703-4225-a432-860189583054 on hv-cinder-82549 Jul 14 09:41:19.202580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-b48bfdec-73d2-49e8-bcc4-dba9f7dccc20 req-d0fa76b9-9ef9-48e8-a550-fded3dec1924 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039819 Jul 14 09:41:19.214753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 247/515] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:41:19.967048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2a10c260-e8ba-4390-9404-fb14b68f86f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:19.967537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2a10c260-e8ba-4390-9404-fb14b68f86f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:19.973630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2a10c260-e8ba-4390-9404-fb14b68f86f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:19.974076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2a10c260-e8ba-4390-9404-fb14b68f86f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:19.974868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2a10c260-e8ba-4390-9404-fb14b68f86f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:19.975302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2a10c260-e8ba-4390-9404-fb14b68f86f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:19.998013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2a10c260-e8ba-4390-9404-fb14b68f86f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/ips" status: 200 len: 152 microversion: 2.20 time: 0.034854 Jul 14 09:41:19.998668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 269/516] 10.222.0.40 () {60 vars in 1288 bytes} [Thu Jul 14 09:41:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:41:20.208880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3b664154-2008-4772-b418-f86088a726a0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:20.210746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3b664154-2008-4772-b418-f86088a726a0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:20.220343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b664154-2008-4772-b418-f86088a726a0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:20.221349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b664154-2008-4772-b418-f86088a726a0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:20.222369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b664154-2008-4772-b418-f86088a726a0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:20.223131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b664154-2008-4772-b418-f86088a726a0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:20.262570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2cbc1864-94b1-4045-bcbe-178d74ca9b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:20.263219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2cbc1864-94b1-4045-bcbe-178d74ca9b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:20.269698 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cbc1864-94b1-4045-bcbe-178d74ca9b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:20.270759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cbc1864-94b1-4045-bcbe-178d74ca9b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:20.282650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cbc1864-94b1-4045-bcbe-178d74ca9b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:20.283160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cbc1864-94b1-4045-bcbe-178d74ca9b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:20.322445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2cbc1864-94b1-4045-bcbe-178d74ca9b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/ips" status: 200 len: 145 microversion: 2.1 time: 0.064164 Jul 14 09:41:20.323667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 270/517] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 09:41:20 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/ips => generated 145 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:41:20.412004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3b664154-2008-4772-b418-f86088a726a0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:20.421475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3b664154-2008-4772-b418-f86088a726a0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.220414 Jul 14 09:41:20.422576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 248/518] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:20 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:21.439832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6c671e13-a4ad-459a-b2eb-672157f56bf8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:21.440602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6c671e13-a4ad-459a-b2eb-672157f56bf8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:21.447519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c671e13-a4ad-459a-b2eb-672157f56bf8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:21.447994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c671e13-a4ad-459a-b2eb-672157f56bf8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:21.448908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c671e13-a4ad-459a-b2eb-672157f56bf8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:21.449344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c671e13-a4ad-459a-b2eb-672157f56bf8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:21.606179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6c671e13-a4ad-459a-b2eb-672157f56bf8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:21.614513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6c671e13-a4ad-459a-b2eb-672157f56bf8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1260 microversion: 2.1 time: 0.177900 Jul 14 09:41:21.615071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 271/519] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:21 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:41:22.208713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7e9ac511-33d7-40a5-b4fd-df2595bfa60a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:22.209250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7e9ac511-33d7-40a5-b4fd-df2595bfa60a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:22.215879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e9ac511-33d7-40a5-b4fd-df2595bfa60a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:22.216319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e9ac511-33d7-40a5-b4fd-df2595bfa60a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:22.217083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e9ac511-33d7-40a5-b4fd-df2595bfa60a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:22.217506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e9ac511-33d7-40a5-b4fd-df2595bfa60a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:22.239049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-7e9ac511-33d7-40a5-b4fd-df2595bfa60a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lazy-loading 'flavor' on Instance uuid a00a0737-b755-4d07-a5a1-8b691911836f {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:41:22.295693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:22.504517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7e9ac511-33d7-40a5-b4fd-df2595bfa60a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "POST /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/action" status: 202 len: 0 microversion: 2.20 time: 0.300284 Jul 14 09:41:22.505259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 249/520] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jul 14 09:41:22 2022] POST /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:41:22.513853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:22.514481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:22.521361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:22.521960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:22.522820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:22.523257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:22.631778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2258f982-bb96-454c-8a9e-012545670910 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:22.632560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2258f982-bb96-454c-8a9e-012545670910 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:22.638933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2258f982-bb96-454c-8a9e-012545670910 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:22.639370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2258f982-bb96-454c-8a9e-012545670910 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:22.640117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2258f982-bb96-454c-8a9e-012545670910 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:22.640541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2258f982-bb96-454c-8a9e-012545670910 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:22.662712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:22.670851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:22.672473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:22.673715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-44f53a4e-f3af-4e6e-9d6b-839ed08587d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.164410 Jul 14 09:41:22.674376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 272/521] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:22.769741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2258f982-bb96-454c-8a9e-012545670910 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:22.778420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2258f982-bb96-454c-8a9e-012545670910 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1444 microversion: 2.1 time: 0.150864 Jul 14 09:41:22.778979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 250/522] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:22 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:41:22.796032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1774c196-4f97-4ef2-9029-0970abadfa9f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:22.796640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1774c196-4f97-4ef2-9029-0970abadfa9f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:22.802787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1774c196-4f97-4ef2-9029-0970abadfa9f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:22.803282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1774c196-4f97-4ef2-9029-0970abadfa9f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:22.804560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1774c196-4f97-4ef2-9029-0970abadfa9f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:22.805176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1774c196-4f97-4ef2-9029-0970abadfa9f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:22.942375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1774c196-4f97-4ef2-9029-0970abadfa9f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:22.949787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1774c196-4f97-4ef2-9029-0970abadfa9f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1444 microversion: 2.1 time: 0.157632 Jul 14 09:41:22.950371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 273/523] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:22 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:23.078869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1319873620", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:23.130618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] validate_networks() for None {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:41:23.426142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:41:23.426766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:41:23.427050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:41:23.427451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:41:23.427858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:41:23.437205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:23.437647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:23.438683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:23.439319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:23.456593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Getting quotas for project 58df2f717fcd44939fa909c6d0bdbf79. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:41:23.461086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Getting quotas for user 1f3d903b658e4039a110cd24e1691386 and project 58df2f717fcd44939fa909c6d0bdbf79. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:41:23.472720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:41:23.475575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:41:23.521002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-98b9011d-ddf0-4189-b5c5-1e7c901e8405 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.445823 Jul 14 09:41:23.521824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 251/524] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:41:23.531611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-63ff254c-007d-4302-9ead-bd521da96f06 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:23.532837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-63ff254c-007d-4302-9ead-bd521da96f06 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:23.593128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-63ff254c-007d-4302-9ead-bd521da96f06 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:23.601123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-63ff254c-007d-4302-9ead-bd521da96f06 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1215 microversion: 2.1 time: 0.073410 Jul 14 09:41:23.613107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 274/525] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:23 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:23.670597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-76b08cf7-8f3e-4fad-b729-8036d13320f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "207951cb-477c-4bd2-a417-5255f53da913"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:23.671583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-76b08cf7-8f3e-4fad-b729-8036d13320f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:23.679222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76b08cf7-8f3e-4fad-b729-8036d13320f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:23.679769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76b08cf7-8f3e-4fad-b729-8036d13320f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:23.680623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76b08cf7-8f3e-4fad-b729-8036d13320f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:23.681271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76b08cf7-8f3e-4fad-b729-8036d13320f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:23.694761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:23.695573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:23.702328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:23.703168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:23.704454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:23.705092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:23.940097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:23.951266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:23.953095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:23.954575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-617a0305-40db-47f0-95b9-91c310545a46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.265588 Jul 14 09:41:23.955277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 275/526] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:24.062700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-76b08cf7-8f3e-4fad-b729-8036d13320f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395774 Jul 14 09:41:24.063342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 252/527] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 09:41:23 2022] POST /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:41:24.620982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f6d7da70-f305-41c0-9f7b-fa918b23755e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:24.621545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f6d7da70-f305-41c0-9f7b-fa918b23755e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:24.627363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f6d7da70-f305-41c0-9f7b-fa918b23755e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:24.627805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f6d7da70-f305-41c0-9f7b-fa918b23755e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:24.628564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f6d7da70-f305-41c0-9f7b-fa918b23755e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:24.629011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f6d7da70-f305-41c0-9f7b-fa918b23755e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:24.693379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f6d7da70-f305-41c0-9f7b-fa918b23755e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:24.700860 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f6d7da70-f305-41c0-9f7b-fa918b23755e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1267 microversion: 2.1 time: 0.084095 Jul 14 09:41:24.701428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 276/528] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:24 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:41:24.985904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:24.986844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:24.993410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:24.994043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:24.994990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:24.996255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:25.057121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-1ec7e165-87c3-4a10-8a1f-5e90394145f7 req-bab33618-90b6-4350-a1e0-a4c7fd6b7ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a699dfcd-f703-4225-a432-860189583054", "tag": "f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:25.066545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-1ec7e165-87c3-4a10-8a1f-5e90394145f7 req-bab33618-90b6-4350-a1e0-a4c7fd6b7ece service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:25.067251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-1ec7e165-87c3-4a10-8a1f-5e90394145f7 req-bab33618-90b6-4350-a1e0-a4c7fd6b7ece service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:25.079035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-1ec7e165-87c3-4a10-8a1f-5e90394145f7 req-bab33618-90b6-4350-a1e0-a4c7fd6b7ece service nova] Creating event network-changed:f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659 for instance a699dfcd-f703-4225-a432-860189583054 on hv-cinder-82549 Jul 14 09:41:25.085111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-1ec7e165-87c3-4a10-8a1f-5e90394145f7 req-bab33618-90b6-4350-a1e0-a4c7fd6b7ece service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031551 Jul 14 09:41:25.086251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 277/529] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:41:25.306616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:25.315258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:25.317517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:25.318750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bae937cc-5c37-406e-a1e4-5b00c58f5b1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.337636 Jul 14 09:41:25.319311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 253/530] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:25.719076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c196e9df-a693-4226-8878-817d565be491 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:25.720555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c196e9df-a693-4226-8878-817d565be491 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:25.727975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c196e9df-a693-4226-8878-817d565be491 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:25.728624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c196e9df-a693-4226-8878-817d565be491 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:25.729926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c196e9df-a693-4226-8878-817d565be491 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:25.730731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c196e9df-a693-4226-8878-817d565be491 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:25.808088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c196e9df-a693-4226-8878-817d565be491 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:25.815841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c196e9df-a693-4226-8878-817d565be491 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1273 microversion: 2.1 time: 0.100898 Jul 14 09:41:25.818828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 278/531] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:25 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:26.337955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:26.338585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:26.359487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:26.360003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:26.360718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:26.361153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:26.655268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:26.663782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:26.665269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:26.666510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a0c70f42-2cfd-44ac-9a0e-6727b9cfdf1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.332482 Jul 14 09:41:26.667096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 254/532] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:26.835578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2e4a3133-cf8d-47e2-a8d3-2f4811ba6770 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:26.836182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2e4a3133-cf8d-47e2-a8d3-2f4811ba6770 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:26.849816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e4a3133-cf8d-47e2-a8d3-2f4811ba6770 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:26.849816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e4a3133-cf8d-47e2-a8d3-2f4811ba6770 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:26.849816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e4a3133-cf8d-47e2-a8d3-2f4811ba6770 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:26.849816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e4a3133-cf8d-47e2-a8d3-2f4811ba6770 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:27.076979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-e7250baf-48ed-4916-97e3-4ada2d9ea3a6 req-36c65415-efd1-484f-b56c-e7810609093c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d19ecf-50af-42e3-a68b-e8e5c638e259", "tag": "509d4117-ecc9-42ab-b685-15f68e28c2e6"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:27.082764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2e4a3133-cf8d-47e2-a8d3-2f4811ba6770 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:27.093457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-e7250baf-48ed-4916-97e3-4ada2d9ea3a6 req-36c65415-efd1-484f-b56c-e7810609093c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:27.093647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2e4a3133-cf8d-47e2-a8d3-2f4811ba6770 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.262444 Jul 14 09:41:27.093907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-e7250baf-48ed-4916-97e3-4ada2d9ea3a6 req-36c65415-efd1-484f-b56c-e7810609093c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:27.098297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 279/533] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:26 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:27.109418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-e7250baf-48ed-4916-97e3-4ada2d9ea3a6 req-36c65415-efd1-484f-b56c-e7810609093c service nova] Creating event network-changed:509d4117-ecc9-42ab-b685-15f68e28c2e6 for instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 on hv-cinder-82549 Jul 14 09:41:27.114758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-e7250baf-48ed-4916-97e3-4ada2d9ea3a6 req-36c65415-efd1-484f-b56c-e7810609093c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041416 Jul 14 09:41:27.115523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 255/534] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:41:27.684387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:27.685006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:27.691062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:27.691536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:27.692295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:27.692736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:27.817593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:27.825736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:27.827426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:27.828577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d7a73942-b3f7-47f2-b446-7932439c6c25 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.148130 Jul 14 09:41:27.829123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 280/535] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:28.111979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a6709ad8-24ff-4c4d-9ff7-53ae3f9d6e0d tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:28.112579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a6709ad8-24ff-4c4d-9ff7-53ae3f9d6e0d tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:28.118715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6709ad8-24ff-4c4d-9ff7-53ae3f9d6e0d tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:28.119150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6709ad8-24ff-4c4d-9ff7-53ae3f9d6e0d tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:28.119890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6709ad8-24ff-4c4d-9ff7-53ae3f9d6e0d tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:28.120400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6709ad8-24ff-4c4d-9ff7-53ae3f9d6e0d tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:28.249259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a6709ad8-24ff-4c4d-9ff7-53ae3f9d6e0d tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:28.257105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a6709ad8-24ff-4c4d-9ff7-53ae3f9d6e0d tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.149825 Jul 14 09:41:28.257819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 256/536] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:28 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:28.847528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:28.848709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:28.854714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:28.855190 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:28.856026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:28.856458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:28.860525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:28.983710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:28.991836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:28.993323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:28.994492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d0a4539d-93f2-45e9-9f81-d766967a3a43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.150924 Jul 14 09:41:28.995039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 281/537] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:29.274151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-18d401c0-52c5-45ea-a8e2-abdc7bdae62f tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:29.274774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-18d401c0-52c5-45ea-a8e2-abdc7bdae62f tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:29.281243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18d401c0-52c5-45ea-a8e2-abdc7bdae62f tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:29.281684 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18d401c0-52c5-45ea-a8e2-abdc7bdae62f tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:29.282470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18d401c0-52c5-45ea-a8e2-abdc7bdae62f tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:29.282902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18d401c0-52c5-45ea-a8e2-abdc7bdae62f tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:29.414318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-18d401c0-52c5-45ea-a8e2-abdc7bdae62f tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:29.421532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-18d401c0-52c5-45ea-a8e2-abdc7bdae62f tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.151811 Jul 14 09:41:29.422086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 257/538] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:29 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:30.012911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:30.013515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:30.019654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:30.020108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:30.020879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:30.021315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:30.148386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:30.156129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:30.157615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:30.158771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2517e0a8-4bc0-48b6-9777-0b6aaa3ecee5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.149776 Jul 14 09:41:30.159317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 282/539] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:30.438602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cae29f52-8e85-4071-8448-a5e39411e744 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:30.439186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cae29f52-8e85-4071-8448-a5e39411e744 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:30.445880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cae29f52-8e85-4071-8448-a5e39411e744 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:30.446426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cae29f52-8e85-4071-8448-a5e39411e744 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:30.447177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cae29f52-8e85-4071-8448-a5e39411e744 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:30.447596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cae29f52-8e85-4071-8448-a5e39411e744 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:30.577845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cae29f52-8e85-4071-8448-a5e39411e744 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:30.585415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cae29f52-8e85-4071-8448-a5e39411e744 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.150759 Jul 14 09:41:30.585978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 258/540] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:30 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:31.177491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:31.178096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:31.184150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:31.184595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:31.185349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:31.185781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:31.312818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:31.321212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:31.322736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:31.323880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6ddf1664-cf05-4917-adbf-70ee4331c32d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.150316 Jul 14 09:41:31.324432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 283/541] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:31.601863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-15503544-5640-4463-99c1-bc08b50073be tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:31.602519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-15503544-5640-4463-99c1-bc08b50073be tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:31.608958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15503544-5640-4463-99c1-bc08b50073be tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:31.609395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15503544-5640-4463-99c1-bc08b50073be tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:31.610138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15503544-5640-4463-99c1-bc08b50073be tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:31.610587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15503544-5640-4463-99c1-bc08b50073be tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:31.741290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-15503544-5640-4463-99c1-bc08b50073be tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:31.748533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-15503544-5640-4463-99c1-bc08b50073be tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.150474 Jul 14 09:41:31.749087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 259/542] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:31 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:32.343156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:32.343759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:32.350834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:32.350954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:32.351634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:32.352063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:32.481578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:32.489711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:32.491250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:32.492392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-61e0b6f6-5a67-4968-bdb1-8b9765d161e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.153087 Jul 14 09:41:32.492938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 284/543] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:32.765037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1ffe5a5e-84df-4da0-8275-d373c3991ac8 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:32.765663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ffe5a5e-84df-4da0-8275-d373c3991ac8 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:32.773005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ffe5a5e-84df-4da0-8275-d373c3991ac8 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:32.773440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ffe5a5e-84df-4da0-8275-d373c3991ac8 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:32.774182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ffe5a5e-84df-4da0-8275-d373c3991ac8 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:32.774628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ffe5a5e-84df-4da0-8275-d373c3991ac8 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:32.994995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1ffe5a5e-84df-4da0-8275-d373c3991ac8 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:33.002673 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1ffe5a5e-84df-4da0-8275-d373c3991ac8 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.241386 Jul 14 09:41:33.003328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 260/544] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:32 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:33.511047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:33.511678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:33.517729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:33.518172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:33.518969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:33.519420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:33.600692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:33.665954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:33.673997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:33.675523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:33.676268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5cc29eed-3a2e-4a6e-8b50-4a0948596834 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:33.677218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-118ac873-8907-4405-841d-787148bce522 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.170067 Jul 14 09:41:33.677758 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 285/545] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:33.678614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:33.679275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=6 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:33.685091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5cc29eed-3a2e-4a6e-8b50-4a0948596834 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:33.685531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5cc29eed-3a2e-4a6e-8b50-4a0948596834 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:33.744678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5cc29eed-3a2e-4a6e-8b50-4a0948596834 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Going to try to stop instance {{(pid=129537) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 09:41:33.787456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5cc29eed-3a2e-4a6e-8b50-4a0948596834 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/action" status: 202 len: 0 microversion: 2.1 time: 0.115446 Jul 14 09:41:33.788465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 261/546] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:41:33 2022] POST /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 09:41:33.799140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f56f69e1-d6f6-47c8-9689-92fa7f721383 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:33.799749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f56f69e1-d6f6-47c8-9689-92fa7f721383 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:33.806321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f56f69e1-d6f6-47c8-9689-92fa7f721383 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:33.806773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f56f69e1-d6f6-47c8-9689-92fa7f721383 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:33.807534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f56f69e1-d6f6-47c8-9689-92fa7f721383 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:33.807971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f56f69e1-d6f6-47c8-9689-92fa7f721383 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:33.939077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f56f69e1-d6f6-47c8-9689-92fa7f721383 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:33.946974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f56f69e1-d6f6-47c8-9689-92fa7f721383 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.151669 Jul 14 09:41:33.947525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 286/547] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:33 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:34.020459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5fea5003-ffff-41c0-ba26-67b2754c17d6 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:34.021170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5fea5003-ffff-41c0-ba26-67b2754c17d6 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:34.027496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fea5003-ffff-41c0-ba26-67b2754c17d6 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:34.027870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fea5003-ffff-41c0-ba26-67b2754c17d6 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:34.028613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fea5003-ffff-41c0-ba26-67b2754c17d6 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:34.029042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fea5003-ffff-41c0-ba26-67b2754c17d6 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:34.156658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5fea5003-ffff-41c0-ba26-67b2754c17d6 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:34.164575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5fea5003-ffff-41c0-ba26-67b2754c17d6 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.148826 Jul 14 09:41:34.165134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 262/548] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:34 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:34.696388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:34.697016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:34.702977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:34.703416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:34.704165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:34.704592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:34.832432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:34.840410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:34.842033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:34.843208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0aa078ac-e14e-4914-9a94-7a767458ff7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.150721 Jul 14 09:41:34.843755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 287/549] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:34.965303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c82abce7-63f8-4dd7-a7fd-0398f6fe15c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:34.965839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c82abce7-63f8-4dd7-a7fd-0398f6fe15c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:34.972421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82abce7-63f8-4dd7-a7fd-0398f6fe15c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:34.972865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82abce7-63f8-4dd7-a7fd-0398f6fe15c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:34.973618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82abce7-63f8-4dd7-a7fd-0398f6fe15c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:34.974050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82abce7-63f8-4dd7-a7fd-0398f6fe15c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:35.099357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c82abce7-63f8-4dd7-a7fd-0398f6fe15c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:35.107220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c82abce7-63f8-4dd7-a7fd-0398f6fe15c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.145865 Jul 14 09:41:35.107779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 263/550] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:34 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:35.181609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fae56739-9f3d-444d-92aa-9e16842c6c5e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:35.181862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fae56739-9f3d-444d-92aa-9e16842c6c5e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:35.188195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fae56739-9f3d-444d-92aa-9e16842c6c5e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:35.188650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fae56739-9f3d-444d-92aa-9e16842c6c5e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:35.189408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fae56739-9f3d-444d-92aa-9e16842c6c5e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:35.189850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fae56739-9f3d-444d-92aa-9e16842c6c5e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:35.327947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fae56739-9f3d-444d-92aa-9e16842c6c5e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:35.336252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fae56739-9f3d-444d-92aa-9e16842c6c5e tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.158881 Jul 14 09:41:35.336806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 288/551] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:35 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:35.579759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-a4cc7cee-dfc1-467e-9354-f59d50638eaa req-e1122555-a629-4a44-a36a-f7e72cf17c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d19ecf-50af-42e3-a68b-e8e5c638e259", "name": "network-vif-plugged", "status": "completed", "tag": "509d4117-ecc9-42ab-b685-15f68e28c2e6"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:35.590166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-a4cc7cee-dfc1-467e-9354-f59d50638eaa req-e1122555-a629-4a44-a36a-f7e72cf17c7e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:35.590641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-a4cc7cee-dfc1-467e-9354-f59d50638eaa req-e1122555-a629-4a44-a36a-f7e72cf17c7e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:35.601986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-a4cc7cee-dfc1-467e-9354-f59d50638eaa req-e1122555-a629-4a44-a36a-f7e72cf17c7e service nova] Creating event network-vif-plugged:509d4117-ecc9-42ab-b685-15f68e28c2e6 for instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 on hv-cinder-82549 Jul 14 09:41:35.606710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-a4cc7cee-dfc1-467e-9354-f59d50638eaa req-e1122555-a629-4a44-a36a-f7e72cf17c7e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030593 Jul 14 09:41:35.607463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 264/552] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:41:35.860992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:35.861592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:35.868568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:35.869010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:35.869779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:35.870230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:36.015967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:36.024125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:36.025627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:36.026808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-60393890-a37f-4d92-9c57-d63db1399895 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.169929 Jul 14 09:41:36.027364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 289/553] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:36.125822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e528f43a-332f-40c8-ba74-05a8a94e8d74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:36.126456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e528f43a-332f-40c8-ba74-05a8a94e8d74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:36.132719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e528f43a-332f-40c8-ba74-05a8a94e8d74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:36.133198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e528f43a-332f-40c8-ba74-05a8a94e8d74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:36.133969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e528f43a-332f-40c8-ba74-05a8a94e8d74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:36.134439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e528f43a-332f-40c8-ba74-05a8a94e8d74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:36.265708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e528f43a-332f-40c8-ba74-05a8a94e8d74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:36.269732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:36.275036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e528f43a-332f-40c8-ba74-05a8a94e8d74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.153981 Jul 14 09:41:36.275597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 265/554] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:36 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:36.354416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-770336cb-9dda-4ab3-93b1-6bbd6b792db0 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:36.355023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-770336cb-9dda-4ab3-93b1-6bbd6b792db0 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:36.361104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-770336cb-9dda-4ab3-93b1-6bbd6b792db0 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:36.361549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-770336cb-9dda-4ab3-93b1-6bbd6b792db0 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:36.362335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-770336cb-9dda-4ab3-93b1-6bbd6b792db0 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:36.362771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-770336cb-9dda-4ab3-93b1-6bbd6b792db0 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:36.488262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-770336cb-9dda-4ab3-93b1-6bbd6b792db0 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:36.495543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-770336cb-9dda-4ab3-93b1-6bbd6b792db0 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.145001 Jul 14 09:41:36.496098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 290/555] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:36 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:37.048012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:37.048603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:37.055216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:37.055757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:37.056565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:37.056985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:37.186395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:37.194895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:37.196405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:37.197559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-196e9147-8f8f-4130-ab82-a621699fa02d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.154329 Jul 14 09:41:37.198120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 266/556] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:37.291692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7ff07f2f-794e-4710-b7f0-4b214ff75711 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:37.292293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7ff07f2f-794e-4710-b7f0-4b214ff75711 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:37.298381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ff07f2f-794e-4710-b7f0-4b214ff75711 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:37.298769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ff07f2f-794e-4710-b7f0-4b214ff75711 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:37.299515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ff07f2f-794e-4710-b7f0-4b214ff75711 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:37.299942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ff07f2f-794e-4710-b7f0-4b214ff75711 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:37.425601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7ff07f2f-794e-4710-b7f0-4b214ff75711 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:37.433549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7ff07f2f-794e-4710-b7f0-4b214ff75711 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.145667 Jul 14 09:41:37.434110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 291/557] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:37 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:37.512546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-273e6ca2-f70c-4eb4-8de4-fb7d78a14676 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:37.513156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-273e6ca2-f70c-4eb4-8de4-fb7d78a14676 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:37.519843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-273e6ca2-f70c-4eb4-8de4-fb7d78a14676 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:37.520315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-273e6ca2-f70c-4eb4-8de4-fb7d78a14676 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:37.521073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-273e6ca2-f70c-4eb4-8de4-fb7d78a14676 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:37.521504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-273e6ca2-f70c-4eb4-8de4-fb7d78a14676 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:37.651834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-273e6ca2-f70c-4eb4-8de4-fb7d78a14676 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:37.659196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-273e6ca2-f70c-4eb4-8de4-fb7d78a14676 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1315 microversion: 2.1 time: 0.150516 Jul 14 09:41:37.659812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 267/558] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:37 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:38.216795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:38.217392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:38.223952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.224394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.225308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.225750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.353715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:38.361784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:38.363318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:38.364462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9fa177ff-de7a-4fd3-88c5-7294ce3230c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.151536 Jul 14 09:41:38.365006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 292/559] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:38.450220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6bf8fd07-852c-4107-93f4-15ce8c25961a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:38.450940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6bf8fd07-852c-4107-93f4-15ce8c25961a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:38.458783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bf8fd07-852c-4107-93f4-15ce8c25961a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.459512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bf8fd07-852c-4107-93f4-15ce8c25961a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.460003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bf8fd07-852c-4107-93f4-15ce8c25961a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.460481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bf8fd07-852c-4107-93f4-15ce8c25961a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.592805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6bf8fd07-852c-4107-93f4-15ce8c25961a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:38.601517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6bf8fd07-852c-4107-93f4-15ce8c25961a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.155187 Jul 14 09:41:38.602071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 268/560] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:38 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:38.675738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7b20cffb-9760-4acb-acc6-693339310dae tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:38.676343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7b20cffb-9760-4acb-acc6-693339310dae tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:38.682452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b20cffb-9760-4acb-acc6-693339310dae tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.682863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b20cffb-9760-4acb-acc6-693339310dae tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.683624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b20cffb-9760-4acb-acc6-693339310dae tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.684055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b20cffb-9760-4acb-acc6-693339310dae tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.813108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7b20cffb-9760-4acb-acc6-693339310dae tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:38.821035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7b20cffb-9760-4acb-acc6-693339310dae tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1464 microversion: 2.1 time: 0.149144 Jul 14 09:41:38.821595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 293/561] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:38 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:38.861199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c91d9d4e-a044-4929-b79e-4a2b222e2316 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:38.861683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c91d9d4e-a044-4929-b79e-4a2b222e2316 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:38.868359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c91d9d4e-a044-4929-b79e-4a2b222e2316 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.868793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c91d9d4e-a044-4929-b79e-4a2b222e2316 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.869535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c91d9d4e-a044-4929-b79e-4a2b222e2316 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.869972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c91d9d4e-a044-4929-b79e-4a2b222e2316 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.894349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c91d9d4e-a044-4929-b79e-4a2b222e2316 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:41:38.975543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c91d9d4e-a044-4929-b79e-4a2b222e2316 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "DELETE /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 204 len: 0 microversion: 2.1 time: 0.117697 Jul 14 09:41:38.976121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 269/562] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:41:38 2022] DELETE /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:41:38.984175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8de24c9e-b180-40a8-bf25-38554d6c4563 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:38.984967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8de24c9e-b180-40a8-bf25-38554d6c4563 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:38.992208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8de24c9e-b180-40a8-bf25-38554d6c4563 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.992659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8de24c9e-b180-40a8-bf25-38554d6c4563 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:38.993448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8de24c9e-b180-40a8-bf25-38554d6c4563 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:38.993878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8de24c9e-b180-40a8-bf25-38554d6c4563 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:39.119514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8de24c9e-b180-40a8-bf25-38554d6c4563 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:39.127031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8de24c9e-b180-40a8-bf25-38554d6c4563 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1470 microversion: 2.1 time: 0.146623 Jul 14 09:41:39.127449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 294/563] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:38 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:39.382815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:39.383414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:39.389404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:39.389840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:39.390615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:39.391037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:39.526925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:39.534895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:39.536631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:39.537762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-49eac45b-a7d5-4d8d-af2c-b08e1fc051b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1722 microversion: 2.20 time: 0.159830 Jul 14 09:41:39.538326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 270/564] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:39.618496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a60e09c4-9e64-42e2-8315-27d0da5744cf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:39.619107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a60e09c4-9e64-42e2-8315-27d0da5744cf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:39.625122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a60e09c4-9e64-42e2-8315-27d0da5744cf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:39.625563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a60e09c4-9e64-42e2-8315-27d0da5744cf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:39.626345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a60e09c4-9e64-42e2-8315-27d0da5744cf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:39.626779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a60e09c4-9e64-42e2-8315-27d0da5744cf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:39.753240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a60e09c4-9e64-42e2-8315-27d0da5744cf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:39.761638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a60e09c4-9e64-42e2-8315-27d0da5744cf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.147078 Jul 14 09:41:39.762201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 295/565] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:39 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:40.143352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2e32e0bc-b29f-4e5f-bb90-a66cb7c32ab1 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:40.143879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2e32e0bc-b29f-4e5f-bb90-a66cb7c32ab1 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:40.149868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e32e0bc-b29f-4e5f-bb90-a66cb7c32ab1 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:40.150342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e32e0bc-b29f-4e5f-bb90-a66cb7c32ab1 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:40.151096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e32e0bc-b29f-4e5f-bb90-a66cb7c32ab1 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:40.151520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e32e0bc-b29f-4e5f-bb90-a66cb7c32ab1 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:40.282674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2e32e0bc-b29f-4e5f-bb90-a66cb7c32ab1 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:40.290467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2e32e0bc-b29f-4e5f-bb90-a66cb7c32ab1 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1470 microversion: 2.1 time: 0.151147 Jul 14 09:41:40.291272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 271/566] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:40 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:40.555922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:40.556694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:40.562746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:40.563192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:40.563954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:40.564388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:40.692409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:40.700345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:40.701836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:40.702999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-98450e6c-2f6d-433d-9e5c-a147657c1152 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1743 microversion: 2.20 time: 0.151186 Jul 14 09:41:40.703542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 296/567] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:40.779291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-79ba4e6e-57e7-4662-80ae-babc12df07ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:40.779917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-79ba4e6e-57e7-4662-80ae-babc12df07ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:40.787003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79ba4e6e-57e7-4662-80ae-babc12df07ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:40.787443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79ba4e6e-57e7-4662-80ae-babc12df07ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:40.788192 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79ba4e6e-57e7-4662-80ae-babc12df07ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:40.788618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79ba4e6e-57e7-4662-80ae-babc12df07ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:40.925055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-79ba4e6e-57e7-4662-80ae-babc12df07ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:40.936258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-79ba4e6e-57e7-4662-80ae-babc12df07ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.160645 Jul 14 09:41:40.936905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 272/568] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:40 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:41.308606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-550f3a36-383d-4141-8887-3771e03c5eb9 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:41.309401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-550f3a36-383d-4141-8887-3771e03c5eb9 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:41.315678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-550f3a36-383d-4141-8887-3771e03c5eb9 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:41.316123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-550f3a36-383d-4141-8887-3771e03c5eb9 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:41.316877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-550f3a36-383d-4141-8887-3771e03c5eb9 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:41.317930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-550f3a36-383d-4141-8887-3771e03c5eb9 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:41.394056 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-550f3a36-383d-4141-8887-3771e03c5eb9 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3d903b658e4039a110cd24e1691386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58df2f717fcd44939fa909c6d0bdbf79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:41.398097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:41.403431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-550f3a36-383d-4141-8887-3771e03c5eb9 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 200 len: 1428 microversion: 2.1 time: 0.099138 Jul 14 09:41:41.403988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 297/569] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:41 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:41.473407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-4831ddcb-60a3-4b6f-a5ad-a0018a38778f req-f3b2fd85-d9a2-4020-bdfa-4d6e829b19d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d19ecf-50af-42e3-a68b-e8e5c638e259", "name": "network-vif-deleted", "tag": "509d4117-ecc9-42ab-b685-15f68e28c2e6"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:41.481951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-4831ddcb-60a3-4b6f-a5ad-a0018a38778f req-f3b2fd85-d9a2-4020-bdfa-4d6e829b19d0 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:41.482491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-4831ddcb-60a3-4b6f-a5ad-a0018a38778f req-f3b2fd85-d9a2-4020-bdfa-4d6e829b19d0 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:41.495249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-4831ddcb-60a3-4b6f-a5ad-a0018a38778f req-f3b2fd85-d9a2-4020-bdfa-4d6e829b19d0 service nova] Creating event network-vif-deleted:509d4117-ecc9-42ab-b685-15f68e28c2e6 for instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 on hv-cinder-82549 Jul 14 09:41:41.500437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-4831ddcb-60a3-4b6f-a5ad-a0018a38778f req-f3b2fd85-d9a2-4020-bdfa-4d6e829b19d0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030989 Jul 14 09:41:41.501042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 273/570] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:41:41.721626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:41.722166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:41.728637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:41.729073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:41.729821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:41.730275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:41.858268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:41.866798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:41.868362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:41.869532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-aeee7bff-51b6-4940-929f-fe27c3e8af5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1743 microversion: 2.20 time: 0.152158 Jul 14 09:41:41.870078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 298/571] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:41.955283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-452f9619-5d7a-474f-ba91-4da4ec4acdd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:41.956232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-452f9619-5d7a-474f-ba91-4da4ec4acdd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:41.963019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-452f9619-5d7a-474f-ba91-4da4ec4acdd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:41.963473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-452f9619-5d7a-474f-ba91-4da4ec4acdd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:41.964277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-452f9619-5d7a-474f-ba91-4da4ec4acdd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:41.964705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-452f9619-5d7a-474f-ba91-4da4ec4acdd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:42.097029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-452f9619-5d7a-474f-ba91-4da4ec4acdd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:42.105899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-452f9619-5d7a-474f-ba91-4da4ec4acdd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.155301 Jul 14 09:41:42.106524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 274/572] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:42.420464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:42.421068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] [instance: 91d19ecf-50af-42e3-a68b-e8e5c638e259] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:42.428371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:42.428371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:42.428371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:42.428814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:42.441989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] HTTP exception thrown: Instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 could not be found. Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Request method failure captured: Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 HTTP/1.1 Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-TAgkbME7pvHyzWvBen1nQn-B12eq9h1My28lMsFkba4bOIxYBtGyZCxWgt_wwIHI5QF0kA1-j8viaQPTc4UuwW63w5MXk16uHa6spQsMwatcGucDnEJ7pqUIYxm0phgvnAvdE63lbjDEGsvn6Tt5doG-4FzbyK2qd2yhrOX2RkUdY Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 58df2f717fcd44939fa909c6d0bdbf79 Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesNegativeTest-65373211 Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:41:42.444171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/58df2f717fcd44939fa909c6d0bdbf79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/58df2f717fcd44939fa909c6d0bdbf79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/58df2f717fcd44939fa909c6d0bdbf79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_58df2f717fcd44939fa909c6d0bdbf79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesNegativeTest-65373211 Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 58df2f717fcd44939fa909c6d0bdbf79 Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesNegativeTest-65373211 Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesNegativeTest-65373211-project Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1f3d903b658e4039a110cd24e1691386 Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesNegativeTest-65373211-project Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 could not be found. Jul 14 09:41:42.445685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '91d19ecf-50af-42e3-a68b-e8e5c638e259'} Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 could not be found. Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:41:42.446594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 could not be found. Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 could not be found. Jul 14 09:41:42.448246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:41:42.449572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] Returning 404 to user: Instance 91d19ecf-50af-42e3-a68b-e8e5c638e259 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:41:42.449572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-91aae267-61ba-4646-bc9a-6ff8fab3b343 tempest-VolumesNegativeTest-65373211 tempest-VolumesNegativeTest-65373211-project] 10.222.0.40 "GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259" status: 404 len: 111 microversion: 2.1 time: 0.028943 Jul 14 09:41:42.449572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 299/573] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:42 2022] GET /compute/v2.1/servers/91d19ecf-50af-42e3-a68b-e8e5c638e259 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:41:42.887717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:42.888244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:42.895212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:42.895650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:42.896402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:42.896827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:43.027945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:43.036118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:43.037608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:43.038903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b229d9ba-c191-49d6-886e-a1a6f59d5e9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1743 microversion: 2.20 time: 0.155041 Jul 14 09:41:43.039454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 275/574] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:43.123437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5fc6c59b-5ec4-491d-ad14-d3bdc0057fe6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:43.124047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5fc6c59b-5ec4-491d-ad14-d3bdc0057fe6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:43.130715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fc6c59b-5ec4-491d-ad14-d3bdc0057fe6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:43.131402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fc6c59b-5ec4-491d-ad14-d3bdc0057fe6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:43.132208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fc6c59b-5ec4-491d-ad14-d3bdc0057fe6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:43.132640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fc6c59b-5ec4-491d-ad14-d3bdc0057fe6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:43.267297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5fc6c59b-5ec4-491d-ad14-d3bdc0057fe6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:43.275701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5fc6c59b-5ec4-491d-ad14-d3bdc0057fe6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.156299 Jul 14 09:41:43.276254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 300/575] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:44.057278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:44.058402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:44.065184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:44.065626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:44.066408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:44.067531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:44.208474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:44.216649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:44.218146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:44.219358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c0ab75bd-79df-4284-9375-8a28e6e52136 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1743 microversion: 2.20 time: 0.166117 Jul 14 09:41:44.219902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 276/576] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:44.292350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-152ccc1b-1fdf-4e93-a118-e2ae6d4b0313 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:44.292962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-152ccc1b-1fdf-4e93-a118-e2ae6d4b0313 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:44.299076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-152ccc1b-1fdf-4e93-a118-e2ae6d4b0313 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:44.299517 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-152ccc1b-1fdf-4e93-a118-e2ae6d4b0313 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:44.300271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-152ccc1b-1fdf-4e93-a118-e2ae6d4b0313 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:44.300701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-152ccc1b-1fdf-4e93-a118-e2ae6d4b0313 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:44.436602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-152ccc1b-1fdf-4e93-a118-e2ae6d4b0313 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:44.445244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-152ccc1b-1fdf-4e93-a118-e2ae6d4b0313 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.156713 Jul 14 09:41:44.445803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 301/577] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:44 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:45.237979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:45.238646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:45.245239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:45.245686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:45.246479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:45.246916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:45.381195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:45.389064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:45.390844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:45.392346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ccb82eab-e4a1-4c9f-8ecd-e6847916227e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1743 microversion: 2.20 time: 0.159014 Jul 14 09:41:45.392898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 277/578] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:45.462910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-59415f98-1e82-4a8e-8c3f-84020683e7d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:45.463539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-59415f98-1e82-4a8e-8c3f-84020683e7d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:45.469436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59415f98-1e82-4a8e-8c3f-84020683e7d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:45.469875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59415f98-1e82-4a8e-8c3f-84020683e7d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:45.470666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59415f98-1e82-4a8e-8c3f-84020683e7d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:45.471094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59415f98-1e82-4a8e-8c3f-84020683e7d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:45.599534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-59415f98-1e82-4a8e-8c3f-84020683e7d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:45.606658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-42302087-93e3-4da2-a246-b998aa2537f0 req-25a93bb0-e0d7-4392-803d-c091bf37b1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00a0737-b755-4d07-a5a1-8b691911836f", "name": "network-vif-plugged", "status": "completed", "tag": "1975270c-eaaa-4443-9916-238cad412d51"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:45.609045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-59415f98-1e82-4a8e-8c3f-84020683e7d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.149628 Jul 14 09:41:45.609576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 302/579] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:45 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:45.614302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:45.616580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-42302087-93e3-4da2-a246-b998aa2537f0 req-25a93bb0-e0d7-4392-803d-c091bf37b1e2 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:45.616976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-42302087-93e3-4da2-a246-b998aa2537f0 req-25a93bb0-e0d7-4392-803d-c091bf37b1e2 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:45.629972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-42302087-93e3-4da2-a246-b998aa2537f0 req-25a93bb0-e0d7-4392-803d-c091bf37b1e2 service nova] Creating event network-vif-plugged:1975270c-eaaa-4443-9916-238cad412d51 for instance a00a0737-b755-4d07-a5a1-8b691911836f on hv-cinder-82549 Jul 14 09:41:45.635361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-42302087-93e3-4da2-a246-b998aa2537f0 req-25a93bb0-e0d7-4392-803d-c091bf37b1e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033318 Jul 14 09:41:45.635916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 278/580] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:41:46.411648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:46.412258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:46.418282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:46.418734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:46.419502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:46.419942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:46.584963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:46.595982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:46.597530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:46.599349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e52f9423-6a75-4d57-a122-1dc4ddfebda0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1743 microversion: 2.20 time: 0.192185 Jul 14 09:41:46.599899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 303/581] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:41:46.627439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8ef09cf7-7be1-4644-a229-1fd42a88b025 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:46.628223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8ef09cf7-7be1-4644-a229-1fd42a88b025 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:46.637363 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ef09cf7-7be1-4644-a229-1fd42a88b025 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:46.637814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ef09cf7-7be1-4644-a229-1fd42a88b025 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:46.638654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ef09cf7-7be1-4644-a229-1fd42a88b025 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:46.639094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ef09cf7-7be1-4644-a229-1fd42a88b025 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:46.776102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8ef09cf7-7be1-4644-a229-1fd42a88b025 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:46.784227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8ef09cf7-7be1-4644-a229-1fd42a88b025 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.161170 Jul 14 09:41:46.785512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 279/582] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:46 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:47.617994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:47.618784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:47.625395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:47.625922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:47.626810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:47.627312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:47.763032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:47.771107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:47.772617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:47.773773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0e3ec6c8-ef88-47f9-abea-362ea12833d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1743 microversion: 2.20 time: 0.160488 Jul 14 09:41:47.774352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 304/583] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:47.802790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-caeb49ab-45f3-4745-a964-0b1f70b23502 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:47.803399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-caeb49ab-45f3-4745-a964-0b1f70b23502 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:47.809973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caeb49ab-45f3-4745-a964-0b1f70b23502 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:47.810444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caeb49ab-45f3-4745-a964-0b1f70b23502 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:47.811197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caeb49ab-45f3-4745-a964-0b1f70b23502 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:47.811620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caeb49ab-45f3-4745-a964-0b1f70b23502 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:47.946767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-caeb49ab-45f3-4745-a964-0b1f70b23502 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:47.956131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-caeb49ab-45f3-4745-a964-0b1f70b23502 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.157840 Jul 14 09:41:47.956706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 280/584] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:48.791399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:48.792003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:48.797888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:48.798371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:48.799122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:48.799548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:48.963787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:48.974454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:48.976349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:48.977645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ef1edf96-d4eb-49b1-826d-c2c2db62326a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1743 microversion: 2.20 time: 0.190057 Jul 14 09:41:48.978317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 305/585] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:48.978815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3792a6c0-5c8b-4cdd-9a2e-a89780bbad73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:48.979494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3792a6c0-5c8b-4cdd-9a2e-a89780bbad73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:48.987758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3792a6c0-5c8b-4cdd-9a2e-a89780bbad73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:48.988446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3792a6c0-5c8b-4cdd-9a2e-a89780bbad73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:48.990031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3792a6c0-5c8b-4cdd-9a2e-a89780bbad73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:48.990546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3792a6c0-5c8b-4cdd-9a2e-a89780bbad73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:49.162003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3792a6c0-5c8b-4cdd-9a2e-a89780bbad73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:49.170025 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3792a6c0-5c8b-4cdd-9a2e-a89780bbad73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.198479 Jul 14 09:41:49.170617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 281/586] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:48 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:41:49.595459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-498099651", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "networks": [{"uuid": "33e7d33f-d1db-4bcf-8519-11d88fe2947e"}]}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:49.603176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=78 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:49.655329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] validate_networks() for [('33e7d33f-d1db-4bcf-8519-11d88fe2947e', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:41:49.997256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:49.997794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:50.006432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:50.007119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:50.008139 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:50.008773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:50.013665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:50.071182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:41:50.072134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:41:50.072792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:41:50.073363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:41:50.074023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:41:50.095026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:50.098360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:50.099828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:50.100534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:50.140999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Getting quotas for project 6bf7eec88bc64cd2be062020a72563de. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:41:50.150352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Getting quotas for user 08962a3ebb194189b2ab68e62fee6e60 and project 6bf7eec88bc64cd2be062020a72563de. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:41:50.163997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:50.175682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:50.177654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:50.179305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a875485f-1dee-4839-82ef-e878b75b0ae5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.186323 Jul 14 09:41:50.180745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:41:50.180982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 282/587] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:41:50.185067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:41:50.196100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ff9f181d-366c-46fa-bc04-959fb9edeabc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:50.197539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ff9f181d-366c-46fa-bc04-959fb9edeabc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:50.206697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ff9f181d-366c-46fa-bc04-959fb9edeabc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:50.208091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ff9f181d-366c-46fa-bc04-959fb9edeabc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:50.209334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ff9f181d-366c-46fa-bc04-959fb9edeabc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:50.210011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ff9f181d-366c-46fa-bc04-959fb9edeabc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:50.254774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e68ca515-6d18-4f79-92ab-bff15c057de1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662910 Jul 14 09:41:50.255712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 306/588] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:41:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:41:50.266565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2d0d8132-87de-4dfe-b821-c0dc109001de tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:50.267189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2d0d8132-87de-4dfe-b821-c0dc109001de tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:50.336138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2d0d8132-87de-4dfe-b821-c0dc109001de tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:50.345872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2d0d8132-87de-4dfe-b821-c0dc109001de tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1218 microversion: 2.1 time: 0.083212 Jul 14 09:41:50.356099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 307/589] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:50 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:50.424699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ff9f181d-366c-46fa-bc04-959fb9edeabc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:50.437232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ff9f181d-366c-46fa-bc04-959fb9edeabc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.252535 Jul 14 09:41:50.438665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 283/590] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:50 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:51.197700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:51.198538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:51.205185 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:51.205976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:51.206836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:51.207874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:51.363244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-20d77ae9-fe84-4e3c-97de-8098216a59e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:51.363843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:51.364844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-20d77ae9-fe84-4e3c-97de-8098216a59e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:51.372700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:51.373143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-20d77ae9-fe84-4e3c-97de-8098216a59e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:51.373811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-20d77ae9-fe84-4e3c-97de-8098216a59e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:51.374310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:51.375055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-20d77ae9-fe84-4e3c-97de-8098216a59e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:51.375478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-06916bc5-13ba-4130-a122-5aaec0a96f26 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.181677 Jul 14 09:41:51.376028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 308/591] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:51.376593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-20d77ae9-fe84-4e3c-97de-8098216a59e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:51.450073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-20d77ae9-fe84-4e3c-97de-8098216a59e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:51.455779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fef553ac-c0e7-4345-a638-de66f092d8a2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:51.457147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fef553ac-c0e7-4345-a638-de66f092d8a2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:51.462347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-20d77ae9-fe84-4e3c-97de-8098216a59e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1270 microversion: 2.1 time: 0.102721 Jul 14 09:41:51.463478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 284/592] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:51 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:51.470842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fef553ac-c0e7-4345-a638-de66f092d8a2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:51.471418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fef553ac-c0e7-4345-a638-de66f092d8a2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:51.472502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fef553ac-c0e7-4345-a638-de66f092d8a2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:51.473050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fef553ac-c0e7-4345-a638-de66f092d8a2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:51.793596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fef553ac-c0e7-4345-a638-de66f092d8a2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:51.803652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fef553ac-c0e7-4345-a638-de66f092d8a2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.351854 Jul 14 09:41:51.804314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 309/593] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:51 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:52.394844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:52.395818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:52.402689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:52.403130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:52.403894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:52.404426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:52.480019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0d155f5f-ca26-4acc-aa66-f289400dda21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:52.481252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0d155f5f-ca26-4acc-aa66-f289400dda21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:52.487691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d155f5f-ca26-4acc-aa66-f289400dda21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:52.488073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d155f5f-ca26-4acc-aa66-f289400dda21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:52.489419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d155f5f-ca26-4acc-aa66-f289400dda21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:52.489859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d155f5f-ca26-4acc-aa66-f289400dda21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:52.718457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:52.732371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:52.733897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:52.735862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-09471d73-67e1-4d9f-9e93-796966894b10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.345376 Jul 14 09:41:52.738034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 285/594] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:52.754920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0d155f5f-ca26-4acc-aa66-f289400dda21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:52.762757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0d155f5f-ca26-4acc-aa66-f289400dda21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.286450 Jul 14 09:41:52.764011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 310/595] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:52 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:41:52.821255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1a14c422-a824-47be-9921-af37dc273d2e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:52.822909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1a14c422-a824-47be-9921-af37dc273d2e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:52.829596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1a14c422-a824-47be-9921-af37dc273d2e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:52.830044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1a14c422-a824-47be-9921-af37dc273d2e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:52.831102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1a14c422-a824-47be-9921-af37dc273d2e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:52.831532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1a14c422-a824-47be-9921-af37dc273d2e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:53.118022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1a14c422-a824-47be-9921-af37dc273d2e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:53.126727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1a14c422-a824-47be-9921-af37dc273d2e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.309104 Jul 14 09:41:53.132203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 286/596] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:52 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:53.537647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-9035051f-7198-4e5e-a638-edf6a9dc707a req-07c0606e-b5f6-4d45-84a9-fd6d03febe21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21359018-1e48-4ba4-9529-a19b35577d59", "tag": "e5ba949a-2ace-47d1-a8b3-aa70ff78fa5e"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:53.562588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-9035051f-7198-4e5e-a638-edf6a9dc707a req-07c0606e-b5f6-4d45-84a9-fd6d03febe21 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:53.563418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-9035051f-7198-4e5e-a638-edf6a9dc707a req-07c0606e-b5f6-4d45-84a9-fd6d03febe21 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:53.576305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-9035051f-7198-4e5e-a638-edf6a9dc707a req-07c0606e-b5f6-4d45-84a9-fd6d03febe21 service nova] Creating event network-changed:e5ba949a-2ace-47d1-a8b3-aa70ff78fa5e for instance 21359018-1e48-4ba4-9529-a19b35577d59 on hv-cinder-82549 Jul 14 09:41:53.582559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-9035051f-7198-4e5e-a638-edf6a9dc707a req-07c0606e-b5f6-4d45-84a9-fd6d03febe21 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057636 Jul 14 09:41:53.583742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 311/597] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:41:53.756537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:53.757370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:53.766211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:53.766892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:53.768015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:53.768598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:53.790936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-42227c74-9bfa-4fa7-a1a3-3281b8546d61 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:53.792503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-42227c74-9bfa-4fa7-a1a3-3281b8546d61 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:53.803302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-42227c74-9bfa-4fa7-a1a3-3281b8546d61 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:53.804092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-42227c74-9bfa-4fa7-a1a3-3281b8546d61 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:53.805135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-42227c74-9bfa-4fa7-a1a3-3281b8546d61 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:53.805801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-42227c74-9bfa-4fa7-a1a3-3281b8546d61 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:54.111804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:54.121689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:54.124549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:54.125737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-25a6e2b3-194f-4cbb-92d0-537871d8413d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.373652 Jul 14 09:41:54.137516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 287/598] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:54.137902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-42227c74-9bfa-4fa7-a1a3-3281b8546d61 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:54.140960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-42227c74-9bfa-4fa7-a1a3-3281b8546d61 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.361802 Jul 14 09:41:54.142281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 312/599] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:53 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:54.145765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a2e106be-450d-494a-98c9-d86938796023 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:54.146647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a2e106be-450d-494a-98c9-d86938796023 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:54.153231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a2e106be-450d-494a-98c9-d86938796023 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:54.153682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a2e106be-450d-494a-98c9-d86938796023 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:54.154557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a2e106be-450d-494a-98c9-d86938796023 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:54.154988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a2e106be-450d-494a-98c9-d86938796023 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:54.308333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a2e106be-450d-494a-98c9-d86938796023 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:54.321163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a2e106be-450d-494a-98c9-d86938796023 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1724 microversion: 2.1 time: 0.178380 Jul 14 09:41:54.322927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 288/600] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:54 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:41:55.145669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:55.146384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:55.157583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2e5f3fea-735c-4a49-aee1-ca8a8a180de9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:55.158181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2e5f3fea-735c-4a49-aee1-ca8a8a180de9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:55.165286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.166068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.166457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e5f3fea-735c-4a49-aee1-ca8a8a180de9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.166926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e5f3fea-735c-4a49-aee1-ca8a8a180de9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.167594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.167784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e5f3fea-735c-4a49-aee1-ca8a8a180de9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.168339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.168459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e5f3fea-735c-4a49-aee1-ca8a8a180de9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.369170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2e5f3fea-735c-4a49-aee1-ca8a8a180de9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:55.373295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:55.377790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2e5f3fea-735c-4a49-aee1-ca8a8a180de9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.224044 Jul 14 09:41:55.387692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 289/601] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:55 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:55.387692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-81da6e3a-e5da-4468-aead-4716c0b12f03 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:55.387692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-81da6e3a-e5da-4468-aead-4716c0b12f03 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:55.388054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:55.388873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:55.390967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81da6e3a-e5da-4468-aead-4716c0b12f03 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.391448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81da6e3a-e5da-4468-aead-4716c0b12f03 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.392220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81da6e3a-e5da-4468-aead-4716c0b12f03 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.392803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81da6e3a-e5da-4468-aead-4716c0b12f03 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.398336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ef2798ea-9ea2-4e4b-83e9-19d173c5e6e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.252648 Jul 14 09:41:55.398960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 313/602] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:55.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-81da6e3a-e5da-4468-aead-4716c0b12f03 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:55.551224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-81da6e3a-e5da-4468-aead-4716c0b12f03 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1701 microversion: 2.1 time: 0.170278 Jul 14 09:41:55.551804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 290/603] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:55 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1701 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:55.569082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a68cd30e-afcb-4c65-9c6b-1002cb9db878 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:41:55.575657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a68cd30e-afcb-4c65-9c6b-1002cb9db878 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.576103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a68cd30e-afcb-4c65-9c6b-1002cb9db878 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.641625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a68cd30e-afcb-4c65-9c6b-1002cb9db878 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Going to try to start instance {{(pid=129536) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 09:41:55.694481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a68cd30e-afcb-4c65-9c6b-1002cb9db878 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/action" status: 202 len: 0 microversion: 2.1 time: 0.130242 Jul 14 09:41:55.695081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 314/604] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:41:55 2022] POST /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 09:41:55.703467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5fccea41-7ede-41d9-950e-4de4902076fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:55.704117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5fccea41-7ede-41d9-950e-4de4902076fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:55.710525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fccea41-7ede-41d9-950e-4de4902076fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.711043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fccea41-7ede-41d9-950e-4de4902076fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.711813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fccea41-7ede-41d9-950e-4de4902076fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:55.712244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fccea41-7ede-41d9-950e-4de4902076fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:55.852205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5fccea41-7ede-41d9-950e-4de4902076fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:55.860765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5fccea41-7ede-41d9-950e-4de4902076fd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1710 microversion: 2.1 time: 0.161311 Jul 14 09:41:55.861332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 291/605] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:55 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:56.399742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1a6834ad-57d3-4132-a553-58158a84b6c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:56.401620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1a6834ad-57d3-4132-a553-58158a84b6c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:56.408344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a6834ad-57d3-4132-a553-58158a84b6c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:56.409177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a6834ad-57d3-4132-a553-58158a84b6c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:56.410220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a6834ad-57d3-4132-a553-58158a84b6c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:56.410656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a6834ad-57d3-4132-a553-58158a84b6c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:56.421210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:56.422219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:56.429321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:56.429853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:56.430954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:56.431499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:56.648960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1a6834ad-57d3-4132-a553-58158a84b6c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:56.651043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:56.658628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1a6834ad-57d3-4132-a553-58158a84b6c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.266265 Jul 14 09:41:56.659458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 315/606] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:56 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:56.670176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:56.671987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:56.673329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f34a924c-645b-4531-807d-b3b64bdc9775 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.256092 Jul 14 09:41:56.674354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 292/607] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:41:56.878898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-81e6d2b1-322b-4b7a-8dfb-82bfacc7778d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:56.879508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-81e6d2b1-322b-4b7a-8dfb-82bfacc7778d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:56.886696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81e6d2b1-322b-4b7a-8dfb-82bfacc7778d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:56.887317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81e6d2b1-322b-4b7a-8dfb-82bfacc7778d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:56.888094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81e6d2b1-322b-4b7a-8dfb-82bfacc7778d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:56.888536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81e6d2b1-322b-4b7a-8dfb-82bfacc7778d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:56.908385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:41:57.039100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-81e6d2b1-322b-4b7a-8dfb-82bfacc7778d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:57.047409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-81e6d2b1-322b-4b7a-8dfb-82bfacc7778d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1710 microversion: 2.1 time: 0.172480 Jul 14 09:41:57.064926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 316/608] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:56 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:57.676415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ba8e3a61-39c1-4a90-baf5-3976caf768ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:57.677685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ba8e3a61-39c1-4a90-baf5-3976caf768ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:57.684794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba8e3a61-39c1-4a90-baf5-3976caf768ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:57.685505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba8e3a61-39c1-4a90-baf5-3976caf768ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:57.686503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba8e3a61-39c1-4a90-baf5-3976caf768ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:57.687175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba8e3a61-39c1-4a90-baf5-3976caf768ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:57.695507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:57.696276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:57.704216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:57.704796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:57.706216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:57.713246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:58.074210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ba8e3a61-39c1-4a90-baf5-3976caf768ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:58.077466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:58.093166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:58.094944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:58.095910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ba8e3a61-39c1-4a90-baf5-3976caf768ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.416941 Jul 14 09:41:58.096706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 293/609] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:57 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:58.097121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e95aed37-4a1e-453e-83e9-bafcc2c62ecf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.405500 Jul 14 09:41:58.114161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c82e67e6-54a3-4842-96d9-1017939902ed tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:58.114397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 317/610] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:41:58.116024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c82e67e6-54a3-4842-96d9-1017939902ed tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:58.126283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82e67e6-54a3-4842-96d9-1017939902ed tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:58.127072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82e67e6-54a3-4842-96d9-1017939902ed tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:58.128062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82e67e6-54a3-4842-96d9-1017939902ed tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:58.129237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82e67e6-54a3-4842-96d9-1017939902ed tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:58.358586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c82e67e6-54a3-4842-96d9-1017939902ed tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:58.378127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c82e67e6-54a3-4842-96d9-1017939902ed tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1710 microversion: 2.1 time: 0.277421 Jul 14 09:41:58.387912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 294/611] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:58 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1710 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:59.117533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-691b3704-b9f9-4d76-b601-4ce4743fbf25 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:59.118966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-691b3704-b9f9-4d76-b601-4ce4743fbf25 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:59.120217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:59.120948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:59.126265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-691b3704-b9f9-4d76-b601-4ce4743fbf25 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:59.127010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-691b3704-b9f9-4d76-b601-4ce4743fbf25 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:59.127882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:59.128244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-691b3704-b9f9-4d76-b601-4ce4743fbf25 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:59.129159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:59.129679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-691b3704-b9f9-4d76-b601-4ce4743fbf25 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:59.130060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:59.130522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:59.351963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:59.360723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:59.362268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:59.364006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e3174143-86d2-4430-9e64-1927139d3e85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.247954 Jul 14 09:41:59.364558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 295/612] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:41:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:41:59.365816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-691b3704-b9f9-4d76-b601-4ce4743fbf25 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:59.381376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-691b3704-b9f9-4d76-b601-4ce4743fbf25 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.269236 Jul 14 09:41:59.386239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 318/613] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:59 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:41:59.399521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bc72029d-ea0c-4ec8-9b24-6e71265eff84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:41:59.400439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bc72029d-ea0c-4ec8-9b24-6e71265eff84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:41:59.407374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc72029d-ea0c-4ec8-9b24-6e71265eff84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:59.407835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc72029d-ea0c-4ec8-9b24-6e71265eff84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:59.408604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc72029d-ea0c-4ec8-9b24-6e71265eff84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:41:59.409040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc72029d-ea0c-4ec8-9b24-6e71265eff84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:41:59.571730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bc72029d-ea0c-4ec8-9b24-6e71265eff84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:41:59.584225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bc72029d-ea0c-4ec8-9b24-6e71265eff84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1710 microversion: 2.1 time: 0.192887 Jul 14 09:41:59.594331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 296/614] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:41:59 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1710 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:00.382553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:00.383752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:00.385809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:00.386648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=8 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:00.392860 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:00.393304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:00.394778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:00.395138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:00.409015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c3e245db-3ded-4754-a2aa-fde747aff499 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:00.411633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c3e245db-3ded-4754-a2aa-fde747aff499 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:00.422276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3e245db-3ded-4754-a2aa-fde747aff499 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:00.423055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3e245db-3ded-4754-a2aa-fde747aff499 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:00.424569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3e245db-3ded-4754-a2aa-fde747aff499 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:00.425388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3e245db-3ded-4754-a2aa-fde747aff499 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:00.619404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:00.629465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:00.635327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:00.637529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-81272361-1c7e-4685-95ca-3915b852eba5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.259184 Jul 14 09:42:00.638711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 319/615] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:00.643591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c3e245db-3ded-4754-a2aa-fde747aff499 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:00.645259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-21ed0c34-b8a4-464b-b7db-ec1cdc3b6ea4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:00.645953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-21ed0c34-b8a4-464b-b7db-ec1cdc3b6ea4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:00.653124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c3e245db-3ded-4754-a2aa-fde747aff499 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.256924 Jul 14 09:42:00.653865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 297/616] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:00 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:00.654220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21ed0c34-b8a4-464b-b7db-ec1cdc3b6ea4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:00.654752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21ed0c34-b8a4-464b-b7db-ec1cdc3b6ea4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:00.655616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21ed0c34-b8a4-464b-b7db-ec1cdc3b6ea4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:00.656124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21ed0c34-b8a4-464b-b7db-ec1cdc3b6ea4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:00.814330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-21ed0c34-b8a4-464b-b7db-ec1cdc3b6ea4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:00.824174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-21ed0c34-b8a4-464b-b7db-ec1cdc3b6ea4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1714 microversion: 2.1 time: 0.184331 Jul 14 09:42:00.825153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 320/617] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:00 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1714 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:01.656824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:01.657425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:01.664386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:01.664835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:01.665595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:01.666024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:01.669881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bba9a47a-c46f-4a83-bec8-37892edc3277 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:01.670531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bba9a47a-c46f-4a83-bec8-37892edc3277 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:01.676456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bba9a47a-c46f-4a83-bec8-37892edc3277 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:01.676904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bba9a47a-c46f-4a83-bec8-37892edc3277 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:01.677668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bba9a47a-c46f-4a83-bec8-37892edc3277 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:01.678100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bba9a47a-c46f-4a83-bec8-37892edc3277 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:01.858028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:01.861471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:01.861755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bba9a47a-c46f-4a83-bec8-37892edc3277 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:01.867737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:01.869250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:01.869376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bba9a47a-c46f-4a83-bec8-37892edc3277 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.203269 Jul 14 09:42:01.869812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 321/618] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:01 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:01.870464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8391fb00-8201-4e60-9ea9-267bff705c60 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1738 microversion: 2.20 time: 0.217523 Jul 14 09:42:01.871011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 298/619] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:02.283710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-1f90785c-5a3c-49f6-9b09-08f1b384d714 req-398c5e85-fae3-44da-a111-93e352a12f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21359018-1e48-4ba4-9529-a19b35577d59", "name": "network-vif-plugged", "status": "completed", "tag": "e5ba949a-2ace-47d1-a8b3-aa70ff78fa5e"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:42:02.292506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-1f90785c-5a3c-49f6-9b09-08f1b384d714 req-398c5e85-fae3-44da-a111-93e352a12f15 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:02.293533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-1f90785c-5a3c-49f6-9b09-08f1b384d714 req-398c5e85-fae3-44da-a111-93e352a12f15 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:02.306350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-1f90785c-5a3c-49f6-9b09-08f1b384d714 req-398c5e85-fae3-44da-a111-93e352a12f15 service nova] Creating event network-vif-plugged:e5ba949a-2ace-47d1-a8b3-aa70ff78fa5e for instance 21359018-1e48-4ba4-9529-a19b35577d59 on hv-cinder-82549 Jul 14 09:42:02.311981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-1f90785c-5a3c-49f6-9b09-08f1b384d714 req-398c5e85-fae3-44da-a111-93e352a12f15 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031946 Jul 14 09:42:02.312888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 322/620] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:42:02.887126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-925e2265-08ac-44c6-b66c-12e4a4a302ef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:02.887732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-925e2265-08ac-44c6-b66c-12e4a4a302ef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:02.889020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:02.889731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:02.893946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-925e2265-08ac-44c6-b66c-12e4a4a302ef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:02.894428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-925e2265-08ac-44c6-b66c-12e4a4a302ef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:02.895190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-925e2265-08ac-44c6-b66c-12e4a4a302ef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:02.895620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-925e2265-08ac-44c6-b66c-12e4a4a302ef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:02.896098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:02.896535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:02.897289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:02.897716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:03.125957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-925e2265-08ac-44c6-b66c-12e4a4a302ef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:03.131102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:03.133610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-925e2265-08ac-44c6-b66c-12e4a4a302ef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.250765 Jul 14 09:42:03.134272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 299/621] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:02 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:03.142397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:03.142397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:03.142828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c3976466-8a9a-4b79-b095-c12f585bb70e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1720 microversion: 2.20 time: 0.257517 Jul 14 09:42:03.143132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 323/622] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:42:04.150350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-75acc6fe-4fb6-43fc-8711-71759236f60f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:04.150913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-75acc6fe-4fb6-43fc-8711-71759236f60f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:04.157451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75acc6fe-4fb6-43fc-8711-71759236f60f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:04.157897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75acc6fe-4fb6-43fc-8711-71759236f60f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:04.158693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75acc6fe-4fb6-43fc-8711-71759236f60f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:04.159125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75acc6fe-4fb6-43fc-8711-71759236f60f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:04.172102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:04.172797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:04.179507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:04.179956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:04.180720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:04.181152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:04.354998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-75acc6fe-4fb6-43fc-8711-71759236f60f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:04.361484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:04.363115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-75acc6fe-4fb6-43fc-8711-71759236f60f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.216042 Jul 14 09:42:04.363702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 300/623] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:04 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:04.370481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:04.372176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:04.373328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c96268e6-ee0b-470d-990d-f083588770ac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1720 microversion: 2.20 time: 0.205065 Jul 14 09:42:04.373904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 324/624] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:42:05.380046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c8c5ea18-02a0-46b8-a417-a05319edb165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:05.380646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c8c5ea18-02a0-46b8-a417-a05319edb165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:05.387254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8c5ea18-02a0-46b8-a417-a05319edb165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:05.387689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8c5ea18-02a0-46b8-a417-a05319edb165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:05.388441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8c5ea18-02a0-46b8-a417-a05319edb165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:05.388864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8c5ea18-02a0-46b8-a417-a05319edb165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:05.391201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:05.391810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:05.398214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:05.398684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:05.399451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:05.399888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:05.584235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:05.587283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c8c5ea18-02a0-46b8-a417-a05319edb165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:05.592216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:05.593989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:05.594593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c8c5ea18-02a0-46b8-a417-a05319edb165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1318 microversion: 2.1 time: 0.218374 Jul 14 09:42:05.595156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 301/625] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:05 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:05.595324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-78ed5179-26f9-46a5-9c05-62cabaf930ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1720 microversion: 2.20 time: 0.207964 Jul 14 09:42:05.595829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 325/626] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:42:06.227371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-1d48fa01-025d-452e-99c1-4eed2d319b06 req-08bbe59c-1e07-4211-93db-6fd8cd3efdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00a0737-b755-4d07-a5a1-8b691911836f", "name": "network-vif-unplugged", "status": "completed", "tag": "1975270c-eaaa-4443-9916-238cad412d51"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:42:06.235769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-1d48fa01-025d-452e-99c1-4eed2d319b06 req-08bbe59c-1e07-4211-93db-6fd8cd3efdde service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:06.236258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-1d48fa01-025d-452e-99c1-4eed2d319b06 req-08bbe59c-1e07-4211-93db-6fd8cd3efdde service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:06.249686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-1d48fa01-025d-452e-99c1-4eed2d319b06 req-08bbe59c-1e07-4211-93db-6fd8cd3efdde service nova] Creating event network-vif-unplugged:1975270c-eaaa-4443-9916-238cad412d51 for instance a00a0737-b755-4d07-a5a1-8b691911836f on hv-cinder-82549 Jul 14 09:42:06.255325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-1d48fa01-025d-452e-99c1-4eed2d319b06 req-08bbe59c-1e07-4211-93db-6fd8cd3efdde service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031635 Jul 14 09:42:06.255909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 302/627] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:42:06.611847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fca529d3-2d9c-4a7e-b340-9070bacf8342 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:06.613032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fca529d3-2d9c-4a7e-b340-9070bacf8342 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:06.615414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:06.616101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:06.619400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fca529d3-2d9c-4a7e-b340-9070bacf8342 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:06.619849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fca529d3-2d9c-4a7e-b340-9070bacf8342 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:06.620616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fca529d3-2d9c-4a7e-b340-9070bacf8342 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:06.621051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fca529d3-2d9c-4a7e-b340-9070bacf8342 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:06.623806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:06.624257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:06.625026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:06.625453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:06.820428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fca529d3-2d9c-4a7e-b340-9070bacf8342 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:06.823104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:06.827938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fca529d3-2d9c-4a7e-b340-9070bacf8342 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1506 microversion: 2.1 time: 0.219933 Jul 14 09:42:06.828498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 326/628] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:06 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:06.831716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:06.833343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:06.834521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-89f5c878-f511-4d70-b608-2e9afbc2768b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1723 microversion: 2.20 time: 0.224452 Jul 14 09:42:06.835070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 303/629] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 09:42:06.852303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-768e8276-0573-4be4-b285-d296b17790ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0248663-29f5-41b5-b3d6-52ea9307820b"}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:42:06.853422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-768e8276-0573-4be4-b285-d296b17790ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:06.859374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-768e8276-0573-4be4-b285-d296b17790ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:06.859815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-768e8276-0573-4be4-b285-d296b17790ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:06.860596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-768e8276-0573-4be4-b285-d296b17790ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:06.861023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-768e8276-0573-4be4-b285-d296b17790ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:07.178731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-768e8276-0573-4be4-b285-d296b17790ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "POST /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330359 Jul 14 09:42:07.179359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 327/630] 10.222.0.40 () {62 vars in 1363 bytes} [Thu Jul 14 09:42:06 2022] POST /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:42:07.302033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-057b8706-702a-42d0-9fe5-3959fa64b18a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:42:07.302610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-057b8706-702a-42d0-9fe5-3959fa64b18a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:07.308572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-057b8706-702a-42d0-9fe5-3959fa64b18a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:07.308919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-057b8706-702a-42d0-9fe5-3959fa64b18a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:07.309666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-057b8706-702a-42d0-9fe5-3959fa64b18a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:07.310112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-057b8706-702a-42d0-9fe5-3959fa64b18a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:07.401072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-057b8706-702a-42d0-9fe5-3959fa64b18a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "POST /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/action" status: 202 len: 0 microversion: 2.20 time: 0.102717 Jul 14 09:42:07.401965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 304/631] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jul 14 09:42:07 2022] POST /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:42:07.410055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:07.410697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:07.417558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:07.418005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:07.418804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:07.419245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:07.827603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:07.838016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:07.843076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:07.844342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cafe8f3e-8c52-474a-9d96-3b01a4dc6eae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1749 microversion: 2.20 time: 0.438426 Jul 14 09:42:07.845020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 328/632] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1749 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:08.862087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:08.862648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:08.870359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:08.870984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:08.872344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:08.872889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:09.001996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:09.011381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:09.013097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:09.014260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3338282a-993e-4272-bb20-9c755bb62953 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1751 microversion: 2.20 time: 0.156137 Jul 14 09:42:09.014816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 305/633] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:10.032794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:10.033405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:10.040321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:10.040761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:10.041520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:10.041978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:10.260613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:10.273301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:10.274844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:10.276000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7b27c56d-5a16-42f3-803c-a6d3690170c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.247084 Jul 14 09:42:10.276551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 329/634] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:11.297462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:11.301189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:11.309608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:11.310088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:11.311017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:11.311476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:11.475678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:11.487883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:11.489415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:11.490620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2a360f54-f3bb-466c-b105-d2a7fdee9c57 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.199220 Jul 14 09:42:11.491348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 306/635] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:12.513463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:12.514064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:12.519981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:12.520360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:12.521115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:12.521542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:12.664323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:12.672601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:12.674112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:12.675312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c1fbb956-e74e-4791-9bfb-907064f1fed9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.166288 Jul 14 09:42:12.676569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 330/636] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:13.695978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:13.696581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:13.703144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:13.703575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:13.704330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:13.705036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:13.862732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:13.871648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:13.873127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:13.874281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bf7d7940-4049-4f32-931c-489da5a9df24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.182959 Jul 14 09:42:13.874848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 307/637] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:14.893480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:14.894009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:14.900018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:14.900466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:14.901219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:14.901651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:14.905579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:15.049833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:15.058777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:15.062593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:15.063810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2c4c41b3-7ed2-437b-95dd-fce0a397e282 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.174301 Jul 14 09:42:15.064728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 331/638] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:16.081272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:16.082436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:16.089156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:16.089600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:16.090401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:16.090831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:16.240464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:16.250438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:16.251934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:16.253154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f8308148-3b08-4351-8959-02934555ea41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.176178 Jul 14 09:42:16.254241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 308/639] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:17.274181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:17.274964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:17.281571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:17.282011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:17.282803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:17.283239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:17.429023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:17.439008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:17.440945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:17.443147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b36425c6-9158-435e-a942-0c442d683483 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.174455 Jul 14 09:42:17.443888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 332/640] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:18.461771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:18.462405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:18.464804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=64 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:18.470367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:18.470810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:18.471564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:18.472008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:18.615893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:18.625686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:18.627247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:18.628426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c6384a62-958e-491b-9374-44f9c2e3c3a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.171179 Jul 14 09:42:18.628984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 309/641] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:19.647130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:19.647731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:19.649589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:19.654866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:19.655335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:19.656095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:19.656559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:19.798244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:19.806627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:19.808123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:19.809270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1b987355-cbed-4821-9896-7df4d59acb1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.166239 Jul 14 09:42:19.809819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 333/642] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:20.828402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:20.828997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:20.835883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:20.836319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:20.837083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:20.837507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:20.979752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:20.988954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:20.990608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:20.991755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-19627abb-c97e-4532-85e8-45015651bd03 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.167408 Jul 14 09:42:20.992311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 310/643] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:22.009450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:22.010049 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:22.016012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:22.016455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:22.017207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:22.017639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:22.151462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:22.160888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:22.162461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:22.163629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-947196e5-4fda-45cc-94c1-a782ef0e67df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.157973 Jul 14 09:42:22.164421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 334/644] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:23.182568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:23.183193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:23.189633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:23.190066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:23.190841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:23.191266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:23.341167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:23.350249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:23.351756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:23.352899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ee177b04-4ff4-42ef-93e4-f755c840d403 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.174320 Jul 14 09:42:23.353447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 311/645] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:24.371823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:24.372389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:24.378542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:24.378983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:24.379745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:24.380173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:24.513165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:24.521583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:24.523118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:24.524277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-05c32a38-65f2-494f-8be8-6902afc01fd8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.156547 Jul 14 09:42:24.524837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 335/646] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:25.542603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:25.543478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:25.553975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:25.556429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:25.556429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:25.556429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:25.559024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-03639ab1-674d-478d-9470-b92cd3d78467 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:42:25.559024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-03639ab1-674d-478d-9470-b92cd3d78467 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:25.564753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03639ab1-674d-478d-9470-b92cd3d78467 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:25.565202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03639ab1-674d-478d-9470-b92cd3d78467 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:25.565988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03639ab1-674d-478d-9470-b92cd3d78467 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:25.566443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03639ab1-674d-478d-9470-b92cd3d78467 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:25.640344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-03639ab1-674d-478d-9470-b92cd3d78467 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/action" status: 202 len: 0 microversion: 2.1 time: 0.086996 Jul 14 09:42:25.641337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 336/647] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:42:25 2022] POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:42:25.649322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8d5af75b-d056-4f7b-ae44-898d9b78e001 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:25.650019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8d5af75b-d056-4f7b-ae44-898d9b78e001 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:25.656259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d5af75b-d056-4f7b-ae44-898d9b78e001 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:25.656708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d5af75b-d056-4f7b-ae44-898d9b78e001 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:25.657482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d5af75b-d056-4f7b-ae44-898d9b78e001 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:25.657914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d5af75b-d056-4f7b-ae44-898d9b78e001 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:25.693608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:25.701995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:25.703563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:25.704997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-77a38d4c-1206-4a68-8609-172c61541ee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.166446 Jul 14 09:42:25.705872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 312/648] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:25.804549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8d5af75b-d056-4f7b-ae44-898d9b78e001 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:25.812345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8d5af75b-d056-4f7b-ae44-898d9b78e001 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.167093 Jul 14 09:42:25.812902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 337/649] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:25 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:26.723190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:26.723822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:26.730448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:26.730892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:26.731677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:26.732109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:26.830921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-af83eb7b-acc7-496b-a2ee-a8319fb03c26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:26.831460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-af83eb7b-acc7-496b-a2ee-a8319fb03c26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:26.838233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af83eb7b-acc7-496b-a2ee-a8319fb03c26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:26.838803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af83eb7b-acc7-496b-a2ee-a8319fb03c26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:26.839567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af83eb7b-acc7-496b-a2ee-a8319fb03c26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:26.840022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af83eb7b-acc7-496b-a2ee-a8319fb03c26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:26.860197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:26.869608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:26.871128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:26.872278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c9288452-0e7b-477d-acdc-dfbf54caaa3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.153044 Jul 14 09:42:26.872834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 313/650] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:26.982896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-af83eb7b-acc7-496b-a2ee-a8319fb03c26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:26.991564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-af83eb7b-acc7-496b-a2ee-a8319fb03c26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.164737 Jul 14 09:42:26.992132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 338/651] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:27.891279 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:27.891804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:27.899101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:27.899538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:27.900276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:27.900696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:28.008851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ad6640f3-b135-49a1-aeea-a0fbb9b5dd70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:28.009460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ad6640f3-b135-49a1-aeea-a0fbb9b5dd70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:28.015654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad6640f3-b135-49a1-aeea-a0fbb9b5dd70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:28.016411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad6640f3-b135-49a1-aeea-a0fbb9b5dd70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:28.016876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad6640f3-b135-49a1-aeea-a0fbb9b5dd70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:28.017309 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad6640f3-b135-49a1-aeea-a0fbb9b5dd70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:28.029733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:28.039253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:28.040754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:28.041894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9b9f120c-4c62-4504-8ee3-f39f3498c7eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.154731 Jul 14 09:42:28.042552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 314/652] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:28.162913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ad6640f3-b135-49a1-aeea-a0fbb9b5dd70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:28.170825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ad6640f3-b135-49a1-aeea-a0fbb9b5dd70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.165948 Jul 14 09:42:28.171389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 339/653] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:29.060783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:29.061388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:29.068416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:29.068860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:29.069632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:29.070047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:29.073967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:29.187824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d5d32910-dfae-42fe-8c18-142afcf1d2ae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:29.188547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d5d32910-dfae-42fe-8c18-142afcf1d2ae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:29.195677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5d32910-dfae-42fe-8c18-142afcf1d2ae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:29.196124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5d32910-dfae-42fe-8c18-142afcf1d2ae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:29.196882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5d32910-dfae-42fe-8c18-142afcf1d2ae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:29.197311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5d32910-dfae-42fe-8c18-142afcf1d2ae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:29.202295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:29.211083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:29.212596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:29.213757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dbab5849-a3b7-4464-8875-bc20db182172 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.156908 Jul 14 09:42:29.214367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 315/654] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:29.348758 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d5d32910-dfae-42fe-8c18-142afcf1d2ae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:29.356670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d5d32910-dfae-42fe-8c18-142afcf1d2ae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.172723 Jul 14 09:42:29.357220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 340/655] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:30.231994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:30.232565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:30.239303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:30.239737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:30.240483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:30.240906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:30.367464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:30.374405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-18063326-1f71-4404-b25c-2ff098f869e9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:30.375046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-18063326-1f71-4404-b25c-2ff098f869e9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:30.376282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:30.377787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:30.378953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9e986f1c-d190-48a5-992d-34a097be4bc1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.150843 Jul 14 09:42:30.382111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-18063326-1f71-4404-b25c-2ff098f869e9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:30.382675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-18063326-1f71-4404-b25c-2ff098f869e9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:30.383733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-18063326-1f71-4404-b25c-2ff098f869e9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:30.385179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 316/656] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:30.385315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-18063326-1f71-4404-b25c-2ff098f869e9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:30.524250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-18063326-1f71-4404-b25c-2ff098f869e9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:30.532744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-18063326-1f71-4404-b25c-2ff098f869e9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.162009 Jul 14 09:42:30.533390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 341/657] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:30 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:31.401809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:31.402532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:31.408652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:31.409093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:31.409843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:31.410303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:31.539592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:31.548145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:31.549476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a88e4529-d2b9-4791-9799-e2e56d448952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:31.549938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:31.550067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a88e4529-d2b9-4791-9799-e2e56d448952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:31.550811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4bfddc5c-7bfd-47ce-9862-ee583e73a4ec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.152891 Jul 14 09:42:31.551400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 317/658] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:31.556867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a88e4529-d2b9-4791-9799-e2e56d448952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:31.557313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a88e4529-d2b9-4791-9799-e2e56d448952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:31.558077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a88e4529-d2b9-4791-9799-e2e56d448952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:31.558535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a88e4529-d2b9-4791-9799-e2e56d448952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:31.700012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a88e4529-d2b9-4791-9799-e2e56d448952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:31.708201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a88e4529-d2b9-4791-9799-e2e56d448952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.162505 Jul 14 09:42:31.708764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 342/659] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:32.569204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:32.569807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:32.576267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:32.576710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:32.577461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:32.577888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:32.706813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:32.715821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:32.717317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:32.718497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cd4f2a85-7392-43ee-96de-16e422fd7a6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.153630 Jul 14 09:42:32.719057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 318/660] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:32.724852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a1b1d3e8-3997-408c-bb70-f0de53aa36b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:32.725484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a1b1d3e8-3997-408c-bb70-f0de53aa36b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:32.731445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1b1d3e8-3997-408c-bb70-f0de53aa36b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:32.731896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1b1d3e8-3997-408c-bb70-f0de53aa36b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:32.732649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1b1d3e8-3997-408c-bb70-f0de53aa36b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:32.733087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1b1d3e8-3997-408c-bb70-f0de53aa36b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:32.869983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a1b1d3e8-3997-408c-bb70-f0de53aa36b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:32.877910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a1b1d3e8-3997-408c-bb70-f0de53aa36b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.156891 Jul 14 09:42:32.878502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 343/661] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:33.736536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:33.737134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:33.743732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:33.744113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:33.744862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:33.745288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:33.877576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:33.886435 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:33.887961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:33.889094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-611c61e8-9034-4918-bc27-37d0eb9b92e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.156534 Jul 14 09:42:33.889655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 319/662] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:33.895966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0779bf5d-abfe-4de6-8dff-98e7e22ce8a5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:33.896670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0779bf5d-abfe-4de6-8dff-98e7e22ce8a5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:33.902661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0779bf5d-abfe-4de6-8dff-98e7e22ce8a5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:33.903106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0779bf5d-abfe-4de6-8dff-98e7e22ce8a5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:33.903874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0779bf5d-abfe-4de6-8dff-98e7e22ce8a5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:33.904335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0779bf5d-abfe-4de6-8dff-98e7e22ce8a5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:34.041974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0779bf5d-abfe-4de6-8dff-98e7e22ce8a5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:34.049925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0779bf5d-abfe-4de6-8dff-98e7e22ce8a5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.158315 Jul 14 09:42:34.050521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 344/663] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:34.907915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:34.908522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:34.915583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:34.916030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:34.916789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:34.917223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:35.043585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:35.053233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:35.054782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:35.055932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fa9628d8-8f6f-4219-869c-69526e014feb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.151987 Jul 14 09:42:35.056486 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 320/664] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:35.066642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d8465c29-aef6-4ba1-bcb0-204af02b372e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:35.067311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d8465c29-aef6-4ba1-bcb0-204af02b372e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:35.073579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8465c29-aef6-4ba1-bcb0-204af02b372e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:35.074023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8465c29-aef6-4ba1-bcb0-204af02b372e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:35.077654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8465c29-aef6-4ba1-bcb0-204af02b372e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:35.077654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8465c29-aef6-4ba1-bcb0-204af02b372e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:35.218756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d8465c29-aef6-4ba1-bcb0-204af02b372e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:35.227248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d8465c29-aef6-4ba1-bcb0-204af02b372e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.164393 Jul 14 09:42:35.227797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 345/665] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:35 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:36.074387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:36.074975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:36.081759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:36.082220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:36.082976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:36.083395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:36.213068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:36.221248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:36.222774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:36.223906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e4e813d1-b3a2-4db0-8dde-55300f5a8381 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.154161 Jul 14 09:42:36.224453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 321/666] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:36.244799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-481d6954-68eb-4757-b2f9-a5c04780ebae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:36.245403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-481d6954-68eb-4757-b2f9-a5c04780ebae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:36.251436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-481d6954-68eb-4757-b2f9-a5c04780ebae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:36.251882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-481d6954-68eb-4757-b2f9-a5c04780ebae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:36.252633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-481d6954-68eb-4757-b2f9-a5c04780ebae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:36.253067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-481d6954-68eb-4757-b2f9-a5c04780ebae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:36.394089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-481d6954-68eb-4757-b2f9-a5c04780ebae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:36.397706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:36.402961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-481d6954-68eb-4757-b2f9-a5c04780ebae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.162634 Jul 14 09:42:36.403518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 346/667] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:37.243226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:37.243853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:37.250588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:37.251034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:37.251785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:37.252218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:37.383140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:37.391543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:37.393024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:37.394165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f31c3bbc-e1c8-4a59-a8a5-a32ffe9bda12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.155368 Jul 14 09:42:37.394731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 322/668] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:37.420447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fcb2a4b6-ac9f-44cf-9a5b-533842e0610b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:37.421061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fcb2a4b6-ac9f-44cf-9a5b-533842e0610b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:37.428168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcb2a4b6-ac9f-44cf-9a5b-533842e0610b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:37.428612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcb2a4b6-ac9f-44cf-9a5b-533842e0610b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:37.429366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcb2a4b6-ac9f-44cf-9a5b-533842e0610b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:37.429800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcb2a4b6-ac9f-44cf-9a5b-533842e0610b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:37.568280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fcb2a4b6-ac9f-44cf-9a5b-533842e0610b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:37.576174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fcb2a4b6-ac9f-44cf-9a5b-533842e0610b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.159582 Jul 14 09:42:37.576736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 347/669] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:37.725315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cde0a833-8b22-4328-9e84-45312cf1bd06 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:37.725832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cde0a833-8b22-4328-9e84-45312cf1bd06 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:37.732416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cde0a833-8b22-4328-9e84-45312cf1bd06 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:37.732859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cde0a833-8b22-4328-9e84-45312cf1bd06 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:37.733613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cde0a833-8b22-4328-9e84-45312cf1bd06 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:37.734044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cde0a833-8b22-4328-9e84-45312cf1bd06 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:37.756338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cde0a833-8b22-4328-9e84-45312cf1bd06 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/ips" status: 200 len: 150 microversion: 2.1 time: 0.034770 Jul 14 09:42:37.756830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 323/670] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 09:42:37 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:42:38.412056 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:38.412676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:38.418718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:38.419162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:38.419930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:38.420367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:38.594002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5fba4987-2150-4067-8a4e-8de591b76c2e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:38.594643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5fba4987-2150-4067-8a4e-8de591b76c2e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:38.601405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fba4987-2150-4067-8a4e-8de591b76c2e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:38.601851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fba4987-2150-4067-8a4e-8de591b76c2e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:38.602644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fba4987-2150-4067-8a4e-8de591b76c2e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:38.603079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5fba4987-2150-4067-8a4e-8de591b76c2e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:38.653071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:38.661484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:38.663032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:38.664709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6e31d6b0-ce10-4830-bd59-6e8bbfeb8eab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.256773 Jul 14 09:42:38.665265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 348/671] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:38.812825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5fba4987-2150-4067-8a4e-8de591b76c2e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:38.820920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5fba4987-2150-4067-8a4e-8de591b76c2e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1752 microversion: 2.1 time: 0.230699 Jul 14 09:42:38.821485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 324/672] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:39.682159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:39.682780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:39.688713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:39.689151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:39.689895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:39.690361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:39.827687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:39.834006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5c86ef15-9a02-4186-af0e-651bd115fe7d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b38a0711-20f9-4eba-93a0-14733d5579ee", "device": "/dev/sdb"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:42:39.835710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5c86ef15-9a02-4186-af0e-651bd115fe7d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:39.837161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:39.838696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:39.839855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bf31bc85-b3ef-44ca-aae5-69e6be7ce0d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.161686 Jul 14 09:42:39.840405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 349/673] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:39.842796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5c86ef15-9a02-4186-af0e-651bd115fe7d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:39.843245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5c86ef15-9a02-4186-af0e-651bd115fe7d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:39.844013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5c86ef15-9a02-4186-af0e-651bd115fe7d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:39.844461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5c86ef15-9a02-4186-af0e-651bd115fe7d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:39.844793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2cd1b8e9-9625-4753-a628-ae7880303359 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:39.845392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2cd1b8e9-9625-4753-a628-ae7880303359 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:39.851268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cd1b8e9-9625-4753-a628-ae7880303359 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:39.852434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cd1b8e9-9625-4753-a628-ae7880303359 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:39.853251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cd1b8e9-9625-4753-a628-ae7880303359 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:39.853689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cd1b8e9-9625-4753-a628-ae7880303359 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:39.996925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2cd1b8e9-9625-4753-a628-ae7880303359 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:40.005389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2cd1b8e9-9625-4753-a628-ae7880303359 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.164042 Jul 14 09:42:40.006012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 350/674] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:40.098178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5c86ef15-9a02-4186-af0e-651bd115fe7d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "POST /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267828 Jul 14 09:42:40.098776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 325/675] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 09:42:39 2022] POST /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:42:40.145909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f49420ec-c902-4225-9412-d95e775feb66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46190db4-e605-49d6-b376-a7c45ff90461"}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:42:40.147443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f49420ec-c902-4225-9412-d95e775feb66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:40.156612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f49420ec-c902-4225-9412-d95e775feb66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:40.157061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f49420ec-c902-4225-9412-d95e775feb66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:40.158034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f49420ec-c902-4225-9412-d95e775feb66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:40.158502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f49420ec-c902-4225-9412-d95e775feb66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:40.441466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f49420ec-c902-4225-9412-d95e775feb66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299218 Jul 14 09:42:40.442114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 351/676] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 09:42:40 2022] POST /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:42:40.859717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:40.860424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:40.866726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:40.867164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:40.868574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:40.869004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:41.002409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:41.010819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:41.012348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:41.013493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8ff93e05-8b0c-4c59-a967-e7eed8685356 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.158618 Jul 14 09:42:41.014072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 326/677] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:41.024679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e32ba6c6-39b5-4afa-87c8-91f939a5c453 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:41.025376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e32ba6c6-39b5-4afa-87c8-91f939a5c453 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:41.031826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e32ba6c6-39b5-4afa-87c8-91f939a5c453 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:41.032269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e32ba6c6-39b5-4afa-87c8-91f939a5c453 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:41.033039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e32ba6c6-39b5-4afa-87c8-91f939a5c453 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:41.033472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e32ba6c6-39b5-4afa-87c8-91f939a5c453 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:41.174271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e32ba6c6-39b5-4afa-87c8-91f939a5c453 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:41.182557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e32ba6c6-39b5-4afa-87c8-91f939a5c453 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.162436 Jul 14 09:42:41.183203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 352/678] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:42.033405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:42.034010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:42.040472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:42.040917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:42.041669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:42.042099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:42.169178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:42.177489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:42.179017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:42.180711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-43dff24f-b1eb-425d-bd83-6b66459f346a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.150668 Jul 14 09:42:42.181293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 327/679] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:42.200103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bed65273-a780-4036-b03d-56215518f44a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:42.200737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bed65273-a780-4036-b03d-56215518f44a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:42.207432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bed65273-a780-4036-b03d-56215518f44a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:42.207874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bed65273-a780-4036-b03d-56215518f44a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:42.208628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bed65273-a780-4036-b03d-56215518f44a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:42.209141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bed65273-a780-4036-b03d-56215518f44a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:42.358102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bed65273-a780-4036-b03d-56215518f44a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:42.365978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bed65273-a780-4036-b03d-56215518f44a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.170290 Jul 14 09:42:42.366575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 353/680] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:42 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:43.199784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:43.200383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:43.207211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:43.207654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:43.208408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:43.208851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:43.346043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:43.354370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:43.355896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:43.357039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-91fdc87a-c920-4193-a2c2-9fffd1968ad6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.161916 Jul 14 09:42:43.357593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 328/681] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:43.383054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b4890866-623a-44ef-980d-f1566af6f8e5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:43.384299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b4890866-623a-44ef-980d-f1566af6f8e5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:43.390691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4890866-623a-44ef-980d-f1566af6f8e5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:43.391137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4890866-623a-44ef-980d-f1566af6f8e5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:43.391896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4890866-623a-44ef-980d-f1566af6f8e5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:43.392328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4890866-623a-44ef-980d-f1566af6f8e5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:43.532366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b4890866-623a-44ef-980d-f1566af6f8e5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:43.540248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b4890866-623a-44ef-980d-f1566af6f8e5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.160966 Jul 14 09:42:43.540802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 354/682] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:44.374989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:44.375587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:44.382025 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:44.382509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:44.383266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:44.383695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:44.510413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:44.518606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:44.520092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:44.521217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-28936399-2fb4-457c-9432-5d3e5a3b1f14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.150088 Jul 14 09:42:44.521767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 329/683] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:44.556794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9c5ec261-15c4-40f0-ba37-6c4bd98e45d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:44.557397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9c5ec261-15c4-40f0-ba37-6c4bd98e45d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:44.563958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c5ec261-15c4-40f0-ba37-6c4bd98e45d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:44.564400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c5ec261-15c4-40f0-ba37-6c4bd98e45d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:44.565148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c5ec261-15c4-40f0-ba37-6c4bd98e45d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:44.565575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c5ec261-15c4-40f0-ba37-6c4bd98e45d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:44.709264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9c5ec261-15c4-40f0-ba37-6c4bd98e45d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:44.717929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9c5ec261-15c4-40f0-ba37-6c4bd98e45d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.164965 Jul 14 09:42:44.718516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 355/684] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:42:45.539926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:45.540549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:45.546975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:45.547417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:45.548161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:45.548585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:45.674215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:45.677650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:45.683994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:45.685494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:45.686671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7cf4d2e1-8deb-46c0-a8e2-ec1e5b8e6ea6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.150719 Jul 14 09:42:45.687230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 330/685] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:45.734825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-885377e5-fb25-42d3-85e3-f811ad97d3b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:45.735435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-885377e5-fb25-42d3-85e3-f811ad97d3b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:45.742096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-885377e5-fb25-42d3-85e3-f811ad97d3b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:45.743086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-885377e5-fb25-42d3-85e3-f811ad97d3b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:45.743854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-885377e5-fb25-42d3-85e3-f811ad97d3b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:45.744290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-885377e5-fb25-42d3-85e3-f811ad97d3b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:45.933045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-885377e5-fb25-42d3-85e3-f811ad97d3b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:45.941281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-885377e5-fb25-42d3-85e3-f811ad97d3b8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.210135 Jul 14 09:42:45.941854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 356/686] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:45 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:46.705671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:46.706315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:46.714885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:46.715353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:46.716121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:46.716551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:46.853694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:46.861987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:46.863518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:46.864662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2a5e64d8-e8d3-431d-b161-7d06e3ffa882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.163164 Jul 14 09:42:46.865222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 331/687] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:46.959021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5d400921-63ec-436f-9d34-72519f42ceba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:46.959623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5d400921-63ec-436f-9d34-72519f42ceba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:46.966978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d400921-63ec-436f-9d34-72519f42ceba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:46.967421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d400921-63ec-436f-9d34-72519f42ceba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:46.968170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d400921-63ec-436f-9d34-72519f42ceba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:46.968599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d400921-63ec-436f-9d34-72519f42ceba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:47.108219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5d400921-63ec-436f-9d34-72519f42ceba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:47.116231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5d400921-63ec-436f-9d34-72519f42ceba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.161013 Jul 14 09:42:47.116782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 357/688] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:47.882940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:47.883533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:47.891389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:47.891830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:47.892748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:47.893230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:48.072875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:48.081887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:48.083487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:48.084628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-45be8dc7-186b-4019-9cbf-f2801d7b05c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.205732 Jul 14 09:42:48.085201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 332/689] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:48.133349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ce5052b4-e274-43f3-aae7-616493447d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:48.133963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ce5052b4-e274-43f3-aae7-616493447d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:48.140600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce5052b4-e274-43f3-aae7-616493447d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:48.141046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce5052b4-e274-43f3-aae7-616493447d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:48.141888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce5052b4-e274-43f3-aae7-616493447d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:48.142316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce5052b4-e274-43f3-aae7-616493447d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:48.280879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ce5052b4-e274-43f3-aae7-616493447d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:48.288871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ce5052b4-e274-43f3-aae7-616493447d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.159374 Jul 14 09:42:48.289603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 358/690] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:49.103902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:49.104474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:49.106703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=48 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:49.112164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:49.112600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:49.113345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:49.113771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:49.242050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:49.250937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:49.252435 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:49.253572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-931a7ab4-ac9b-44f1-8f56-7c2feb65cea3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.154259 Jul 14 09:42:49.254124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 333/691] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:49.306133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d3cd1ef2-5e7d-4746-9dc2-46aac09ce957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:49.307351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d3cd1ef2-5e7d-4746-9dc2-46aac09ce957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:49.314061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3cd1ef2-5e7d-4746-9dc2-46aac09ce957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:49.314548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3cd1ef2-5e7d-4746-9dc2-46aac09ce957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:49.315331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3cd1ef2-5e7d-4746-9dc2-46aac09ce957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:49.315759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3cd1ef2-5e7d-4746-9dc2-46aac09ce957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:49.473519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d3cd1ef2-5e7d-4746-9dc2-46aac09ce957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:49.481963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d3cd1ef2-5e7d-4746-9dc2-46aac09ce957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.179684 Jul 14 09:42:49.482554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 359/692] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:50.271852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:50.272445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:50.278932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:50.279366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:50.280117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:50.280539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:50.409877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:50.418237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:50.419743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:50.420889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-caf1bb7a-8c74-4d7c-ac92-ebac7290b811 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.152934 Jul 14 09:42:50.421443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 334/693] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:50.499116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-af50acf4-3d6b-44f6-bf5f-291b55ec2fa2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:50.499727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-af50acf4-3d6b-44f6-bf5f-291b55ec2fa2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:50.502151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=54 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:50.507512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af50acf4-3d6b-44f6-bf5f-291b55ec2fa2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:50.507962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af50acf4-3d6b-44f6-bf5f-291b55ec2fa2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:50.508741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af50acf4-3d6b-44f6-bf5f-291b55ec2fa2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:50.509177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af50acf4-3d6b-44f6-bf5f-291b55ec2fa2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:50.648987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-af50acf4-3d6b-44f6-bf5f-291b55ec2fa2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:50.656900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-af50acf4-3d6b-44f6-bf5f-291b55ec2fa2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.161568 Jul 14 09:42:50.657458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 360/694] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:51.439609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:51.440217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:51.447382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:51.447827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:51.448614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:51.449046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:51.576228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:51.584732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:51.586953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:51.588087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-48b7d71b-7333-48df-a0ca-b1619ba75b91 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.152389 Jul 14 09:42:51.588636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 335/695] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:51.674277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-27e19c92-a909-4e8b-b07b-d9e67354a420 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:51.674922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-27e19c92-a909-4e8b-b07b-d9e67354a420 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:51.682059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27e19c92-a909-4e8b-b07b-d9e67354a420 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:51.682540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27e19c92-a909-4e8b-b07b-d9e67354a420 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:51.683321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27e19c92-a909-4e8b-b07b-d9e67354a420 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:51.683802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27e19c92-a909-4e8b-b07b-d9e67354a420 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:51.825208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-27e19c92-a909-4e8b-b07b-d9e67354a420 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:51.833351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-27e19c92-a909-4e8b-b07b-d9e67354a420 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.162910 Jul 14 09:42:51.833908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 361/696] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:52.607120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:52.607715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:52.614096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:52.614561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:52.615306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:52.615730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:52.742706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:52.751396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:52.752922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:52.754082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0d56eec3-fb85-40ea-aa4c-010ee4dd2054 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.151636 Jul 14 09:42:52.754912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 336/697] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:52.850627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c5058fce-efec-4c03-9615-71894df505c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:52.851446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c5058fce-efec-4c03-9615-71894df505c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:52.857953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5058fce-efec-4c03-9615-71894df505c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:52.858444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5058fce-efec-4c03-9615-71894df505c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:52.859204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5058fce-efec-4c03-9615-71894df505c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:52.859639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5058fce-efec-4c03-9615-71894df505c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:52.865432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:42:52.908828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-f011c5e5-25ba-4ccb-a2c7-bf9fc9db7a30 req-18016761-4f19-4ee3-b9ab-ea2a12147510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00a0737-b755-4d07-a5a1-8b691911836f", "name": "network-vif-plugged", "status": "completed", "tag": "1975270c-eaaa-4443-9916-238cad412d51"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:42:52.917518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f011c5e5-25ba-4ccb-a2c7-bf9fc9db7a30 req-18016761-4f19-4ee3-b9ab-ea2a12147510 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:52.918049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f011c5e5-25ba-4ccb-a2c7-bf9fc9db7a30 req-18016761-4f19-4ee3-b9ab-ea2a12147510 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:52.931260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-f011c5e5-25ba-4ccb-a2c7-bf9fc9db7a30 req-18016761-4f19-4ee3-b9ab-ea2a12147510 service nova] Creating event network-vif-plugged:1975270c-eaaa-4443-9916-238cad412d51 for instance a00a0737-b755-4d07-a5a1-8b691911836f on hv-cinder-82549 Jul 14 09:42:52.938098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-f011c5e5-25ba-4ccb-a2c7-bf9fc9db7a30 req-18016761-4f19-4ee3-b9ab-ea2a12147510 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033248 Jul 14 09:42:52.938774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 337/698] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:42:53.015324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c5058fce-efec-4c03-9615-71894df505c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:53.023323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c5058fce-efec-4c03-9615-71894df505c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.176743 Jul 14 09:42:53.023878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 362/699] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:53.773733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:53.775008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:53.781101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:53.781534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:53.782310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:53.782745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:53.912560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:53.920794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:53.922323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:53.923444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bac4dc44-22ee-4e69-a7ec-29d22f180ef1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.154415 Jul 14 09:42:53.923996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 338/700] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:54.040859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-27c2e7b6-4b7e-4849-a682-e2689244b167 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:54.041468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-27c2e7b6-4b7e-4849-a682-e2689244b167 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:54.048123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27c2e7b6-4b7e-4849-a682-e2689244b167 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:54.048651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27c2e7b6-4b7e-4849-a682-e2689244b167 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:54.049494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27c2e7b6-4b7e-4849-a682-e2689244b167 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:54.050001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27c2e7b6-4b7e-4849-a682-e2689244b167 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:54.227543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-27c2e7b6-4b7e-4849-a682-e2689244b167 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:54.236821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-27c2e7b6-4b7e-4849-a682-e2689244b167 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.199799 Jul 14 09:42:54.237567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 363/701] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:54.941952 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:54.942581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:54.949536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:54.949973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:54.950757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:54.951185 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:55.082060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:55.090658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:55.092159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:55.093297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5a3138a3-5ca9-43c7-8a84-e5ffea2ae759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.155316 Jul 14 09:42:55.093880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 339/702] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:55.254483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-564ebfd2-b8dc-48bb-9f7d-0be013f32560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:55.255097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-564ebfd2-b8dc-48bb-9f7d-0be013f32560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:55.261488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-564ebfd2-b8dc-48bb-9f7d-0be013f32560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:55.261937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-564ebfd2-b8dc-48bb-9f7d-0be013f32560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:55.262743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-564ebfd2-b8dc-48bb-9f7d-0be013f32560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:55.263182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-564ebfd2-b8dc-48bb-9f7d-0be013f32560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:55.406996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-564ebfd2-b8dc-48bb-9f7d-0be013f32560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:55.416063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-564ebfd2-b8dc-48bb-9f7d-0be013f32560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.165311 Jul 14 09:42:55.416733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 364/703] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:56.112063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:56.112586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:56.119649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:56.120092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:56.120853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:56.121287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:56.247062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:56.255406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:56.256911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:56.258024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c9ad28c7-20f7-482a-800d-e85a7457caec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.149984 Jul 14 09:42:56.259404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 340/704] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:56.435899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1055a043-8ed1-4b5e-81ec-d52b7eb4a603 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:56.436503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1055a043-8ed1-4b5e-81ec-d52b7eb4a603 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:56.443212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1055a043-8ed1-4b5e-81ec-d52b7eb4a603 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:56.443656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1055a043-8ed1-4b5e-81ec-d52b7eb4a603 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:56.444412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1055a043-8ed1-4b5e-81ec-d52b7eb4a603 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:56.444842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1055a043-8ed1-4b5e-81ec-d52b7eb4a603 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:56.582235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1055a043-8ed1-4b5e-81ec-d52b7eb4a603 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:56.590126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1055a043-8ed1-4b5e-81ec-d52b7eb4a603 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.158100 Jul 14 09:42:56.590714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 365/705] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:57.277211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:57.277757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:57.284147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:57.284589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:57.285333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:57.285757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:57.608547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0667ed69-5975-419f-b93e-3b6704981a6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:57.609284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0667ed69-5975-419f-b93e-3b6704981a6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:57.616038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0667ed69-5975-419f-b93e-3b6704981a6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:57.616487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0667ed69-5975-419f-b93e-3b6704981a6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:57.617250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0667ed69-5975-419f-b93e-3b6704981a6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:57.618217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0667ed69-5975-419f-b93e-3b6704981a6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:57.730654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:57.739375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:57.741032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:57.743317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-900e8590-f39c-4198-a4c7-9c57efc8925e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1807 microversion: 2.20 time: 0.470200 Jul 14 09:42:57.744000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 341/706] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1807 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:57.785880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0667ed69-5975-419f-b93e-3b6704981a6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:57.793844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0667ed69-5975-419f-b93e-3b6704981a6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1757 microversion: 2.1 time: 0.189574 Jul 14 09:42:57.794450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 366/707] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:42:58.261325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:42:58.261558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 09:42:58.762440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:58.763018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:58.769723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:58.770150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:58.771830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:58.772861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:58.811244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4581d35d-6107-4696-9a36-12cab55fc88f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:42:58.811852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4581d35d-6107-4696-9a36-12cab55fc88f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:42:58.818663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4581d35d-6107-4696-9a36-12cab55fc88f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:58.819113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4581d35d-6107-4696-9a36-12cab55fc88f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:58.819883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4581d35d-6107-4696-9a36-12cab55fc88f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:42:58.826561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4581d35d-6107-4696-9a36-12cab55fc88f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:42:58.966847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:58.975639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:58.977463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:58.978826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ca93b497-90b6-45ae-9bb7-e945a5f0a2ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1794 microversion: 2.20 time: 0.220873 Jul 14 09:42:58.979528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 342/708] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 09:42:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1794 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 09:42:59.009347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4581d35d-6107-4696-9a36-12cab55fc88f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:42:59.017267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4581d35d-6107-4696-9a36-12cab55fc88f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1760 microversion: 2.1 time: 0.209967 Jul 14 09:42:59.017826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 367/709] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:42:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1760 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:08.420451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:43:08.420966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:43:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 09:43:22.237440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=19 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:22.238175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=68 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:22.341937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-91b42940-5453-4d66-b7db-da1cdb638e98 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d58ee9a-25a0-4b40-8048-0093cc49ff2d"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:43:22.343163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-91b42940-5453-4d66-b7db-da1cdb638e98 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:22.349213 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91b42940-5453-4d66-b7db-da1cdb638e98 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:22.349652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91b42940-5453-4d66-b7db-da1cdb638e98 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:22.350425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91b42940-5453-4d66-b7db-da1cdb638e98 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:22.350851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91b42940-5453-4d66-b7db-da1cdb638e98 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:32.347426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:32.420745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=6 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:42.856591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-91b42940-5453-4d66-b7db-da1cdb638e98 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "POST /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 20.623982 Jul 14 09:43:42.857235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 343/710] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 09:43:22 2022] POST /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d/os-volume_attachments => generated 194 bytes in 20625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:43:43.702028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1be7e87c-76f9-416f-88f7-b4a3458d8a49 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: .version_select at 0x7f7da1dfcee0>, body: {"keypair": {"name": "tempest-keypair-1661548706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhZnLQTuMY8xsF9RAq60FRvvMizRrLjMWQeoMcgsQN0l5Uiyjnut85CMciAvCnN0ZdfRq2wu+sX39IK11hDcaso3j1sPuX6/L34FjA1x+/4LbDgO2aXOUSpaVFXiUnFlQ=="}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:43:43.706568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=15 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:43.707206 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=34 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:43.718889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-1be7e87c-76f9-416f-88f7-b4a3458d8a49 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:43:43.722639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-1be7e87c-76f9-416f-88f7-b4a3458d8a49 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for user 1d7ae3d2f56a491baf26a83a34d86ccf and project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:43:43.748190 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1be7e87c-76f9-416f-88f7-b4a3458d8a49 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050317 Jul 14 09:43:43.748762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 368/711] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 09:43:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:43:45.032260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1626899704", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9dc9a66-299f-4d37-a369-9dec401232c3"}], "security_groups": [{"name": "tempest-securitygroup--712061471"}], "key_name": "tempest-keypair-1661548706", "user_data": "}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:43:45.131503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] validate_networks() for [('b9dc9a66-299f-4d37-a369-9dec401232c3', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 09:43:45.545041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 09:43:45.545537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 09:43:45.545994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 09:43:45.546738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 09:43:45.547162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 09:43:45.556593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:45.557030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:45.557808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:45.558255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:45.575665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 09:43:45.580365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for user 1d7ae3d2f56a491baf26a83a34d86ccf and project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 09:43:45.590128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9223890f-4b03-4906-9b46-73842a973182 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:45.590712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9223890f-4b03-4906-9b46-73842a973182 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:45.591547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 09:43:45.594051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 09:43:45.596957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9223890f-4b03-4906-9b46-73842a973182 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:45.597481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9223890f-4b03-4906-9b46-73842a973182 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:45.598352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9223890f-4b03-4906-9b46-73842a973182 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:45.598856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9223890f-4b03-4906-9b46-73842a973182 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:45.647268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bdbcab1d-da15-4272-8540-308921596044 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.620090 Jul 14 09:43:45.648109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 344/712] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 09:43:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 09:43:45.657828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d21cc122-d441-4839-9b05-f2b2357a8f85 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:45.658450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d21cc122-d441-4839-9b05-f2b2357a8f85 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:45.713647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d21cc122-d441-4839-9b05-f2b2357a8f85 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:45.721640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d21cc122-d441-4839-9b05-f2b2357a8f85 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1242 microversion: 2.1 time: 0.067540 Jul 14 09:43:45.722105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 345/713] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:45 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:45.743243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-9223890f-4b03-4906-9b46-73842a973182 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lazy-loading 'services' on Instance uuid 99819874-5159-49fd-81c9-78998c928020 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:43:45.854744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9223890f-4b03-4906-9b46-73842a973182 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments/207951cb-477c-4bd2-a417-5255f53da913" status: 202 len: 0 microversion: 2.1 time: 0.380020 Jul 14 09:43:45.855558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 369/714] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:43:45 2022] DELETE /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments/207951cb-477c-4bd2-a417-5255f53da913 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:43:46.738674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7220766e-456c-4ed6-8f0b-736381eb00da tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:46.739338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7220766e-456c-4ed6-8f0b-736381eb00da tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:46.747139 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7220766e-456c-4ed6-8f0b-736381eb00da tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:46.747575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7220766e-456c-4ed6-8f0b-736381eb00da tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:46.748365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7220766e-456c-4ed6-8f0b-736381eb00da tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:46.748791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7220766e-456c-4ed6-8f0b-736381eb00da tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:46.810338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7220766e-456c-4ed6-8f0b-736381eb00da tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:46.817833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7220766e-456c-4ed6-8f0b-736381eb00da tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1294 microversion: 2.1 time: 0.082980 Jul 14 09:43:46.818439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 346/715] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:46 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:47.837339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-669e111f-25ae-4ab3-9827-5cfb731aa0d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:47.838034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-669e111f-25ae-4ab3-9827-5cfb731aa0d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:47.844702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-669e111f-25ae-4ab3-9827-5cfb731aa0d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:47.845153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-669e111f-25ae-4ab3-9827-5cfb731aa0d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:47.845913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-669e111f-25ae-4ab3-9827-5cfb731aa0d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:47.846377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-669e111f-25ae-4ab3-9827-5cfb731aa0d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:48.094994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-669e111f-25ae-4ab3-9827-5cfb731aa0d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:48.102608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-669e111f-25ae-4ab3-9827-5cfb731aa0d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.270525 Jul 14 09:43:48.103172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 370/716] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:47 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:48.514991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-fd83b6d2-4d6e-481e-be24-76d9c6d9bb6a req-89ab1fec-3b26-42d5-89aa-b05a713705b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e1234d-e61b-402a-8ad9-380bbe756dad", "tag": "b0f598f1-c7bf-4e57-8fc5-a6a7a4f165d5"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:43:48.523521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-fd83b6d2-4d6e-481e-be24-76d9c6d9bb6a req-89ab1fec-3b26-42d5-89aa-b05a713705b6 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:48.524233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-fd83b6d2-4d6e-481e-be24-76d9c6d9bb6a req-89ab1fec-3b26-42d5-89aa-b05a713705b6 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:48.547638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-fd83b6d2-4d6e-481e-be24-76d9c6d9bb6a req-89ab1fec-3b26-42d5-89aa-b05a713705b6 service nova] Creating event network-changed:b0f598f1-c7bf-4e57-8fc5-a6a7a4f165d5 for instance 70e1234d-e61b-402a-8ad9-380bbe756dad on hv-cinder-82549 Jul 14 09:43:48.565336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-fd83b6d2-4d6e-481e-be24-76d9c6d9bb6a req-89ab1fec-3b26-42d5-89aa-b05a713705b6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122538 Jul 14 09:43:48.565978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 347/717] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:43:49.119003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ebc17794-2314-4c08-bbb7-f6d7fc4c04e4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:49.119580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ebc17794-2314-4c08-bbb7-f6d7fc4c04e4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:49.126021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebc17794-2314-4c08-bbb7-f6d7fc4c04e4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:49.126543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebc17794-2314-4c08-bbb7-f6d7fc4c04e4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:49.127303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebc17794-2314-4c08-bbb7-f6d7fc4c04e4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:49.127738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebc17794-2314-4c08-bbb7-f6d7fc4c04e4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:49.259497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ebc17794-2314-4c08-bbb7-f6d7fc4c04e4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:49.266894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ebc17794-2314-4c08-bbb7-f6d7fc4c04e4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.151762 Jul 14 09:43:49.267560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 371/718] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:49 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:50.285089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-edab417d-d3a0-4b95-9946-95a6e7d03095 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:50.285770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-edab417d-d3a0-4b95-9946-95a6e7d03095 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:50.292365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-edab417d-d3a0-4b95-9946-95a6e7d03095 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:50.292802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-edab417d-d3a0-4b95-9946-95a6e7d03095 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:50.293549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-edab417d-d3a0-4b95-9946-95a6e7d03095 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:50.293973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-edab417d-d3a0-4b95-9946-95a6e7d03095 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:50.419531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-edab417d-d3a0-4b95-9946-95a6e7d03095 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:50.426842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-edab417d-d3a0-4b95-9946-95a6e7d03095 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.145868 Jul 14 09:43:50.427389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 348/719] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:50 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:51.443645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-121a9382-740e-46b8-a1c9-b8f689d21979 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:51.444248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-121a9382-740e-46b8-a1c9-b8f689d21979 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:51.451594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-121a9382-740e-46b8-a1c9-b8f689d21979 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:51.452035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-121a9382-740e-46b8-a1c9-b8f689d21979 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:51.452829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-121a9382-740e-46b8-a1c9-b8f689d21979 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:51.453241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-121a9382-740e-46b8-a1c9-b8f689d21979 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:51.583320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-121a9382-740e-46b8-a1c9-b8f689d21979 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:51.590639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-121a9382-740e-46b8-a1c9-b8f689d21979 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.150827 Jul 14 09:43:51.591194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 372/720] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:51 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:52.606481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a09704bf-8442-4f60-a207-741cb2887b46 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:52.607083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a09704bf-8442-4f60-a207-741cb2887b46 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:52.614303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a09704bf-8442-4f60-a207-741cb2887b46 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:52.614752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a09704bf-8442-4f60-a207-741cb2887b46 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:52.615529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a09704bf-8442-4f60-a207-741cb2887b46 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:52.616141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a09704bf-8442-4f60-a207-741cb2887b46 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:52.831929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a09704bf-8442-4f60-a207-741cb2887b46 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:52.840185 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a09704bf-8442-4f60-a207-741cb2887b46 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.237608 Jul 14 09:43:52.841012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 349/721] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:52 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:53.857352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c408d44b-f6ca-4f30-8443-5180e7ebcc59 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:53.857893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c408d44b-f6ca-4f30-8443-5180e7ebcc59 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:53.860366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:53.865659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c408d44b-f6ca-4f30-8443-5180e7ebcc59 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:53.866108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c408d44b-f6ca-4f30-8443-5180e7ebcc59 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:53.866898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c408d44b-f6ca-4f30-8443-5180e7ebcc59 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:53.867352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c408d44b-f6ca-4f30-8443-5180e7ebcc59 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:53.999952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c408d44b-f6ca-4f30-8443-5180e7ebcc59 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:54.008181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c408d44b-f6ca-4f30-8443-5180e7ebcc59 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.154696 Jul 14 09:43:54.009253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 373/722] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:53 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:55.025720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d21e03f8-93c5-40ef-b227-dd9be4154ae9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:55.026345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d21e03f8-93c5-40ef-b227-dd9be4154ae9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:55.032781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d21e03f8-93c5-40ef-b227-dd9be4154ae9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:55.033216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d21e03f8-93c5-40ef-b227-dd9be4154ae9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:55.033971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d21e03f8-93c5-40ef-b227-dd9be4154ae9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:55.034426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d21e03f8-93c5-40ef-b227-dd9be4154ae9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:55.161844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d21e03f8-93c5-40ef-b227-dd9be4154ae9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:55.169856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d21e03f8-93c5-40ef-b227-dd9be4154ae9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.148467 Jul 14 09:43:55.170459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 350/723] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:55 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:55.669004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-fa4bce54-39d1-4675-b842-24cb72435e24 req-5b106f1c-a73b-4d02-8964-f36798e5842e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e1234d-e61b-402a-8ad9-380bbe756dad", "name": "network-vif-plugged", "status": "completed", "tag": "b0f598f1-c7bf-4e57-8fc5-a6a7a4f165d5"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:43:55.677663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-fa4bce54-39d1-4675-b842-24cb72435e24 req-5b106f1c-a73b-4d02-8964-f36798e5842e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:55.677798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-fa4bce54-39d1-4675-b842-24cb72435e24 req-5b106f1c-a73b-4d02-8964-f36798e5842e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:55.691886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-fa4bce54-39d1-4675-b842-24cb72435e24 req-5b106f1c-a73b-4d02-8964-f36798e5842e service nova] Creating event network-vif-plugged:b0f598f1-c7bf-4e57-8fc5-a6a7a4f165d5 for instance 70e1234d-e61b-402a-8ad9-380bbe756dad on hv-cinder-82549 Jul 14 09:43:55.697447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-fa4bce54-39d1-4675-b842-24cb72435e24 req-5b106f1c-a73b-4d02-8964-f36798e5842e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090064 Jul 14 09:43:55.698032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 374/724] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:43:56.187043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4a96ea51-d96a-4f41-b4cf-e69d2d9fa250 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:56.187677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4a96ea51-d96a-4f41-b4cf-e69d2d9fa250 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:56.189581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:56.190276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=8 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:43:56.196794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a96ea51-d96a-4f41-b4cf-e69d2d9fa250 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:56.197228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a96ea51-d96a-4f41-b4cf-e69d2d9fa250 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:56.197981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a96ea51-d96a-4f41-b4cf-e69d2d9fa250 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:56.198427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a96ea51-d96a-4f41-b4cf-e69d2d9fa250 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:56.324847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4a96ea51-d96a-4f41-b4cf-e69d2d9fa250 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:56.332486 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4a96ea51-d96a-4f41-b4cf-e69d2d9fa250 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.149268 Jul 14 09:43:56.333056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 351/725] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:56 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:57.350660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-814183b2-a972-4ab0-ae41-aa1fe1335a5e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:57.351349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-814183b2-a972-4ab0-ae41-aa1fe1335a5e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:57.358272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-814183b2-a972-4ab0-ae41-aa1fe1335a5e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:57.358721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-814183b2-a972-4ab0-ae41-aa1fe1335a5e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:57.359477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-814183b2-a972-4ab0-ae41-aa1fe1335a5e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:57.359914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-814183b2-a972-4ab0-ae41-aa1fe1335a5e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:57.489555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-814183b2-a972-4ab0-ae41-aa1fe1335a5e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:57.496918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-814183b2-a972-4ab0-ae41-aa1fe1335a5e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.150883 Jul 14 09:43:57.497466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 375/726] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:57 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:58.512853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32b62b06-6e21-447a-9317-0b684043dd18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:58.514057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-32b62b06-6e21-447a-9317-0b684043dd18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:58.520677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32b62b06-6e21-447a-9317-0b684043dd18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:58.521119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32b62b06-6e21-447a-9317-0b684043dd18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:58.521885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32b62b06-6e21-447a-9317-0b684043dd18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:58.522381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32b62b06-6e21-447a-9317-0b684043dd18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:58.650172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32b62b06-6e21-447a-9317-0b684043dd18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:58.657750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-32b62b06-6e21-447a-9317-0b684043dd18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.149076 Jul 14 09:43:58.658336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 352/727] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:58 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:43:59.674997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-aeba5346-a9c3-44ee-b04f-503bffe0633d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:43:59.675601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-aeba5346-a9c3-44ee-b04f-503bffe0633d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:43:59.682619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aeba5346-a9c3-44ee-b04f-503bffe0633d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:59.683069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aeba5346-a9c3-44ee-b04f-503bffe0633d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:59.683828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aeba5346-a9c3-44ee-b04f-503bffe0633d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:43:59.684260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aeba5346-a9c3-44ee-b04f-503bffe0633d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:43:59.817558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aeba5346-a9c3-44ee-b04f-503bffe0633d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:43:59.824881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-aeba5346-a9c3-44ee-b04f-503bffe0633d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1367 microversion: 2.1 time: 0.153787 Jul 14 09:43:59.825705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 376/728] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:43:59 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:00.843162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-886dc379-cfc2-44e3-aecb-dc40818f4249 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:00.843763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-886dc379-cfc2-44e3-aecb-dc40818f4249 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:00.850279 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-886dc379-cfc2-44e3-aecb-dc40818f4249 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:00.850718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-886dc379-cfc2-44e3-aecb-dc40818f4249 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:00.851464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-886dc379-cfc2-44e3-aecb-dc40818f4249 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:00.851890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-886dc379-cfc2-44e3-aecb-dc40818f4249 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:00.980189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-886dc379-cfc2-44e3-aecb-dc40818f4249 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:00.987645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-886dc379-cfc2-44e3-aecb-dc40818f4249 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1557 microversion: 2.1 time: 0.148270 Jul 14 09:44:00.988203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 353/729] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:00 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:01.003500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cb72572a-25f6-4499-951d-8bb4686e0c0f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:01.003977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cb72572a-25f6-4499-951d-8bb4686e0c0f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:01.010370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb72572a-25f6-4499-951d-8bb4686e0c0f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:01.010815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb72572a-25f6-4499-951d-8bb4686e0c0f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:01.011562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb72572a-25f6-4499-951d-8bb4686e0c0f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:01.011992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb72572a-25f6-4499-951d-8bb4686e0c0f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:01.091395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cb72572a-25f6-4499-951d-8bb4686e0c0f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091756 Jul 14 09:44:01.092110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 377/730] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 09:44:00 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:02.255862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-b35aef19-956b-4a37-a7ab-902da8cfac17 req-354262b7-8950-4eb1-a3c8-762395443667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e1234d-e61b-402a-8ad9-380bbe756dad", "tag": "b0f598f1-c7bf-4e57-8fc5-a6a7a4f165d5"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:44:02.264641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-b35aef19-956b-4a37-a7ab-902da8cfac17 req-354262b7-8950-4eb1-a3c8-762395443667 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:02.265691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-b35aef19-956b-4a37-a7ab-902da8cfac17 req-354262b7-8950-4eb1-a3c8-762395443667 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:02.277511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-b35aef19-956b-4a37-a7ab-902da8cfac17 req-354262b7-8950-4eb1-a3c8-762395443667 service nova] Creating event network-changed:b0f598f1-c7bf-4e57-8fc5-a6a7a4f165d5 for instance 70e1234d-e61b-402a-8ad9-380bbe756dad on hv-cinder-82549 Jul 14 09:44:02.282446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-b35aef19-956b-4a37-a7ab-902da8cfac17 req-354262b7-8950-4eb1-a3c8-762395443667 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030197 Jul 14 09:44:02.283223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 354/731] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:21.815764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:21.816599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:21.820817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-798df6c5-283e-44d4-be88-7f063eb4dda5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:44:21.821349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-798df6c5-283e-44d4-be88-7f063eb4dda5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:21.830709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-798df6c5-283e-44d4-be88-7f063eb4dda5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:21.831161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-798df6c5-283e-44d4-be88-7f063eb4dda5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:21.831929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-798df6c5-283e-44d4-be88-7f063eb4dda5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:21.832366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-798df6c5-283e-44d4-be88-7f063eb4dda5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:21.855460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-798df6c5-283e-44d4-be88-7f063eb4dda5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lazy-loading 'flavor' on Instance uuid a699dfcd-f703-4225-a432-860189583054 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:44:21.961076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-798df6c5-283e-44d4-be88-7f063eb4dda5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "POST /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054/action" status: 202 len: 0 microversion: 2.1 time: 0.146770 Jul 14 09:44:21.961852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 378/732] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:44:21 2022] POST /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:44:21.968133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:21.968867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:21.973571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a8e46816-5b7d-418e-90a8-a533beb903b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:21.974288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a8e46816-5b7d-418e-90a8-a533beb903b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:21.984255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a8e46816-5b7d-418e-90a8-a533beb903b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:21.984728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a8e46816-5b7d-418e-90a8-a533beb903b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:21.985487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a8e46816-5b7d-418e-90a8-a533beb903b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:21.985912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a8e46816-5b7d-418e-90a8-a533beb903b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:22.122727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a8e46816-5b7d-418e-90a8-a533beb903b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:22.130277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a8e46816-5b7d-418e-90a8-a533beb903b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.163914 Jul 14 09:44:22.130833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 355/733] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:21 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:23.148618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b43f0aa2-01dc-49ed-82c8-4b4878e4c976 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:23.149228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b43f0aa2-01dc-49ed-82c8-4b4878e4c976 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:23.156477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b43f0aa2-01dc-49ed-82c8-4b4878e4c976 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:23.156919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b43f0aa2-01dc-49ed-82c8-4b4878e4c976 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:23.157665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b43f0aa2-01dc-49ed-82c8-4b4878e4c976 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:23.158091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b43f0aa2-01dc-49ed-82c8-4b4878e4c976 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:23.287325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b43f0aa2-01dc-49ed-82c8-4b4878e4c976 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:23.294744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b43f0aa2-01dc-49ed-82c8-4b4878e4c976 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150440 Jul 14 09:44:23.295283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 379/734] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:23 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:24.311767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f30bca5a-8f1b-43ff-a4c9-487d99e470e7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:24.312366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f30bca5a-8f1b-43ff-a4c9-487d99e470e7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:24.318979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f30bca5a-8f1b-43ff-a4c9-487d99e470e7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:24.319423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f30bca5a-8f1b-43ff-a4c9-487d99e470e7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:24.320169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f30bca5a-8f1b-43ff-a4c9-487d99e470e7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:24.320604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f30bca5a-8f1b-43ff-a4c9-487d99e470e7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:24.449180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f30bca5a-8f1b-43ff-a4c9-487d99e470e7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:24.456853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f30bca5a-8f1b-43ff-a4c9-487d99e470e7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148984 Jul 14 09:44:24.457407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 356/735] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:24 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:44:25.474848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bc203ef4-df09-4040-98b9-b8c940780b76 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:25.475453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bc203ef4-df09-4040-98b9-b8c940780b76 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:25.482527 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc203ef4-df09-4040-98b9-b8c940780b76 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:25.483058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc203ef4-df09-4040-98b9-b8c940780b76 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:25.483812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc203ef4-df09-4040-98b9-b8c940780b76 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:25.484243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc203ef4-df09-4040-98b9-b8c940780b76 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:25.616736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bc203ef4-df09-4040-98b9-b8c940780b76 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:25.624188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bc203ef4-df09-4040-98b9-b8c940780b76 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153193 Jul 14 09:44:25.624745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 380/736] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:25 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:26.641637 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-50de7ed4-23a5-49cb-9bba-0b2f991206f5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:26.642259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-50de7ed4-23a5-49cb-9bba-0b2f991206f5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:26.648672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50de7ed4-23a5-49cb-9bba-0b2f991206f5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:26.649208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50de7ed4-23a5-49cb-9bba-0b2f991206f5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:26.649968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50de7ed4-23a5-49cb-9bba-0b2f991206f5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:26.650442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50de7ed4-23a5-49cb-9bba-0b2f991206f5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:26.777115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-50de7ed4-23a5-49cb-9bba-0b2f991206f5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:26.784613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-50de7ed4-23a5-49cb-9bba-0b2f991206f5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146883 Jul 14 09:44:26.785165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 357/737] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:26 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:27.802074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-50b424d0-ddc2-4fb5-8f66-07a413be1b5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:27.802701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-50b424d0-ddc2-4fb5-8f66-07a413be1b5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:27.809377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50b424d0-ddc2-4fb5-8f66-07a413be1b5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:27.809754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50b424d0-ddc2-4fb5-8f66-07a413be1b5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:27.810536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50b424d0-ddc2-4fb5-8f66-07a413be1b5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:27.810963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50b424d0-ddc2-4fb5-8f66-07a413be1b5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:27.944101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-50b424d0-ddc2-4fb5-8f66-07a413be1b5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:27.951928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-50b424d0-ddc2-4fb5-8f66-07a413be1b5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153629 Jul 14 09:44:27.952482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 381/738] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:27 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:28.969270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e5893660-0d36-437c-9c27-553ab2e9c635 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:28.969907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e5893660-0d36-437c-9c27-553ab2e9c635 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:28.976550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5893660-0d36-437c-9c27-553ab2e9c635 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:28.976983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5893660-0d36-437c-9c27-553ab2e9c635 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:28.977875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5893660-0d36-437c-9c27-553ab2e9c635 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:28.979881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5893660-0d36-437c-9c27-553ab2e9c635 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:29.108854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e5893660-0d36-437c-9c27-553ab2e9c635 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:29.116368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e5893660-0d36-437c-9c27-553ab2e9c635 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150953 Jul 14 09:44:29.116925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 358/739] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:28 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:29.703272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4c177ec6-d04a-45d1-a507-9bf3dee88033 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:29.703774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4c177ec6-d04a-45d1-a507-9bf3dee88033 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:29.709812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c177ec6-d04a-45d1-a507-9bf3dee88033 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:29.710288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c177ec6-d04a-45d1-a507-9bf3dee88033 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:29.711050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c177ec6-d04a-45d1-a507-9bf3dee88033 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:29.711483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c177ec6-d04a-45d1-a507-9bf3dee88033 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:29.739381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4c177ec6-d04a-45d1-a507-9bf3dee88033 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments/b0248663-29f5-41b5-b3d6-52ea9307820b" status: 200 len: 194 microversion: 2.20 time: 0.136244 Jul 14 09:44:29.739928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 382/740] 10.222.0.40 () {60 vars in 1453 bytes} [Thu Jul 14 09:44:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments/b0248663-29f5-41b5-b3d6-52ea9307820b => generated 194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:29.801438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-840b5987-4c15-4870-a0d3-949347f5a4eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:29.801920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-840b5987-4c15-4870-a0d3-949347f5a4eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:29.808472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-840b5987-4c15-4870-a0d3-949347f5a4eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:29.808906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-840b5987-4c15-4870-a0d3-949347f5a4eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:29.809700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-840b5987-4c15-4870-a0d3-949347f5a4eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:29.810074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-840b5987-4c15-4870-a0d3-949347f5a4eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:29.942617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-840b5987-4c15-4870-a0d3-949347f5a4eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lazy-loading 'services' on Instance uuid a00a0737-b755-4d07-a5a1-8b691911836f {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:44:30.051765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-840b5987-4c15-4870-a0d3-949347f5a4eb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments/b0248663-29f5-41b5-b3d6-52ea9307820b" status: 202 len: 0 microversion: 2.20 time: 0.254166 Jul 14 09:44:30.052383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 359/741] 10.222.0.40 () {60 vars in 1456 bytes} [Thu Jul 14 09:44:29 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments/b0248663-29f5-41b5-b3d6-52ea9307820b => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:44:30.060849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e37478f0-8f1f-4f4c-8888-d89c59cd9a81 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:30.061765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e37478f0-8f1f-4f4c-8888-d89c59cd9a81 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:30.067865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e37478f0-8f1f-4f4c-8888-d89c59cd9a81 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:30.068320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e37478f0-8f1f-4f4c-8888-d89c59cd9a81 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:30.069081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e37478f0-8f1f-4f4c-8888-d89c59cd9a81 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:30.069523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e37478f0-8f1f-4f4c-8888-d89c59cd9a81 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:30.102936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e37478f0-8f1f-4f4c-8888-d89c59cd9a81 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045996 Jul 14 09:44:30.104507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 383/742] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:30.140214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a7b682a8-8475-4fbd-8a74-ee0748e14d41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:30.140910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a7b682a8-8475-4fbd-8a74-ee0748e14d41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:30.147198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7b682a8-8475-4fbd-8a74-ee0748e14d41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:30.147642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7b682a8-8475-4fbd-8a74-ee0748e14d41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:30.148404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7b682a8-8475-4fbd-8a74-ee0748e14d41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:30.148835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7b682a8-8475-4fbd-8a74-ee0748e14d41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:30.284033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a7b682a8-8475-4fbd-8a74-ee0748e14d41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:30.292357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a7b682a8-8475-4fbd-8a74-ee0748e14d41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.156627 Jul 14 09:44:30.292915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 360/743] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:30 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:30.575799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c1266536-bc73-451d-926e-eec92f951e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-911171546"}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:44:30.576332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c1266536-bc73-451d-926e-eec92f951e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:30.582318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1266536-bc73-451d-926e-eec92f951e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:30.582762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1266536-bc73-451d-926e-eec92f951e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:30.583522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1266536-bc73-451d-926e-eec92f951e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:30.583957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c1266536-bc73-451d-926e-eec92f951e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:30.718054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.network.security_group_api [None req-c1266536-bc73-451d-926e-eec92f951e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Removing security group fbd19145-5841-42fb-ace0-5451917c968c from port f3b4a515-5f24-4041-9e95-ef29a5325536 Jul 14 09:44:31.060709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c1266536-bc73-451d-926e-eec92f951e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/action" status: 202 len: 0 microversion: 2.1 time: 0.489467 Jul 14 09:44:31.061509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 384/744] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:44:30 2022] POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:44:31.070559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-1ecc3bb5-eed6-473d-91e4-6029700d6322 req-ff879e65-9fbc-4bd4-82cd-1544826cbb88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e62e62e-be29-409c-a568-7269db0dba2d", "tag": "f3b4a515-5f24-4041-9e95-ef29a5325536"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:44:31.086573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-1ecc3bb5-eed6-473d-91e4-6029700d6322 req-ff879e65-9fbc-4bd4-82cd-1544826cbb88 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:31.087433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-1ecc3bb5-eed6-473d-91e4-6029700d6322 req-ff879e65-9fbc-4bd4-82cd-1544826cbb88 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:31.102432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-1ecc3bb5-eed6-473d-91e4-6029700d6322 req-ff879e65-9fbc-4bd4-82cd-1544826cbb88 service nova] Creating event network-changed:f3b4a515-5f24-4041-9e95-ef29a5325536 for instance 9e62e62e-be29-409c-a568-7269db0dba2d on hv-cinder-82549 Jul 14 09:44:31.115586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5f117595-9139-4cb0-a5d8-515f1f95aac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:31.116558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5f117595-9139-4cb0-a5d8-515f1f95aac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:31.123031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-1ecc3bb5-eed6-473d-91e4-6029700d6322 req-ff879e65-9fbc-4bd4-82cd-1544826cbb88 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056139 Jul 14 09:44:31.126373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f117595-9139-4cb0-a5d8-515f1f95aac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:31.127108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f117595-9139-4cb0-a5d8-515f1f95aac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:31.128064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f117595-9139-4cb0-a5d8-515f1f95aac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:31.128809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f117595-9139-4cb0-a5d8-515f1f95aac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:31.130741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 361/745] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:31.191971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5f117595-9139-4cb0-a5d8-515f1f95aac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080376 Jul 14 09:44:31.197414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 385/746] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:31.312313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0d8b2b2b-58ca-4167-a121-b6073b744b45 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:31.313479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0d8b2b2b-58ca-4167-a121-b6073b744b45 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:31.325479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d8b2b2b-58ca-4167-a121-b6073b744b45 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:31.326643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d8b2b2b-58ca-4167-a121-b6073b744b45 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:31.330050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d8b2b2b-58ca-4167-a121-b6073b744b45 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:31.330778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d8b2b2b-58ca-4167-a121-b6073b744b45 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:31.539915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0d8b2b2b-58ca-4167-a121-b6073b744b45 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:31.548455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0d8b2b2b-58ca-4167-a121-b6073b744b45 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.240523 Jul 14 09:44:31.549047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 362/747] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:31 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:32.204539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-615daf77-018c-4e9c-992d-a4c3db315bfa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:32.205632 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-615daf77-018c-4e9c-992d-a4c3db315bfa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:32.213668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-615daf77-018c-4e9c-992d-a4c3db315bfa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:32.214131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-615daf77-018c-4e9c-992d-a4c3db315bfa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:32.215177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-615daf77-018c-4e9c-992d-a4c3db315bfa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:32.215495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-615daf77-018c-4e9c-992d-a4c3db315bfa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:32.246690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-615daf77-018c-4e9c-992d-a4c3db315bfa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046175 Jul 14 09:44:32.247760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 386/748] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:32.352845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a839aa3d-9667-4590-a719-fcf0d1a29bfe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:32.353449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a839aa3d-9667-4590-a719-fcf0d1a29bfe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:32.360364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a839aa3d-9667-4590-a719-fcf0d1a29bfe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:32.360818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a839aa3d-9667-4590-a719-fcf0d1a29bfe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:32.361589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a839aa3d-9667-4590-a719-fcf0d1a29bfe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:32.362021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a839aa3d-9667-4590-a719-fcf0d1a29bfe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:32.454546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-a839aa3d-9667-4590-a719-fcf0d1a29bfe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:44:32.536173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a839aa3d-9667-4590-a719-fcf0d1a29bfe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 202 len: 0 microversion: 2.1 time: 0.187003 Jul 14 09:44:32.540302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 363/749] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:44:32 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:44:32.545466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4b79eeaf-016e-4490-8e76-7472e2c8f39d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:32.546455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4b79eeaf-016e-4490-8e76-7472e2c8f39d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:32.553657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b79eeaf-016e-4490-8e76-7472e2c8f39d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:32.554243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b79eeaf-016e-4490-8e76-7472e2c8f39d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:32.555141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b79eeaf-016e-4490-8e76-7472e2c8f39d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:32.555578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b79eeaf-016e-4490-8e76-7472e2c8f39d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:32.569740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-10e0c936-ac32-4489-8e73-a2fecd02232e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:32.570837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-10e0c936-ac32-4489-8e73-a2fecd02232e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:32.580238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10e0c936-ac32-4489-8e73-a2fecd02232e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:32.580900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10e0c936-ac32-4489-8e73-a2fecd02232e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:32.582056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10e0c936-ac32-4489-8e73-a2fecd02232e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:32.582713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10e0c936-ac32-4489-8e73-a2fecd02232e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:32.598117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4b79eeaf-016e-4490-8e76-7472e2c8f39d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055575 Jul 14 09:44:32.602281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 387/750] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:32.742622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-10e0c936-ac32-4489-8e73-a2fecd02232e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:32.751263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-10e0c936-ac32-4489-8e73-a2fecd02232e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.189398 Jul 14 09:44:32.751851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 364/751] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:32 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:33.144274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-6e57160a-8a77-4416-a6a3-ae6806c064f1 req-f297e4f5-a98e-4578-a222-d7f094b6fb1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e62e62e-be29-409c-a568-7269db0dba2d", "tag": "f3b4a515-5f24-4041-9e95-ef29a5325536"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:44:33.152747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-6e57160a-8a77-4416-a6a3-ae6806c064f1 req-f297e4f5-a98e-4578-a222-d7f094b6fb1e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:33.153180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-6e57160a-8a77-4416-a6a3-ae6806c064f1 req-f297e4f5-a98e-4578-a222-d7f094b6fb1e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:33.164237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-6e57160a-8a77-4416-a6a3-ae6806c064f1 req-f297e4f5-a98e-4578-a222-d7f094b6fb1e service nova] Creating event network-changed:f3b4a515-5f24-4041-9e95-ef29a5325536 for instance 9e62e62e-be29-409c-a568-7269db0dba2d on hv-cinder-82549 Jul 14 09:44:33.169958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-6e57160a-8a77-4416-a6a3-ae6806c064f1 req-f297e4f5-a98e-4578-a222-d7f094b6fb1e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029340 Jul 14 09:44:33.170578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 388/752] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:33.258717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-73e55ffa-c2d9-4a5e-84da-5fd9a64c221e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:33.259890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-73e55ffa-c2d9-4a5e-84da-5fd9a64c221e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:33.266660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73e55ffa-c2d9-4a5e-84da-5fd9a64c221e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:33.267576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73e55ffa-c2d9-4a5e-84da-5fd9a64c221e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:33.267939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73e55ffa-c2d9-4a5e-84da-5fd9a64c221e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:33.268376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73e55ffa-c2d9-4a5e-84da-5fd9a64c221e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:33.305976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-73e55ffa-c2d9-4a5e-84da-5fd9a64c221e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051511 Jul 14 09:44:33.307170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 365/753] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:33.611169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-682a58cf-bd0f-4afc-9fad-aff2ab41aceb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:33.612220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-682a58cf-bd0f-4afc-9fad-aff2ab41aceb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:33.618247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-682a58cf-bd0f-4afc-9fad-aff2ab41aceb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:33.618696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-682a58cf-bd0f-4afc-9fad-aff2ab41aceb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:33.619481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-682a58cf-bd0f-4afc-9fad-aff2ab41aceb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:33.619912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-682a58cf-bd0f-4afc-9fad-aff2ab41aceb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:33.647899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-682a58cf-bd0f-4afc-9fad-aff2ab41aceb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041559 Jul 14 09:44:33.648439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 389/754] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:33.767675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3f961de0-eaad-4e0c-9932-446df05cf76c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:33.768268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3f961de0-eaad-4e0c-9932-446df05cf76c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:33.774731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3f961de0-eaad-4e0c-9932-446df05cf76c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:33.775169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3f961de0-eaad-4e0c-9932-446df05cf76c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:33.775909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3f961de0-eaad-4e0c-9932-446df05cf76c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:33.776331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3f961de0-eaad-4e0c-9932-446df05cf76c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:33.906965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3f961de0-eaad-4e0c-9932-446df05cf76c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:33.914385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3f961de0-eaad-4e0c-9932-446df05cf76c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150464 Jul 14 09:44:33.914941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 366/755] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:33 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:34.317792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a99745e5-0c9d-4824-9022-250736f5fffd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:34.318728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a99745e5-0c9d-4824-9022-250736f5fffd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:34.325478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a99745e5-0c9d-4824-9022-250736f5fffd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:34.325917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a99745e5-0c9d-4824-9022-250736f5fffd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:34.326686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a99745e5-0c9d-4824-9022-250736f5fffd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:34.327118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a99745e5-0c9d-4824-9022-250736f5fffd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:34.356542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a99745e5-0c9d-4824-9022-250736f5fffd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042624 Jul 14 09:44:34.357093 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 390/756] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:34.660329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-04aaa733-08cd-4f1f-bf34-1830ed33edec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:34.661162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-04aaa733-08cd-4f1f-bf34-1830ed33edec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:34.671619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04aaa733-08cd-4f1f-bf34-1830ed33edec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:34.671827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04aaa733-08cd-4f1f-bf34-1830ed33edec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:34.672592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04aaa733-08cd-4f1f-bf34-1830ed33edec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:34.673132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04aaa733-08cd-4f1f-bf34-1830ed33edec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:34.705019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-04aaa733-08cd-4f1f-bf34-1830ed33edec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048617 Jul 14 09:44:34.705586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 367/757] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:34.931217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4ae928c4-76fd-4256-9877-0c1cab68c2c3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:34.932399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4ae928c4-76fd-4256-9877-0c1cab68c2c3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:34.938803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4ae928c4-76fd-4256-9877-0c1cab68c2c3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:34.939250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4ae928c4-76fd-4256-9877-0c1cab68c2c3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:34.940012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4ae928c4-76fd-4256-9877-0c1cab68c2c3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:34.940444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4ae928c4-76fd-4256-9877-0c1cab68c2c3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:35.072179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4ae928c4-76fd-4256-9877-0c1cab68c2c3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:35.079779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4ae928c4-76fd-4256-9877-0c1cab68c2c3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152383 Jul 14 09:44:35.080332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 391/758] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:34 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:44:35.368208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7c8db38e-10b1-4477-9ee5-6dba52863012 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:35.369079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7c8db38e-10b1-4477-9ee5-6dba52863012 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:35.375706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8db38e-10b1-4477-9ee5-6dba52863012 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:35.376155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8db38e-10b1-4477-9ee5-6dba52863012 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:35.376916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8db38e-10b1-4477-9ee5-6dba52863012 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:35.377391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8db38e-10b1-4477-9ee5-6dba52863012 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:35.409474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7c8db38e-10b1-4477-9ee5-6dba52863012 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045237 Jul 14 09:44:35.410042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 368/759] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:35.812556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-96fada4d-62ad-4602-bd44-a19b9e084bfa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:35.813514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-96fada4d-62ad-4602-bd44-a19b9e084bfa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:35.819422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-96fada4d-62ad-4602-bd44-a19b9e084bfa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:35.819862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-96fada4d-62ad-4602-bd44-a19b9e084bfa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:35.820610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-96fada4d-62ad-4602-bd44-a19b9e084bfa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:35.821036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-96fada4d-62ad-4602-bd44-a19b9e084bfa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:35.850865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-96fada4d-62ad-4602-bd44-a19b9e084bfa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138166 Jul 14 09:44:35.851415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 392/760] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:35 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:36.096808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a073339e-7d1d-4c1f-9a06-bc8a7614ba31 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:36.097333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a073339e-7d1d-4c1f-9a06-bc8a7614ba31 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:36.103348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a073339e-7d1d-4c1f-9a06-bc8a7614ba31 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:36.104416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a073339e-7d1d-4c1f-9a06-bc8a7614ba31 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:36.105172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a073339e-7d1d-4c1f-9a06-bc8a7614ba31 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:36.105599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a073339e-7d1d-4c1f-9a06-bc8a7614ba31 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:36.234688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a073339e-7d1d-4c1f-9a06-bc8a7614ba31 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:36.242137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a073339e-7d1d-4c1f-9a06-bc8a7614ba31 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149340 Jul 14 09:44:36.242733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 369/761] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:36 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:36.420508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-91d1441e-1bb2-40d0-b95c-f974208ec30d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:36.421369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-91d1441e-1bb2-40d0-b95c-f974208ec30d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:36.428263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91d1441e-1bb2-40d0-b95c-f974208ec30d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:36.428737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91d1441e-1bb2-40d0-b95c-f974208ec30d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:36.430007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91d1441e-1bb2-40d0-b95c-f974208ec30d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:36.430681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91d1441e-1bb2-40d0-b95c-f974208ec30d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:36.452377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:36.467742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-91d1441e-1bb2-40d0-b95c-f974208ec30d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051237 Jul 14 09:44:36.468312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 393/762] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:36.864234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-369426d2-17c0-4d7d-ae4a-3156129a7943 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:36.865152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-369426d2-17c0-4d7d-ae4a-3156129a7943 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:36.873994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-369426d2-17c0-4d7d-ae4a-3156129a7943 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:36.874461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-369426d2-17c0-4d7d-ae4a-3156129a7943 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:36.875222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-369426d2-17c0-4d7d-ae4a-3156129a7943 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:36.875649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-369426d2-17c0-4d7d-ae4a-3156129a7943 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:36.903598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:36.909618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-369426d2-17c0-4d7d-ae4a-3156129a7943 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049998 Jul 14 09:44:36.910223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 370/763] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:37.259523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ca8d66b0-5137-439b-9826-c87aef980ebe tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:37.260128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ca8d66b0-5137-439b-9826-c87aef980ebe tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:37.267029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ca8d66b0-5137-439b-9826-c87aef980ebe tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:37.267471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ca8d66b0-5137-439b-9826-c87aef980ebe tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:37.268229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ca8d66b0-5137-439b-9826-c87aef980ebe tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:37.268691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ca8d66b0-5137-439b-9826-c87aef980ebe tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:37.397687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ca8d66b0-5137-439b-9826-c87aef980ebe tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:37.405780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ca8d66b0-5137-439b-9826-c87aef980ebe tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150428 Jul 14 09:44:37.406610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 394/764] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:37 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:37.481339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f1d4d92a-780d-41fb-99a6-a8c550b70b80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:37.482336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f1d4d92a-780d-41fb-99a6-a8c550b70b80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:37.488531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1d4d92a-780d-41fb-99a6-a8c550b70b80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:37.488969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1d4d92a-780d-41fb-99a6-a8c550b70b80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:37.489716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1d4d92a-780d-41fb-99a6-a8c550b70b80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:37.490140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1d4d92a-780d-41fb-99a6-a8c550b70b80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:37.521700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f1d4d92a-780d-41fb-99a6-a8c550b70b80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045680 Jul 14 09:44:37.526060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 371/765] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:37.920893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d73a5cfb-1bf9-4909-be22-6f5f7ecb1126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:37.921792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d73a5cfb-1bf9-4909-be22-6f5f7ecb1126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:37.928173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d73a5cfb-1bf9-4909-be22-6f5f7ecb1126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:37.928617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d73a5cfb-1bf9-4909-be22-6f5f7ecb1126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:37.929367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d73a5cfb-1bf9-4909-be22-6f5f7ecb1126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:37.929798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d73a5cfb-1bf9-4909-be22-6f5f7ecb1126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:37.957837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d73a5cfb-1bf9-4909-be22-6f5f7ecb1126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040851 Jul 14 09:44:37.958417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 395/766] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:38.422894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-acca6147-7460-4160-aa37-90196cf50183 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:38.423502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-acca6147-7460-4160-aa37-90196cf50183 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:38.429868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acca6147-7460-4160-aa37-90196cf50183 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:38.430340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acca6147-7460-4160-aa37-90196cf50183 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:38.431092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acca6147-7460-4160-aa37-90196cf50183 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:38.431557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acca6147-7460-4160-aa37-90196cf50183 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:38.533841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-367278c0-4e8b-41ac-8549-7bf299c22885 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:38.534777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-367278c0-4e8b-41ac-8549-7bf299c22885 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:38.540660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-367278c0-4e8b-41ac-8549-7bf299c22885 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:38.541669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-367278c0-4e8b-41ac-8549-7bf299c22885 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:38.542459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-367278c0-4e8b-41ac-8549-7bf299c22885 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:38.542891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-367278c0-4e8b-41ac-8549-7bf299c22885 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:38.564688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-acca6147-7460-4160-aa37-90196cf50183 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:38.573167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-acca6147-7460-4160-aa37-90196cf50183 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154005 Jul 14 09:44:38.574258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 372/767] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:38 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:38.575071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-367278c0-4e8b-41ac-8549-7bf299c22885 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045084 Jul 14 09:44:38.575776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 396/768] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:44:38.969986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9231201f-8768-49db-b461-36c1d8029d6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:38.970837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9231201f-8768-49db-b461-36c1d8029d6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:38.976749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9231201f-8768-49db-b461-36c1d8029d6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:38.977185 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9231201f-8768-49db-b461-36c1d8029d6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:38.977960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9231201f-8768-49db-b461-36c1d8029d6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:38.980296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9231201f-8768-49db-b461-36c1d8029d6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:39.008386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9231201f-8768-49db-b461-36c1d8029d6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042398 Jul 14 09:44:39.008923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 373/769] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:39.586809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7b1c3f9-b95e-4468-85fa-b7389ee72878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:39.587739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d7b1c3f9-b95e-4468-85fa-b7389ee72878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:39.590414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-36f0e3da-052b-44fb-9b66-341641cd4ddf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:39.591021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-36f0e3da-052b-44fb-9b66-341641cd4ddf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:39.594303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7b1c3f9-b95e-4468-85fa-b7389ee72878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:39.594750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7b1c3f9-b95e-4468-85fa-b7389ee72878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:39.595501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7b1c3f9-b95e-4468-85fa-b7389ee72878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:39.595931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7b1c3f9-b95e-4468-85fa-b7389ee72878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:39.597315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36f0e3da-052b-44fb-9b66-341641cd4ddf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:39.597765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36f0e3da-052b-44fb-9b66-341641cd4ddf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:39.598553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36f0e3da-052b-44fb-9b66-341641cd4ddf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:39.598982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36f0e3da-052b-44fb-9b66-341641cd4ddf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:39.627195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d7b1c3f9-b95e-4468-85fa-b7389ee72878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044505 Jul 14 09:44:39.627967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 397/770] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:39.732016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-36f0e3da-052b-44fb-9b66-341641cd4ddf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:39.739876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-36f0e3da-052b-44fb-9b66-341641cd4ddf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153244 Jul 14 09:44:39.743094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 374/771] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:39 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:44:40.020152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5b7a64e8-6fc6-4c4e-8bcf-7db6d02a0628 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:40.021067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5b7a64e8-6fc6-4c4e-8bcf-7db6d02a0628 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:40.027541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b7a64e8-6fc6-4c4e-8bcf-7db6d02a0628 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:40.027990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b7a64e8-6fc6-4c4e-8bcf-7db6d02a0628 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:40.028743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b7a64e8-6fc6-4c4e-8bcf-7db6d02a0628 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:40.029198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b7a64e8-6fc6-4c4e-8bcf-7db6d02a0628 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:40.057102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5b7a64e8-6fc6-4c4e-8bcf-7db6d02a0628 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040967 Jul 14 09:44:40.057641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 398/772] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:40.639576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4097528b-f2d4-4055-9452-0eab5723a913 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:40.640491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4097528b-f2d4-4055-9452-0eab5723a913 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:40.647045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4097528b-f2d4-4055-9452-0eab5723a913 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:40.647492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4097528b-f2d4-4055-9452-0eab5723a913 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:40.648252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4097528b-f2d4-4055-9452-0eab5723a913 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:40.648684 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4097528b-f2d4-4055-9452-0eab5723a913 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:40.676971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4097528b-f2d4-4055-9452-0eab5723a913 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041379 Jul 14 09:44:40.677515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 375/773] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:40.757257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ef560ee4-209d-4853-b057-5e698fd21382 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:40.757776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ef560ee4-209d-4853-b057-5e698fd21382 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:40.764599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef560ee4-209d-4853-b057-5e698fd21382 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:40.765044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef560ee4-209d-4853-b057-5e698fd21382 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:40.765799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef560ee4-209d-4853-b057-5e698fd21382 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:40.766261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ef560ee4-209d-4853-b057-5e698fd21382 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:40.898723 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ef560ee4-209d-4853-b057-5e698fd21382 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:40.906303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ef560ee4-209d-4853-b057-5e698fd21382 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153102 Jul 14 09:44:40.906895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 399/774] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:40 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:41.068660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2578afd3-73d7-4663-93e8-9312b99ef924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:41.069506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2578afd3-73d7-4663-93e8-9312b99ef924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:41.075799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2578afd3-73d7-4663-93e8-9312b99ef924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:41.076249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2578afd3-73d7-4663-93e8-9312b99ef924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:41.077005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2578afd3-73d7-4663-93e8-9312b99ef924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:41.077435 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2578afd3-73d7-4663-93e8-9312b99ef924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:41.105388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2578afd3-73d7-4663-93e8-9312b99ef924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040788 Jul 14 09:44:41.105930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 376/775] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:41.688561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b2ad7496-45b8-41c6-8121-35a54148e244 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:41.689503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b2ad7496-45b8-41c6-8121-35a54148e244 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:41.695561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2ad7496-45b8-41c6-8121-35a54148e244 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:41.696013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2ad7496-45b8-41c6-8121-35a54148e244 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:41.697286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2ad7496-45b8-41c6-8121-35a54148e244 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:41.697732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2ad7496-45b8-41c6-8121-35a54148e244 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:41.726561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b2ad7496-45b8-41c6-8121-35a54148e244 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041946 Jul 14 09:44:41.727102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 400/776] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:41.893803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:44:41.894480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:44:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 09:44:41.923865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f9e8b132-9c15-4662-827c-98a05bcd2e8c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:41.924505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f9e8b132-9c15-4662-827c-98a05bcd2e8c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:41.931135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9e8b132-9c15-4662-827c-98a05bcd2e8c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:41.931581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9e8b132-9c15-4662-827c-98a05bcd2e8c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:41.932337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9e8b132-9c15-4662-827c-98a05bcd2e8c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:41.932768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9e8b132-9c15-4662-827c-98a05bcd2e8c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:42.065536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f9e8b132-9c15-4662-827c-98a05bcd2e8c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:42.072986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f9e8b132-9c15-4662-827c-98a05bcd2e8c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153020 Jul 14 09:44:42.073556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 377/777] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:41 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:42.116608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-15144168-d701-49d7-a816-6a349d2f47dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:42.117516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-15144168-d701-49d7-a816-6a349d2f47dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:42.123954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15144168-d701-49d7-a816-6a349d2f47dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:42.124393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15144168-d701-49d7-a816-6a349d2f47dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:42.125140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15144168-d701-49d7-a816-6a349d2f47dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:42.125568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15144168-d701-49d7-a816-6a349d2f47dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:42.154303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-15144168-d701-49d7-a816-6a349d2f47dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Jul 14 09:44:42.154689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 401/778] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:42 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:42.738280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dd93dc1f-2ea0-4e16-bf94-4455b1c55a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:42.739129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dd93dc1f-2ea0-4e16-bf94-4455b1c55a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:42.745737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd93dc1f-2ea0-4e16-bf94-4455b1c55a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:42.746176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd93dc1f-2ea0-4e16-bf94-4455b1c55a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:42.746946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd93dc1f-2ea0-4e16-bf94-4455b1c55a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:42.747370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd93dc1f-2ea0-4e16-bf94-4455b1c55a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:42.776252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dd93dc1f-2ea0-4e16-bf94-4455b1c55a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041728 Jul 14 09:44:42.777272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 378/779] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:43.090242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-78f29ad6-2d3d-4ba5-b19f-ffb1d816c502 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:43.090796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-78f29ad6-2d3d-4ba5-b19f-ffb1d816c502 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:43.096895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78f29ad6-2d3d-4ba5-b19f-ffb1d816c502 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:43.097340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78f29ad6-2d3d-4ba5-b19f-ffb1d816c502 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:43.098091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78f29ad6-2d3d-4ba5-b19f-ffb1d816c502 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:43.098550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78f29ad6-2d3d-4ba5-b19f-ffb1d816c502 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:43.165286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-10afd2cb-2d7b-45c5-9036-1da926de6543 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:43.166750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-10afd2cb-2d7b-45c5-9036-1da926de6543 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:43.173285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10afd2cb-2d7b-45c5-9036-1da926de6543 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:43.174010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10afd2cb-2d7b-45c5-9036-1da926de6543 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:43.174492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10afd2cb-2d7b-45c5-9036-1da926de6543 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:43.174927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10afd2cb-2d7b-45c5-9036-1da926de6543 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:43.203689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-10afd2cb-2d7b-45c5-9036-1da926de6543 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042337 Jul 14 09:44:43.204537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 379/780] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:44:43.227115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78f29ad6-2d3d-4ba5-b19f-ffb1d816c502 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:43.235136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-78f29ad6-2d3d-4ba5-b19f-ffb1d816c502 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148866 Jul 14 09:44:43.235692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 402/781] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:43 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:43.788413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d7e492e2-2c11-49ec-a5f2-b0c1db52734f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:43.789321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d7e492e2-2c11-49ec-a5f2-b0c1db52734f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:43.795422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7e492e2-2c11-49ec-a5f2-b0c1db52734f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:43.795865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7e492e2-2c11-49ec-a5f2-b0c1db52734f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:43.796651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7e492e2-2c11-49ec-a5f2-b0c1db52734f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:43.797080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7e492e2-2c11-49ec-a5f2-b0c1db52734f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:43.827337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d7e492e2-2c11-49ec-a5f2-b0c1db52734f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042761 Jul 14 09:44:43.827807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 380/782] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:44.100669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-dc9b0ab4-60ea-4929-9584-0f17d2aa77ab req-ee8c5a8c-f4a2-4575-b639-b724eb840232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a699dfcd-f703-4225-a432-860189583054", "name": "network-vif-unplugged", "status": "completed", "tag": "f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:44:44.108668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-dc9b0ab4-60ea-4929-9584-0f17d2aa77ab req-ee8c5a8c-f4a2-4575-b639-b724eb840232 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:44.109062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-dc9b0ab4-60ea-4929-9584-0f17d2aa77ab req-ee8c5a8c-f4a2-4575-b639-b724eb840232 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:44.120448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-dc9b0ab4-60ea-4929-9584-0f17d2aa77ab req-ee8c5a8c-f4a2-4575-b639-b724eb840232 service nova] Creating event network-vif-unplugged:f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659 for instance a699dfcd-f703-4225-a432-860189583054 on hv-cinder-82549 Jul 14 09:44:44.125420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-dc9b0ab4-60ea-4929-9584-0f17d2aa77ab req-ee8c5a8c-f4a2-4575-b639-b724eb840232 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028367 Jul 14 09:44:44.126105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 403/783] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:44.216078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f4e057c6-7328-4537-87b1-719be77479d0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:44.216990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f4e057c6-7328-4537-87b1-719be77479d0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:44.223502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4e057c6-7328-4537-87b1-719be77479d0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:44.223942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4e057c6-7328-4537-87b1-719be77479d0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:44.224690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4e057c6-7328-4537-87b1-719be77479d0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:44.225119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4e057c6-7328-4537-87b1-719be77479d0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:44.253132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-385ce26e-2fbc-408d-beff-ef7edac5d4e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:44.253311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f4e057c6-7328-4537-87b1-719be77479d0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 Jul 14 09:44:44.253754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 381/784] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:44.253903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-385ce26e-2fbc-408d-beff-ef7edac5d4e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:44.260831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-385ce26e-2fbc-408d-beff-ef7edac5d4e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:44.261276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-385ce26e-2fbc-408d-beff-ef7edac5d4e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:44.262026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-385ce26e-2fbc-408d-beff-ef7edac5d4e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:44.262505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-385ce26e-2fbc-408d-beff-ef7edac5d4e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:44.395976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-385ce26e-2fbc-408d-beff-ef7edac5d4e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:44.403677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-385ce26e-2fbc-408d-beff-ef7edac5d4e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154708 Jul 14 09:44:44.404246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 404/785] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:44 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:44.839611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b6f6481c-cc2e-49be-86fc-ea9f42d51c1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:44.840529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b6f6481c-cc2e-49be-86fc-ea9f42d51c1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:44.846558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6f6481c-cc2e-49be-86fc-ea9f42d51c1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:44.847011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6f6481c-cc2e-49be-86fc-ea9f42d51c1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:44.847768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6f6481c-cc2e-49be-86fc-ea9f42d51c1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:44.848202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6f6481c-cc2e-49be-86fc-ea9f42d51c1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:44.875894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b6f6481c-cc2e-49be-86fc-ea9f42d51c1d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040854 Jul 14 09:44:44.876438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 382/786] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:45.265380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-083f80ea-348a-40bc-8e91-9386f5de3783 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:45.266375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-083f80ea-348a-40bc-8e91-9386f5de3783 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:45.272911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-083f80ea-348a-40bc-8e91-9386f5de3783 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:45.273416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-083f80ea-348a-40bc-8e91-9386f5de3783 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:45.274406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-083f80ea-348a-40bc-8e91-9386f5de3783 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:45.274981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-083f80ea-348a-40bc-8e91-9386f5de3783 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:45.302864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-083f80ea-348a-40bc-8e91-9386f5de3783 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Jul 14 09:44:45.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 405/787] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:45 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:45.421118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fd524541-2ece-4efd-8760-c18b86a9d296 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:45.421711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fd524541-2ece-4efd-8760-c18b86a9d296 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:45.428163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fd524541-2ece-4efd-8760-c18b86a9d296 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:45.428599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fd524541-2ece-4efd-8760-c18b86a9d296 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:45.429354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fd524541-2ece-4efd-8760-c18b86a9d296 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:45.429779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fd524541-2ece-4efd-8760-c18b86a9d296 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:45.559747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fd524541-2ece-4efd-8760-c18b86a9d296 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:45.566730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fd524541-2ece-4efd-8760-c18b86a9d296 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149982 Jul 14 09:44:45.567282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 383/788] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:45 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:45.888014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9cdd30ac-41f3-42f0-ad5f-d5dadaed45e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:45.888843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9cdd30ac-41f3-42f0-ad5f-d5dadaed45e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:45.894790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cdd30ac-41f3-42f0-ad5f-d5dadaed45e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:45.895227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cdd30ac-41f3-42f0-ad5f-d5dadaed45e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:45.895981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cdd30ac-41f3-42f0-ad5f-d5dadaed45e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:45.896410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cdd30ac-41f3-42f0-ad5f-d5dadaed45e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:45.930978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9cdd30ac-41f3-42f0-ad5f-d5dadaed45e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047583 Jul 14 09:44:45.931525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 406/789] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:46.314734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-07011efb-2460-4405-a439-1bf537a0dff9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:46.315645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-07011efb-2460-4405-a439-1bf537a0dff9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:46.321665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07011efb-2460-4405-a439-1bf537a0dff9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:46.322107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07011efb-2460-4405-a439-1bf537a0dff9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:46.322927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07011efb-2460-4405-a439-1bf537a0dff9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:46.323357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07011efb-2460-4405-a439-1bf537a0dff9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:46.351070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-07011efb-2460-4405-a439-1bf537a0dff9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040474 Jul 14 09:44:46.351609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 384/790] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:46.583706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-030ce35b-2216-4c8d-87cd-028b35b62254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:46.584246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-030ce35b-2216-4c8d-87cd-028b35b62254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:46.591411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-030ce35b-2216-4c8d-87cd-028b35b62254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:46.591850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-030ce35b-2216-4c8d-87cd-028b35b62254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:46.592598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-030ce35b-2216-4c8d-87cd-028b35b62254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:46.593117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-030ce35b-2216-4c8d-87cd-028b35b62254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:46.723104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-030ce35b-2216-4c8d-87cd-028b35b62254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:46.731114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-030ce35b-2216-4c8d-87cd-028b35b62254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151296 Jul 14 09:44:46.731667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 407/791] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:46 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:44:46.943346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-93d46480-622b-4c79-a0ce-34e1593f097e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:46.944260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-93d46480-622b-4c79-a0ce-34e1593f097e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:46.951583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93d46480-622b-4c79-a0ce-34e1593f097e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:46.952034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93d46480-622b-4c79-a0ce-34e1593f097e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:46.952790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93d46480-622b-4c79-a0ce-34e1593f097e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:46.953223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93d46480-622b-4c79-a0ce-34e1593f097e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:46.981816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-93d46480-622b-4c79-a0ce-34e1593f097e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042427 Jul 14 09:44:46.982383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 385/792] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:47.363001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cde0f9fd-3181-41b0-82e9-da51a98b2d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:47.363837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cde0f9fd-3181-41b0-82e9-da51a98b2d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:47.371037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cde0f9fd-3181-41b0-82e9-da51a98b2d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:47.371481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cde0f9fd-3181-41b0-82e9-da51a98b2d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:47.372239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cde0f9fd-3181-41b0-82e9-da51a98b2d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:47.372671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cde0f9fd-3181-41b0-82e9-da51a98b2d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:47.400710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cde0f9fd-3181-41b0-82e9-da51a98b2d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041757 Jul 14 09:44:47.401240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 408/793] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:47.748515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8f9fa104-cbb2-43a9-85e6-95381dd6fcd5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:47.749117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8f9fa104-cbb2-43a9-85e6-95381dd6fcd5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:47.755218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8f9fa104-cbb2-43a9-85e6-95381dd6fcd5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:47.755653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8f9fa104-cbb2-43a9-85e6-95381dd6fcd5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:47.756404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8f9fa104-cbb2-43a9-85e6-95381dd6fcd5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:47.756830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8f9fa104-cbb2-43a9-85e6-95381dd6fcd5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:47.885574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8f9fa104-cbb2-43a9-85e6-95381dd6fcd5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:47.893150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8f9fa104-cbb2-43a9-85e6-95381dd6fcd5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148894 Jul 14 09:44:47.893709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 386/794] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:47 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:47.992557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c0795ad-8e69-4aaf-867a-2559bfec9de5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:47.993496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3c0795ad-8e69-4aaf-867a-2559bfec9de5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:48.000656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c0795ad-8e69-4aaf-867a-2559bfec9de5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:48.001041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c0795ad-8e69-4aaf-867a-2559bfec9de5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:48.001795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c0795ad-8e69-4aaf-867a-2559bfec9de5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:48.002251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c0795ad-8e69-4aaf-867a-2559bfec9de5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:48.030530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3c0795ad-8e69-4aaf-867a-2559bfec9de5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041917 Jul 14 09:44:48.031063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 409/795] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:48.412478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d5f1b268-8e74-4935-a977-3535fd85a91c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:48.413504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d5f1b268-8e74-4935-a977-3535fd85a91c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:48.420348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5f1b268-8e74-4935-a977-3535fd85a91c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:48.420785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5f1b268-8e74-4935-a977-3535fd85a91c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:48.421531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5f1b268-8e74-4935-a977-3535fd85a91c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:48.421955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5f1b268-8e74-4935-a977-3535fd85a91c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:48.438934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:48.451780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d5f1b268-8e74-4935-a977-3535fd85a91c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Jul 14 09:44:48.452327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 387/796] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:48.910728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9e9668c7-48f9-4716-8a7e-dc36897e6521 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:48.911340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9e9668c7-48f9-4716-8a7e-dc36897e6521 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:48.917979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9e9668c7-48f9-4716-8a7e-dc36897e6521 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:48.918455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9e9668c7-48f9-4716-8a7e-dc36897e6521 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:48.919213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9e9668c7-48f9-4716-8a7e-dc36897e6521 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:48.919647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9e9668c7-48f9-4716-8a7e-dc36897e6521 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:49.043349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2b48c6ac-d458-4b40-a68a-6bdd5381d909 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:49.044237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2b48c6ac-d458-4b40-a68a-6bdd5381d909 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:49.045696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9e9668c7-48f9-4716-8a7e-dc36897e6521 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:49.049260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:49.050386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2b48c6ac-d458-4b40-a68a-6bdd5381d909 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:49.050797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2b48c6ac-d458-4b40-a68a-6bdd5381d909 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:49.051754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2b48c6ac-d458-4b40-a68a-6bdd5381d909 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:49.052187 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2b48c6ac-d458-4b40-a68a-6bdd5381d909 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:49.054239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9e9668c7-48f9-4716-8a7e-dc36897e6521 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147305 Jul 14 09:44:49.054800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 410/797] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:48 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:44:49.081182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2b48c6ac-d458-4b40-a68a-6bdd5381d909 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042609 Jul 14 09:44:49.081726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 388/798] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:44:49.463782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-51c43ad0-d7d4-4a2e-aac2-0c34fdd46dce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:49.464698 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-51c43ad0-d7d4-4a2e-aac2-0c34fdd46dce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:49.470654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51c43ad0-d7d4-4a2e-aac2-0c34fdd46dce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:49.471103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51c43ad0-d7d4-4a2e-aac2-0c34fdd46dce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:49.471855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51c43ad0-d7d4-4a2e-aac2-0c34fdd46dce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:49.472288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51c43ad0-d7d4-4a2e-aac2-0c34fdd46dce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:49.500226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-51c43ad0-d7d4-4a2e-aac2-0c34fdd46dce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041130 Jul 14 09:44:49.500759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 411/799] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:50.071538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-17d8ebbb-8975-4ee7-aaa9-42ce5762ef0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:50.072058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-17d8ebbb-8975-4ee7-aaa9-42ce5762ef0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:50.079272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17d8ebbb-8975-4ee7-aaa9-42ce5762ef0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:50.079711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17d8ebbb-8975-4ee7-aaa9-42ce5762ef0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:50.080466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17d8ebbb-8975-4ee7-aaa9-42ce5762ef0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:50.080893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17d8ebbb-8975-4ee7-aaa9-42ce5762ef0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:50.093329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5bfc2904-69ef-41f5-81a7-4ffce3913382 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:50.094295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5bfc2904-69ef-41f5-81a7-4ffce3913382 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:50.100638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5bfc2904-69ef-41f5-81a7-4ffce3913382 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:50.101090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5bfc2904-69ef-41f5-81a7-4ffce3913382 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:50.101851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5bfc2904-69ef-41f5-81a7-4ffce3913382 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:50.102312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5bfc2904-69ef-41f5-81a7-4ffce3913382 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:50.131004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5bfc2904-69ef-41f5-81a7-4ffce3913382 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041588 Jul 14 09:44:50.131565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 412/800] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:44:50.215405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-17d8ebbb-8975-4ee7-aaa9-42ce5762ef0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:50.222797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-17d8ebbb-8975-4ee7-aaa9-42ce5762ef0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.155188 Jul 14 09:44:50.223348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 389/801] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:50 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:50.516468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6619578d-0fe6-49a1-a014-f29891e82b56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:50.517391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6619578d-0fe6-49a1-a014-f29891e82b56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:50.525292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6619578d-0fe6-49a1-a014-f29891e82b56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:50.527847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6619578d-0fe6-49a1-a014-f29891e82b56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:50.528778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6619578d-0fe6-49a1-a014-f29891e82b56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:50.529596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6619578d-0fe6-49a1-a014-f29891e82b56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:50.559679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6619578d-0fe6-49a1-a014-f29891e82b56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049959 Jul 14 09:44:50.560895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 413/802] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:44:51.143315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-de164527-dd6f-4af3-bb33-a813cfa968f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:51.144230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-de164527-dd6f-4af3-bb33-a813cfa968f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:51.151545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de164527-dd6f-4af3-bb33-a813cfa968f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:51.151997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de164527-dd6f-4af3-bb33-a813cfa968f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:51.152751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de164527-dd6f-4af3-bb33-a813cfa968f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:51.153177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de164527-dd6f-4af3-bb33-a813cfa968f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:51.181491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-de164527-dd6f-4af3-bb33-a813cfa968f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042109 Jul 14 09:44:51.182576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 390/803] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:51.239506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5cd8742f-22f3-41d6-9459-c8cad25677a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:51.240149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5cd8742f-22f3-41d6-9459-c8cad25677a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:51.247188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5cd8742f-22f3-41d6-9459-c8cad25677a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:51.247640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5cd8742f-22f3-41d6-9459-c8cad25677a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:51.248402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5cd8742f-22f3-41d6-9459-c8cad25677a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:51.248841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5cd8742f-22f3-41d6-9459-c8cad25677a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:51.379006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5cd8742f-22f3-41d6-9459-c8cad25677a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:51.386598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5cd8742f-22f3-41d6-9459-c8cad25677a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150811 Jul 14 09:44:51.387152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 414/804] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:51 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:51.572397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2d49c913-1864-4e61-b8ff-f4dfa4dfaac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:51.573306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2d49c913-1864-4e61-b8ff-f4dfa4dfaac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:51.579854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d49c913-1864-4e61-b8ff-f4dfa4dfaac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:51.580289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d49c913-1864-4e61-b8ff-f4dfa4dfaac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:51.581033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d49c913-1864-4e61-b8ff-f4dfa4dfaac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:51.581460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d49c913-1864-4e61-b8ff-f4dfa4dfaac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:51.610181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2d49c913-1864-4e61-b8ff-f4dfa4dfaac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 Jul 14 09:44:51.610764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 391/805] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:52.193788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c8cffdc2-66b0-465c-b1ae-d7a9998010bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:52.194722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c8cffdc2-66b0-465c-b1ae-d7a9998010bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:52.196573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=75 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:52.202362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8cffdc2-66b0-465c-b1ae-d7a9998010bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:52.202753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8cffdc2-66b0-465c-b1ae-d7a9998010bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:52.203507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8cffdc2-66b0-465c-b1ae-d7a9998010bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:52.203944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8cffdc2-66b0-465c-b1ae-d7a9998010bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:52.232290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c8cffdc2-66b0-465c-b1ae-d7a9998010bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042485 Jul 14 09:44:52.232822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 415/806] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:52.403297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d82f7a1c-7cef-446a-8c21-288e94f59ec3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:52.403901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d82f7a1c-7cef-446a-8c21-288e94f59ec3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:52.406266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=75 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:44:52.411743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d82f7a1c-7cef-446a-8c21-288e94f59ec3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:52.412180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d82f7a1c-7cef-446a-8c21-288e94f59ec3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:52.412934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d82f7a1c-7cef-446a-8c21-288e94f59ec3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:52.413359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d82f7a1c-7cef-446a-8c21-288e94f59ec3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:52.545375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d82f7a1c-7cef-446a-8c21-288e94f59ec3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:52.552949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d82f7a1c-7cef-446a-8c21-288e94f59ec3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153467 Jul 14 09:44:52.553516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 392/807] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:52 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:52.621521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e4fdc48b-dec7-4450-ad7e-eb3c220b6942 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:52.622465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e4fdc48b-dec7-4450-ad7e-eb3c220b6942 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:52.628941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4fdc48b-dec7-4450-ad7e-eb3c220b6942 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:52.629399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4fdc48b-dec7-4450-ad7e-eb3c220b6942 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:52.630159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4fdc48b-dec7-4450-ad7e-eb3c220b6942 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:52.630623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4fdc48b-dec7-4450-ad7e-eb3c220b6942 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:52.658621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e4fdc48b-dec7-4450-ad7e-eb3c220b6942 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041551 Jul 14 09:44:52.659163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 416/808] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:53.243533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-04463aa9-2db8-4001-a8f4-5b05427b7d6c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:53.244437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-04463aa9-2db8-4001-a8f4-5b05427b7d6c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:53.250532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04463aa9-2db8-4001-a8f4-5b05427b7d6c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:53.250965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04463aa9-2db8-4001-a8f4-5b05427b7d6c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:53.251742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04463aa9-2db8-4001-a8f4-5b05427b7d6c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:53.252166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04463aa9-2db8-4001-a8f4-5b05427b7d6c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:53.282614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-04463aa9-2db8-4001-a8f4-5b05427b7d6c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043132 Jul 14 09:44:53.283099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 393/809] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:53.570350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-63207981-4cf4-4cb1-acf2-8b1c93e4ffa6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:53.570959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-63207981-4cf4-4cb1-acf2-8b1c93e4ffa6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:53.578497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63207981-4cf4-4cb1-acf2-8b1c93e4ffa6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:53.578959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63207981-4cf4-4cb1-acf2-8b1c93e4ffa6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:53.579697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63207981-4cf4-4cb1-acf2-8b1c93e4ffa6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:53.580132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63207981-4cf4-4cb1-acf2-8b1c93e4ffa6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:53.670082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-45665dff-a890-438c-b5de-ba93c0c9eeca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:53.671027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-45665dff-a890-438c-b5de-ba93c0c9eeca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:53.677286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45665dff-a890-438c-b5de-ba93c0c9eeca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:53.677730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45665dff-a890-438c-b5de-ba93c0c9eeca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:53.678507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45665dff-a890-438c-b5de-ba93c0c9eeca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:53.678938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45665dff-a890-438c-b5de-ba93c0c9eeca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:53.712073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-63207981-4cf4-4cb1-acf2-8b1c93e4ffa6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:53.722642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-63207981-4cf4-4cb1-acf2-8b1c93e4ffa6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.156010 Jul 14 09:44:53.723426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 417/810] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:53 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:53.860507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-45665dff-a890-438c-b5de-ba93c0c9eeca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194268 Jul 14 09:44:53.861053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 394/811] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:53 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:44:54.294087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c188c468-d1d1-45dd-814f-6bd0224f631c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:54.295040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c188c468-d1d1-45dd-814f-6bd0224f631c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:54.301028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c188c468-d1d1-45dd-814f-6bd0224f631c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:54.301472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c188c468-d1d1-45dd-814f-6bd0224f631c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:54.302249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c188c468-d1d1-45dd-814f-6bd0224f631c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:54.302687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c188c468-d1d1-45dd-814f-6bd0224f631c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:54.332492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c188c468-d1d1-45dd-814f-6bd0224f631c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042338 Jul 14 09:44:54.333038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 418/812] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:54.739459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9a6ab6fb-be81-4e10-8b2a-154b0b26ca8f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:54.740068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9a6ab6fb-be81-4e10-8b2a-154b0b26ca8f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:54.746663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a6ab6fb-be81-4e10-8b2a-154b0b26ca8f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:54.747113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a6ab6fb-be81-4e10-8b2a-154b0b26ca8f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:54.747865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a6ab6fb-be81-4e10-8b2a-154b0b26ca8f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:54.748293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a6ab6fb-be81-4e10-8b2a-154b0b26ca8f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:54.872012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-41a0688f-45dc-4e20-9955-351428221370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:54.873013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-41a0688f-45dc-4e20-9955-351428221370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:54.875217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9a6ab6fb-be81-4e10-8b2a-154b0b26ca8f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:54.879462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41a0688f-45dc-4e20-9955-351428221370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:54.879902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41a0688f-45dc-4e20-9955-351428221370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:54.880655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41a0688f-45dc-4e20-9955-351428221370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:54.881085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41a0688f-45dc-4e20-9955-351428221370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:54.882717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9a6ab6fb-be81-4e10-8b2a-154b0b26ca8f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147152 Jul 14 09:44:54.883271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 395/813] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:54 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:54.909818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-41a0688f-45dc-4e20-9955-351428221370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Jul 14 09:44:54.910401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 419/814] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:44:55.344095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f7a9193d-5cde-43be-98fc-ec45ebbbdf39 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:55.345011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f7a9193d-5cde-43be-98fc-ec45ebbbdf39 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:55.350963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7a9193d-5cde-43be-98fc-ec45ebbbdf39 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:55.351405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7a9193d-5cde-43be-98fc-ec45ebbbdf39 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:55.352158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7a9193d-5cde-43be-98fc-ec45ebbbdf39 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:55.352589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7a9193d-5cde-43be-98fc-ec45ebbbdf39 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:55.381471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f7a9193d-5cde-43be-98fc-ec45ebbbdf39 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041339 Jul 14 09:44:55.381995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 396/815] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:55.899880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9b8305ac-9874-4a25-b95c-5bb669bd899f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:55.900546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9b8305ac-9874-4a25-b95c-5bb669bd899f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:55.907007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b8305ac-9874-4a25-b95c-5bb669bd899f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:55.907446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b8305ac-9874-4a25-b95c-5bb669bd899f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:55.908193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b8305ac-9874-4a25-b95c-5bb669bd899f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:55.908619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b8305ac-9874-4a25-b95c-5bb669bd899f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:55.921587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1309b8b7-ca50-45c0-80e8-def5f68b2247 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:55.922519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1309b8b7-ca50-45c0-80e8-def5f68b2247 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:55.928804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1309b8b7-ca50-45c0-80e8-def5f68b2247 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:55.929246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1309b8b7-ca50-45c0-80e8-def5f68b2247 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:55.929992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1309b8b7-ca50-45c0-80e8-def5f68b2247 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:55.930446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1309b8b7-ca50-45c0-80e8-def5f68b2247 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:55.962553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1309b8b7-ca50-45c0-80e8-def5f68b2247 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Jul 14 09:44:55.963124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 397/816] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:44:56.041909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9b8305ac-9874-4a25-b95c-5bb669bd899f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:56.049379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9b8305ac-9874-4a25-b95c-5bb669bd899f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153434 Jul 14 09:44:56.049940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 420/817] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:55 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:56.393131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-346b0167-c345-45f4-b767-135f41952914 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:56.394065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-346b0167-c345-45f4-b767-135f41952914 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:56.400563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-346b0167-c345-45f4-b767-135f41952914 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:56.401008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-346b0167-c345-45f4-b767-135f41952914 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:56.401751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-346b0167-c345-45f4-b767-135f41952914 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:56.402173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-346b0167-c345-45f4-b767-135f41952914 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:56.430729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-346b0167-c345-45f4-b767-135f41952914 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041604 Jul 14 09:44:56.431257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 398/818] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:56.975065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-22211d5f-2ad2-4abc-8c6a-14746c63e35c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:56.976014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-22211d5f-2ad2-4abc-8c6a-14746c63e35c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:56.982506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22211d5f-2ad2-4abc-8c6a-14746c63e35c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:56.982957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22211d5f-2ad2-4abc-8c6a-14746c63e35c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:56.983714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22211d5f-2ad2-4abc-8c6a-14746c63e35c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:56.984147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22211d5f-2ad2-4abc-8c6a-14746c63e35c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:57.012653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-22211d5f-2ad2-4abc-8c6a-14746c63e35c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041505 Jul 14 09:44:57.013197 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 421/819] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:57.067401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eed41d5c-83e1-4f1f-8499-0adf3b2257c0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:57.068001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eed41d5c-83e1-4f1f-8499-0adf3b2257c0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:57.075457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eed41d5c-83e1-4f1f-8499-0adf3b2257c0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:57.075905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eed41d5c-83e1-4f1f-8499-0adf3b2257c0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:57.076649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eed41d5c-83e1-4f1f-8499-0adf3b2257c0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:57.077080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eed41d5c-83e1-4f1f-8499-0adf3b2257c0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:57.203709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-eed41d5c-83e1-4f1f-8499-0adf3b2257c0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:57.211089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eed41d5c-83e1-4f1f-8499-0adf3b2257c0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147622 Jul 14 09:44:57.211638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 399/820] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:57 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:57.442445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f0aa8488-8420-43db-b434-f6dc0dc05714 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:57.443390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f0aa8488-8420-43db-b434-f6dc0dc05714 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:57.449682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0aa8488-8420-43db-b434-f6dc0dc05714 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:57.450127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0aa8488-8420-43db-b434-f6dc0dc05714 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:57.450905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0aa8488-8420-43db-b434-f6dc0dc05714 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:57.451338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0aa8488-8420-43db-b434-f6dc0dc05714 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:57.479977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f0aa8488-8420-43db-b434-f6dc0dc05714 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041499 Jul 14 09:44:57.480520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 422/821] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:58.024830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9958615d-0dc6-4db1-94be-34cc629b6b6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:58.025771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9958615d-0dc6-4db1-94be-34cc629b6b6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:58.031822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9958615d-0dc6-4db1-94be-34cc629b6b6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:58.032258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9958615d-0dc6-4db1-94be-34cc629b6b6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:58.033000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9958615d-0dc6-4db1-94be-34cc629b6b6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:58.033426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9958615d-0dc6-4db1-94be-34cc629b6b6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:58.062960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9958615d-0dc6-4db1-94be-34cc629b6b6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042089 Jul 14 09:44:58.063509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 400/822] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:58.228745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fc69ed98-feef-47b6-9c60-1ec50b749a0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:58.229351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fc69ed98-feef-47b6-9c60-1ec50b749a0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:58.235713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc69ed98-feef-47b6-9c60-1ec50b749a0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:58.236150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc69ed98-feef-47b6-9c60-1ec50b749a0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:58.236931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc69ed98-feef-47b6-9c60-1ec50b749a0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:58.237359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc69ed98-feef-47b6-9c60-1ec50b749a0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:58.367607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fc69ed98-feef-47b6-9c60-1ec50b749a0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:58.375663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fc69ed98-feef-47b6-9c60-1ec50b749a0e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151325 Jul 14 09:44:58.376217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 423/823] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:58 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:58.491589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b2328932-6705-4bca-9dac-8879dc9f3a1a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:58.492501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b2328932-6705-4bca-9dac-8879dc9f3a1a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:58.499004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b2328932-6705-4bca-9dac-8879dc9f3a1a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:58.499447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b2328932-6705-4bca-9dac-8879dc9f3a1a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:58.500196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b2328932-6705-4bca-9dac-8879dc9f3a1a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:58.500623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b2328932-6705-4bca-9dac-8879dc9f3a1a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:58.529643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b2328932-6705-4bca-9dac-8879dc9f3a1a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041962 Jul 14 09:44:58.530223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 401/824] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:44:59.075355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0e3209a5-cd1f-4944-b798-823d98f51431 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:59.076187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0e3209a5-cd1f-4944-b798-823d98f51431 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:59.082213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3209a5-cd1f-4944-b798-823d98f51431 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:59.082660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3209a5-cd1f-4944-b798-823d98f51431 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:59.083417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3209a5-cd1f-4944-b798-823d98f51431 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:59.083851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3209a5-cd1f-4944-b798-823d98f51431 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:59.112612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0e3209a5-cd1f-4944-b798-823d98f51431 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Jul 14 09:44:59.113161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 424/825] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:44:59 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:44:59.398229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cef65d2a-dc11-4ab5-85d8-2ff089bb7957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:59.398229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cef65d2a-dc11-4ab5-85d8-2ff089bb7957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:59.413646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cef65d2a-dc11-4ab5-85d8-2ff089bb7957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:59.414083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cef65d2a-dc11-4ab5-85d8-2ff089bb7957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:59.414980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cef65d2a-dc11-4ab5-85d8-2ff089bb7957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:59.415405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cef65d2a-dc11-4ab5-85d8-2ff089bb7957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:59.541713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bec641eb-8186-431a-a67f-acab8042df38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:44:59.542658 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bec641eb-8186-431a-a67f-acab8042df38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:44:59.548680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bec641eb-8186-431a-a67f-acab8042df38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:59.549134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bec641eb-8186-431a-a67f-acab8042df38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:59.549905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bec641eb-8186-431a-a67f-acab8042df38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:44:59.550284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cef65d2a-dc11-4ab5-85d8-2ff089bb7957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:44:59.550741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bec641eb-8186-431a-a67f-acab8042df38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:44:59.559272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cef65d2a-dc11-4ab5-85d8-2ff089bb7957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.170376 Jul 14 09:44:59.560039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 402/826] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:44:59 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:44:59.586046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bec641eb-8186-431a-a67f-acab8042df38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048897 Jul 14 09:44:59.586977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 425/827] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:44:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:00.123784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-94187319-9881-45c1-93e2-d90e166e2ba7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:00.125125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-94187319-9881-45c1-93e2-d90e166e2ba7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:00.131892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-94187319-9881-45c1-93e2-d90e166e2ba7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:00.132331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-94187319-9881-45c1-93e2-d90e166e2ba7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:00.133075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-94187319-9881-45c1-93e2-d90e166e2ba7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:00.133500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-94187319-9881-45c1-93e2-d90e166e2ba7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:00.161780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-94187319-9881-45c1-93e2-d90e166e2ba7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041981 Jul 14 09:45:00.162328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 403/828] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:00 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:00.576395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b711173f-eaa2-41e1-ad6d-626e4feef8e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:00.577007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b711173f-eaa2-41e1-ad6d-626e4feef8e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:00.583547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b711173f-eaa2-41e1-ad6d-626e4feef8e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:00.583991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b711173f-eaa2-41e1-ad6d-626e4feef8e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:00.584744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b711173f-eaa2-41e1-ad6d-626e4feef8e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:00.585180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b711173f-eaa2-41e1-ad6d-626e4feef8e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:00.597118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21836f95-e76d-44be-9459-3e5be39634d1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:00.598026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-21836f95-e76d-44be-9459-3e5be39634d1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:00.605122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21836f95-e76d-44be-9459-3e5be39634d1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:00.605565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21836f95-e76d-44be-9459-3e5be39634d1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:00.606352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21836f95-e76d-44be-9459-3e5be39634d1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:00.606781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21836f95-e76d-44be-9459-3e5be39634d1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:00.610361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:00.636536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-21836f95-e76d-44be-9459-3e5be39634d1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043243 Jul 14 09:45:00.637371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 404/829] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:00.719889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b711173f-eaa2-41e1-ad6d-626e4feef8e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:00.727307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b711173f-eaa2-41e1-ad6d-626e4feef8e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.155038 Jul 14 09:45:00.727883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 426/830] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:00 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:01.173403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a8dbc371-9b88-4235-be8c-e180637c8a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:01.174286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a8dbc371-9b88-4235-be8c-e180637c8a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:01.180261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a8dbc371-9b88-4235-be8c-e180637c8a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:01.180705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a8dbc371-9b88-4235-be8c-e180637c8a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:01.182073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a8dbc371-9b88-4235-be8c-e180637c8a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:01.182528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a8dbc371-9b88-4235-be8c-e180637c8a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:01.210167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a8dbc371-9b88-4235-be8c-e180637c8a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040852 Jul 14 09:45:01.210724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 405/831] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:01.649545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ffb6cf06-72e1-44f1-b809-a97e1566b5bf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:01.650981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ffb6cf06-72e1-44f1-b809-a97e1566b5bf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:01.657345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf06-72e1-44f1-b809-a97e1566b5bf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:01.657786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf06-72e1-44f1-b809-a97e1566b5bf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:01.658569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf06-72e1-44f1-b809-a97e1566b5bf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:01.658999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffb6cf06-72e1-44f1-b809-a97e1566b5bf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:01.675904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:01.688816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ffb6cf06-72e1-44f1-b809-a97e1566b5bf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043231 Jul 14 09:45:01.689361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 427/832] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:01.744701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fa57d8b5-bc3c-4781-91c2-abe55a97070b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:01.745305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fa57d8b5-bc3c-4781-91c2-abe55a97070b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:01.751355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa57d8b5-bc3c-4781-91c2-abe55a97070b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:01.751800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa57d8b5-bc3c-4781-91c2-abe55a97070b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:01.752553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa57d8b5-bc3c-4781-91c2-abe55a97070b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:01.752977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa57d8b5-bc3c-4781-91c2-abe55a97070b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:01.881751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fa57d8b5-bc3c-4781-91c2-abe55a97070b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:01.889688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fa57d8b5-bc3c-4781-91c2-abe55a97070b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148972 Jul 14 09:45:01.890264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 406/833] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:01 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:02.221678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-aa6cffac-b2a2-4158-bf73-3d770c85acd1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:02.222614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-aa6cffac-b2a2-4158-bf73-3d770c85acd1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:02.228573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aa6cffac-b2a2-4158-bf73-3d770c85acd1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:02.229018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aa6cffac-b2a2-4158-bf73-3d770c85acd1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:02.229773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aa6cffac-b2a2-4158-bf73-3d770c85acd1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:02.230231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aa6cffac-b2a2-4158-bf73-3d770c85acd1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:02.258046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-aa6cffac-b2a2-4158-bf73-3d770c85acd1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040360 Jul 14 09:45:02.258617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 428/834] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:02 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:02.700467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bbafa997-79c7-4735-adad-e3fc52ce4bc7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:02.701384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bbafa997-79c7-4735-adad-e3fc52ce4bc7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:02.707399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbafa997-79c7-4735-adad-e3fc52ce4bc7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:02.707840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbafa997-79c7-4735-adad-e3fc52ce4bc7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:02.708593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbafa997-79c7-4735-adad-e3fc52ce4bc7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:02.709021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbafa997-79c7-4735-adad-e3fc52ce4bc7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:02.737317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bbafa997-79c7-4735-adad-e3fc52ce4bc7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041226 Jul 14 09:45:02.737861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 407/835] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:02.906334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-24a37e25-a976-446c-86a5-7214c19275f7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:02.906901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-24a37e25-a976-446c-86a5-7214c19275f7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:02.913355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-24a37e25-a976-446c-86a5-7214c19275f7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:02.913801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-24a37e25-a976-446c-86a5-7214c19275f7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:02.914581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-24a37e25-a976-446c-86a5-7214c19275f7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:02.915017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-24a37e25-a976-446c-86a5-7214c19275f7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:03.043261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-24a37e25-a976-446c-86a5-7214c19275f7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:03.050780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-24a37e25-a976-446c-86a5-7214c19275f7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148361 Jul 14 09:45:03.051337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 429/836] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:02 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:03.270176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0c2cc7be-0bf2-470e-92cf-3d3d28905e70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:03.271135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0c2cc7be-0bf2-470e-92cf-3d3d28905e70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:03.277800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c2cc7be-0bf2-470e-92cf-3d3d28905e70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:03.278262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c2cc7be-0bf2-470e-92cf-3d3d28905e70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:03.279006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c2cc7be-0bf2-470e-92cf-3d3d28905e70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:03.279434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c2cc7be-0bf2-470e-92cf-3d3d28905e70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:03.307244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0c2cc7be-0bf2-470e-92cf-3d3d28905e70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041026 Jul 14 09:45:03.307777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 408/837] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:03 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:03.748961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8bc92ad6-a095-4dd9-ae5e-7332b2c216e7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:03.749974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8bc92ad6-a095-4dd9-ae5e-7332b2c216e7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:03.756087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8bc92ad6-a095-4dd9-ae5e-7332b2c216e7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:03.756534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8bc92ad6-a095-4dd9-ae5e-7332b2c216e7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:03.757293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8bc92ad6-a095-4dd9-ae5e-7332b2c216e7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:03.757725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8bc92ad6-a095-4dd9-ae5e-7332b2c216e7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:03.785770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8bc92ad6-a095-4dd9-ae5e-7332b2c216e7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040816 Jul 14 09:45:03.786337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 430/838] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:04.068135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e53e0fe0-4bda-412c-b474-16370fab3d70 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:04.068784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e53e0fe0-4bda-412c-b474-16370fab3d70 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:04.075582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e53e0fe0-4bda-412c-b474-16370fab3d70 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:04.076018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e53e0fe0-4bda-412c-b474-16370fab3d70 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:04.076758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e53e0fe0-4bda-412c-b474-16370fab3d70 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:04.077180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e53e0fe0-4bda-412c-b474-16370fab3d70 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:04.206622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e53e0fe0-4bda-412c-b474-16370fab3d70 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:04.214531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e53e0fe0-4bda-412c-b474-16370fab3d70 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150205 Jul 14 09:45:04.215181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 409/839] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:04 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:04.318768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-988c9809-4536-4e7c-99c4-f1db40e6ee84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:04.319681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-988c9809-4536-4e7c-99c4-f1db40e6ee84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:04.326603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-988c9809-4536-4e7c-99c4-f1db40e6ee84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:04.327052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-988c9809-4536-4e7c-99c4-f1db40e6ee84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:04.327808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-988c9809-4536-4e7c-99c4-f1db40e6ee84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:04.328242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-988c9809-4536-4e7c-99c4-f1db40e6ee84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:04.356360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-988c9809-4536-4e7c-99c4-f1db40e6ee84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Jul 14 09:45:04.356901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 431/840] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:04.797807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dab1237f-3902-4595-bbaa-ac646b3a84a7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:04.798691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dab1237f-3902-4595-bbaa-ac646b3a84a7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:04.805191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dab1237f-3902-4595-bbaa-ac646b3a84a7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:04.805636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dab1237f-3902-4595-bbaa-ac646b3a84a7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:04.806421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dab1237f-3902-4595-bbaa-ac646b3a84a7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:04.806853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dab1237f-3902-4595-bbaa-ac646b3a84a7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:04.835581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dab1237f-3902-4595-bbaa-ac646b3a84a7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041914 Jul 14 09:45:04.836120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 410/841] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:05.231405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-193a0c8f-1cf2-48c5-86b5-d1816ca08f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:05.232015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-193a0c8f-1cf2-48c5-86b5-d1816ca08f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:05.238037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-193a0c8f-1cf2-48c5-86b5-d1816ca08f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:05.238541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-193a0c8f-1cf2-48c5-86b5-d1816ca08f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:05.239298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-193a0c8f-1cf2-48c5-86b5-d1816ca08f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:05.239733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-193a0c8f-1cf2-48c5-86b5-d1816ca08f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:05.366910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-193a0c8f-1cf2-48c5-86b5-d1816ca08f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:05.367747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a325e5c7-0124-463f-8d32-1fc8addad8ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:05.369154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a325e5c7-0124-463f-8d32-1fc8addad8ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:05.374918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-193a0c8f-1cf2-48c5-86b5-d1816ca08f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147375 Jul 14 09:45:05.375114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a325e5c7-0124-463f-8d32-1fc8addad8ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:05.375479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 432/842] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:05 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:05.375600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a325e5c7-0124-463f-8d32-1fc8addad8ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:05.376297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a325e5c7-0124-463f-8d32-1fc8addad8ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:05.376722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a325e5c7-0124-463f-8d32-1fc8addad8ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:05.405510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a325e5c7-0124-463f-8d32-1fc8addad8ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041543 Jul 14 09:45:05.405961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 411/843] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:05.847980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-37c22433-fc51-4492-8099-e286a1c0423f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:05.848815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-37c22433-fc51-4492-8099-e286a1c0423f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:05.854814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37c22433-fc51-4492-8099-e286a1c0423f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:05.855265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37c22433-fc51-4492-8099-e286a1c0423f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:05.856021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37c22433-fc51-4492-8099-e286a1c0423f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:05.856459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37c22433-fc51-4492-8099-e286a1c0423f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:05.884736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-37c22433-fc51-4492-8099-e286a1c0423f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040313 Jul 14 09:45:05.885276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 433/844] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:06.392455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3d3d4850-0a11-41f1-89a9-0e2ec03337b3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:06.393050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3d3d4850-0a11-41f1-89a9-0e2ec03337b3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:06.399482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d3d4850-0a11-41f1-89a9-0e2ec03337b3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:06.399925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d3d4850-0a11-41f1-89a9-0e2ec03337b3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:06.400718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d3d4850-0a11-41f1-89a9-0e2ec03337b3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:06.401141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d3d4850-0a11-41f1-89a9-0e2ec03337b3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:06.417507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-224a41b0-b9ea-40f3-bdc3-b7e55364729f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:06.418459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-224a41b0-b9ea-40f3-bdc3-b7e55364729f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:06.424815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-224a41b0-b9ea-40f3-bdc3-b7e55364729f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:06.425263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-224a41b0-b9ea-40f3-bdc3-b7e55364729f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:06.426024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-224a41b0-b9ea-40f3-bdc3-b7e55364729f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:06.426486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-224a41b0-b9ea-40f3-bdc3-b7e55364729f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:06.456808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-224a41b0-b9ea-40f3-bdc3-b7e55364729f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Jul 14 09:45:06.457392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 434/845] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:06 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:06.535082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3d3d4850-0a11-41f1-89a9-0e2ec03337b3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:06.543209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3d3d4850-0a11-41f1-89a9-0e2ec03337b3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154612 Jul 14 09:45:06.543799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 412/846] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:06 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:06.896417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ce3ec751-3210-4708-b805-2bfcd46e1d41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:06.897352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ce3ec751-3210-4708-b805-2bfcd46e1d41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:06.903822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce3ec751-3210-4708-b805-2bfcd46e1d41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:06.904265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce3ec751-3210-4708-b805-2bfcd46e1d41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:06.905015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce3ec751-3210-4708-b805-2bfcd46e1d41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:06.905445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce3ec751-3210-4708-b805-2bfcd46e1d41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:06.934212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ce3ec751-3210-4708-b805-2bfcd46e1d41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041720 Jul 14 09:45:06.934742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 435/847] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:07.469120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2f8461df-0757-4e37-ad78-a73f63855126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:07.470036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2f8461df-0757-4e37-ad78-a73f63855126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:07.476490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2f8461df-0757-4e37-ad78-a73f63855126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:07.476931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2f8461df-0757-4e37-ad78-a73f63855126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:07.477688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2f8461df-0757-4e37-ad78-a73f63855126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:07.478117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2f8461df-0757-4e37-ad78-a73f63855126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:07.505837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2f8461df-0757-4e37-ad78-a73f63855126 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040694 Jul 14 09:45:07.506403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 413/848] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:07.560984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-be767a57-fa79-4808-998a-ae0897bae925 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:07.561592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-be767a57-fa79-4808-998a-ae0897bae925 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:07.568104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be767a57-fa79-4808-998a-ae0897bae925 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:07.568553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be767a57-fa79-4808-998a-ae0897bae925 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:07.569304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be767a57-fa79-4808-998a-ae0897bae925 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:07.569734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be767a57-fa79-4808-998a-ae0897bae925 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:07.697567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-be767a57-fa79-4808-998a-ae0897bae925 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:07.705221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-be767a57-fa79-4808-998a-ae0897bae925 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148090 Jul 14 09:45:07.705798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 436/849] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:07 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:07.945580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0372e1c3-459b-4efd-a4b2-bf1115b313f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:07.947045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0372e1c3-459b-4efd-a4b2-bf1115b313f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:07.953256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0372e1c3-459b-4efd-a4b2-bf1115b313f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:07.953700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0372e1c3-459b-4efd-a4b2-bf1115b313f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:07.954474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0372e1c3-459b-4efd-a4b2-bf1115b313f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:07.954906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0372e1c3-459b-4efd-a4b2-bf1115b313f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:07.983130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0372e1c3-459b-4efd-a4b2-bf1115b313f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041587 Jul 14 09:45:07.983669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 414/850] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:08.517669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-aab618c3-1375-448c-b2ca-f84c6175df54 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:08.518627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-aab618c3-1375-448c-b2ca-f84c6175df54 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:08.524681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aab618c3-1375-448c-b2ca-f84c6175df54 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:08.525127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aab618c3-1375-448c-b2ca-f84c6175df54 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:08.525902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aab618c3-1375-448c-b2ca-f84c6175df54 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:08.526358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aab618c3-1375-448c-b2ca-f84c6175df54 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:08.554072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-aab618c3-1375-448c-b2ca-f84c6175df54 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040277 Jul 14 09:45:08.554650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 437/851] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:08.722253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a00951e5-4916-4080-bbed-7addbeb1f351 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:08.722781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a00951e5-4916-4080-bbed-7addbeb1f351 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:08.729711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a00951e5-4916-4080-bbed-7addbeb1f351 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:08.730156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a00951e5-4916-4080-bbed-7addbeb1f351 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:08.730934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a00951e5-4916-4080-bbed-7addbeb1f351 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:08.731366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a00951e5-4916-4080-bbed-7addbeb1f351 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:08.858961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a00951e5-4916-4080-bbed-7addbeb1f351 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:08.866559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a00951e5-4916-4080-bbed-7addbeb1f351 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148255 Jul 14 09:45:08.867127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 415/852] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:08 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:08.994704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ea242549-f7d6-4dc5-ac14-7d53addacb08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:08.995546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ea242549-f7d6-4dc5-ac14-7d53addacb08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:09.001916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea242549-f7d6-4dc5-ac14-7d53addacb08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:09.002416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea242549-f7d6-4dc5-ac14-7d53addacb08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:09.003184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea242549-f7d6-4dc5-ac14-7d53addacb08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:09.004822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea242549-f7d6-4dc5-ac14-7d53addacb08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:09.031966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ea242549-f7d6-4dc5-ac14-7d53addacb08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041298 Jul 14 09:45:09.032519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 438/853] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:09.566011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6f906ac9-9898-40a7-a46a-1b3ad853064a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:09.566948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6f906ac9-9898-40a7-a46a-1b3ad853064a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:09.573181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f906ac9-9898-40a7-a46a-1b3ad853064a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:09.573620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f906ac9-9898-40a7-a46a-1b3ad853064a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:09.574405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f906ac9-9898-40a7-a46a-1b3ad853064a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:09.574832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f906ac9-9898-40a7-a46a-1b3ad853064a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:09.602250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6f906ac9-9898-40a7-a46a-1b3ad853064a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040137 Jul 14 09:45:09.603316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 416/854] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:09.884101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72d19c5c-5680-4452-935a-f9cb21f9f2da tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:09.884630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-72d19c5c-5680-4452-935a-f9cb21f9f2da tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:09.890642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72d19c5c-5680-4452-935a-f9cb21f9f2da tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:09.891088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72d19c5c-5680-4452-935a-f9cb21f9f2da tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:09.891844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72d19c5c-5680-4452-935a-f9cb21f9f2da tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:09.892277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72d19c5c-5680-4452-935a-f9cb21f9f2da tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:10.022516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-72d19c5c-5680-4452-935a-f9cb21f9f2da tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:10.031883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-72d19c5c-5680-4452-935a-f9cb21f9f2da tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151430 Jul 14 09:45:10.032830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 439/855] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:09 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:10.044124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8b4d0baa-00e9-464f-be1d-67d40c0ae2f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:10.045060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8b4d0baa-00e9-464f-be1d-67d40c0ae2f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:10.051450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b4d0baa-00e9-464f-be1d-67d40c0ae2f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:10.051890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b4d0baa-00e9-464f-be1d-67d40c0ae2f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:10.052638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b4d0baa-00e9-464f-be1d-67d40c0ae2f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:10.053064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b4d0baa-00e9-464f-be1d-67d40c0ae2f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:10.081400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8b4d0baa-00e9-464f-be1d-67d40c0ae2f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041828 Jul 14 09:45:10.081939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 417/856] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:10.614312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-289d1c8c-f17a-490e-9673-1a36dbb12a64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:10.615230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-289d1c8c-f17a-490e-9673-1a36dbb12a64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:10.621362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-289d1c8c-f17a-490e-9673-1a36dbb12a64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:10.621811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-289d1c8c-f17a-490e-9673-1a36dbb12a64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:10.622596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-289d1c8c-f17a-490e-9673-1a36dbb12a64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:10.623033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-289d1c8c-f17a-490e-9673-1a36dbb12a64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:10.650934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-289d1c8c-f17a-490e-9673-1a36dbb12a64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040601 Jul 14 09:45:10.651472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 440/857] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:11.050197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f9539ae4-9586-4f30-9bd8-507b91efbf5a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:11.050822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f9539ae4-9586-4f30-9bd8-507b91efbf5a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:11.057263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9539ae4-9586-4f30-9bd8-507b91efbf5a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:11.057707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9539ae4-9586-4f30-9bd8-507b91efbf5a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:11.058483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9539ae4-9586-4f30-9bd8-507b91efbf5a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:11.058915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9539ae4-9586-4f30-9bd8-507b91efbf5a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:11.093638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-58373e8a-b804-4eb8-af6d-fd31237992be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:11.094573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-58373e8a-b804-4eb8-af6d-fd31237992be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:11.100586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-58373e8a-b804-4eb8-af6d-fd31237992be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:11.101035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-58373e8a-b804-4eb8-af6d-fd31237992be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:11.101799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-58373e8a-b804-4eb8-af6d-fd31237992be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:11.102413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-58373e8a-b804-4eb8-af6d-fd31237992be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:11.131379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-58373e8a-b804-4eb8-af6d-fd31237992be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041526 Jul 14 09:45:11.131940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 441/858] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:11.190620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f9539ae4-9586-4f30-9bd8-507b91efbf5a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:11.199799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f9539ae4-9586-4f30-9bd8-507b91efbf5a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153452 Jul 14 09:45:11.200421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 418/859] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:11 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:11.662495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c0efa794-95c2-4ac9-96fd-408709c97447 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:11.663444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c0efa794-95c2-4ac9-96fd-408709c97447 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:11.670482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0efa794-95c2-4ac9-96fd-408709c97447 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:11.670931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0efa794-95c2-4ac9-96fd-408709c97447 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:11.671684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0efa794-95c2-4ac9-96fd-408709c97447 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:11.672120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0efa794-95c2-4ac9-96fd-408709c97447 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:11.700412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c0efa794-95c2-4ac9-96fd-408709c97447 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041902 Jul 14 09:45:11.700950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 442/860] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:11 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:12.143634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-14a0ad27-f308-4707-b120-fa1e139708b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:12.144595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-14a0ad27-f308-4707-b120-fa1e139708b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:12.151099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14a0ad27-f308-4707-b120-fa1e139708b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:12.151545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14a0ad27-f308-4707-b120-fa1e139708b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:12.152307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14a0ad27-f308-4707-b120-fa1e139708b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:12.152743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14a0ad27-f308-4707-b120-fa1e139708b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:12.180831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-14a0ad27-f308-4707-b120-fa1e139708b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040757 Jul 14 09:45:12.181370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 419/861] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:12.216462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fe711356-effb-4d19-b271-f673e4637e18 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:12.217064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fe711356-effb-4d19-b271-f673e4637e18 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:12.223230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fe711356-effb-4d19-b271-f673e4637e18 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:12.223675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fe711356-effb-4d19-b271-f673e4637e18 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:12.224427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fe711356-effb-4d19-b271-f673e4637e18 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:12.224856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fe711356-effb-4d19-b271-f673e4637e18 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:12.361783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fe711356-effb-4d19-b271-f673e4637e18 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:12.369781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fe711356-effb-4d19-b271-f673e4637e18 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.157124 Jul 14 09:45:12.370353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 443/862] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:12 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:12.712718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-caffbf10-7d7e-492e-a016-be178004b8da tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:12.713638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-caffbf10-7d7e-492e-a016-be178004b8da tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:12.719748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caffbf10-7d7e-492e-a016-be178004b8da tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:12.720136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caffbf10-7d7e-492e-a016-be178004b8da tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:12.720891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caffbf10-7d7e-492e-a016-be178004b8da tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:12.721319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-caffbf10-7d7e-492e-a016-be178004b8da tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:12.745579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:12.750653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-caffbf10-7d7e-492e-a016-be178004b8da tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Jul 14 09:45:12.751213 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 420/863] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:13.192125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-06409fc4-4edb-4385-af67-75c2b0cf6fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:13.193038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-06409fc4-4edb-4385-af67-75c2b0cf6fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:13.199646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-06409fc4-4edb-4385-af67-75c2b0cf6fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:13.200102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-06409fc4-4edb-4385-af67-75c2b0cf6fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:13.200857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-06409fc4-4edb-4385-af67-75c2b0cf6fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:13.201286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-06409fc4-4edb-4385-af67-75c2b0cf6fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:13.204898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:13.230276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-06409fc4-4edb-4385-af67-75c2b0cf6fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042050 Jul 14 09:45:13.231024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 444/864] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:13.387014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c6c34df2-e15b-4b62-ac4b-c7468b02f765 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:13.387647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c6c34df2-e15b-4b62-ac4b-c7468b02f765 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:13.394151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6c34df2-e15b-4b62-ac4b-c7468b02f765 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:13.394631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6c34df2-e15b-4b62-ac4b-c7468b02f765 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:13.395393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6c34df2-e15b-4b62-ac4b-c7468b02f765 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:13.395830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6c34df2-e15b-4b62-ac4b-c7468b02f765 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:13.524476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c6c34df2-e15b-4b62-ac4b-c7468b02f765 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:13.532570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c6c34df2-e15b-4b62-ac4b-c7468b02f765 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149750 Jul 14 09:45:13.533163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 421/865] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:13 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:13.762521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-77839d1a-d804-4990-9788-b4d9d394f002 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:13.763372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-77839d1a-d804-4990-9788-b4d9d394f002 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:13.769461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-77839d1a-d804-4990-9788-b4d9d394f002 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:13.769913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-77839d1a-d804-4990-9788-b4d9d394f002 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:13.770722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-77839d1a-d804-4990-9788-b4d9d394f002 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:13.771163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-77839d1a-d804-4990-9788-b4d9d394f002 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:13.801010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-77839d1a-d804-4990-9788-b4d9d394f002 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 Jul 14 09:45:13.801778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 445/866] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:13 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:14.241064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-696a230d-32b9-40a0-903b-6e336acaea3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:14.241967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-696a230d-32b9-40a0-903b-6e336acaea3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:14.248542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-696a230d-32b9-40a0-903b-6e336acaea3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:14.248977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-696a230d-32b9-40a0-903b-6e336acaea3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:14.249721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-696a230d-32b9-40a0-903b-6e336acaea3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:14.250147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-696a230d-32b9-40a0-903b-6e336acaea3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:14.278568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-696a230d-32b9-40a0-903b-6e336acaea3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041469 Jul 14 09:45:14.279111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 422/867] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:14.550823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8ff19599-7df7-4c4e-b3ab-c9f61adb431e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:14.551346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8ff19599-7df7-4c4e-b3ab-c9f61adb431e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:14.558566 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ff19599-7df7-4c4e-b3ab-c9f61adb431e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:14.559012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ff19599-7df7-4c4e-b3ab-c9f61adb431e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:14.560207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ff19599-7df7-4c4e-b3ab-c9f61adb431e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:14.560207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ff19599-7df7-4c4e-b3ab-c9f61adb431e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:14.690512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8ff19599-7df7-4c4e-b3ab-c9f61adb431e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:14.698377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8ff19599-7df7-4c4e-b3ab-c9f61adb431e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151396 Jul 14 09:45:14.698940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 446/868] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:14 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:14.813184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1ff36026-478e-4c92-a632-55f67812f6dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:14.814075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ff36026-478e-4c92-a632-55f67812f6dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:14.821072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ff36026-478e-4c92-a632-55f67812f6dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:14.821507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ff36026-478e-4c92-a632-55f67812f6dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:14.822304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ff36026-478e-4c92-a632-55f67812f6dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:14.823001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ff36026-478e-4c92-a632-55f67812f6dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:14.850838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1ff36026-478e-4c92-a632-55f67812f6dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041635 Jul 14 09:45:14.851393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 423/869] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:15.289457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d745536d-4399-46e7-a1b6-721287b4ce0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:15.290403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d745536d-4399-46e7-a1b6-721287b4ce0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:15.297071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d745536d-4399-46e7-a1b6-721287b4ce0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:15.297513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d745536d-4399-46e7-a1b6-721287b4ce0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:15.298297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d745536d-4399-46e7-a1b6-721287b4ce0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:15.298732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d745536d-4399-46e7-a1b6-721287b4ce0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:15.327252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d745536d-4399-46e7-a1b6-721287b4ce0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041749 Jul 14 09:45:15.327791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 447/870] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:15.714494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a896cb0a-b201-424e-b826-53184f0e3254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:15.715095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a896cb0a-b201-424e-b826-53184f0e3254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:15.721076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a896cb0a-b201-424e-b826-53184f0e3254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:15.721507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a896cb0a-b201-424e-b826-53184f0e3254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:15.722274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a896cb0a-b201-424e-b826-53184f0e3254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:15.722699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a896cb0a-b201-424e-b826-53184f0e3254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:15.847456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a896cb0a-b201-424e-b826-53184f0e3254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:15.854856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a896cb0a-b201-424e-b826-53184f0e3254 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.144324 Jul 14 09:45:15.855413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 424/871] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:15 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:15.862845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fed97fa2-74e8-4de1-ad24-dda980e1b5ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:15.863788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fed97fa2-74e8-4de1-ad24-dda980e1b5ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:15.870729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fed97fa2-74e8-4de1-ad24-dda980e1b5ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:15.871174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fed97fa2-74e8-4de1-ad24-dda980e1b5ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:15.871933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fed97fa2-74e8-4de1-ad24-dda980e1b5ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:15.872367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fed97fa2-74e8-4de1-ad24-dda980e1b5ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:15.900256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fed97fa2-74e8-4de1-ad24-dda980e1b5ca tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041396 Jul 14 09:45:15.900793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 448/872] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:16.339718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d29621bd-3a9b-42d7-986a-926f2856f545 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:16.340741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d29621bd-3a9b-42d7-986a-926f2856f545 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:16.346818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d29621bd-3a9b-42d7-986a-926f2856f545 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:16.347266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d29621bd-3a9b-42d7-986a-926f2856f545 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:16.348024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d29621bd-3a9b-42d7-986a-926f2856f545 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:16.348455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d29621bd-3a9b-42d7-986a-926f2856f545 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:16.376672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d29621bd-3a9b-42d7-986a-926f2856f545 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041675 Jul 14 09:45:16.377216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 425/873] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:16.871509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b57c4057-b962-44cd-9fae-e9d48eba98ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:16.872092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b57c4057-b962-44cd-9fae-e9d48eba98ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:16.879218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b57c4057-b962-44cd-9fae-e9d48eba98ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:16.879678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b57c4057-b962-44cd-9fae-e9d48eba98ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:16.880413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b57c4057-b962-44cd-9fae-e9d48eba98ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:16.880843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b57c4057-b962-44cd-9fae-e9d48eba98ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:16.911449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-282de3ba-72fd-44d3-9623-732d7884bd6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:16.912364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-282de3ba-72fd-44d3-9623-732d7884bd6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:16.919456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-282de3ba-72fd-44d3-9623-732d7884bd6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:16.919902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-282de3ba-72fd-44d3-9623-732d7884bd6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:16.920690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-282de3ba-72fd-44d3-9623-732d7884bd6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:16.921121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-282de3ba-72fd-44d3-9623-732d7884bd6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:16.950080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-282de3ba-72fd-44d3-9623-732d7884bd6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042637 Jul 14 09:45:16.953852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 426/874] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:16 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:17.008729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b57c4057-b962-44cd-9fae-e9d48eba98ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:17.016223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b57c4057-b962-44cd-9fae-e9d48eba98ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149227 Jul 14 09:45:17.016785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 449/875] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:16 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:17.387655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b1b57564-bb0c-4622-a22d-e332ca3a8806 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:17.388559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b1b57564-bb0c-4622-a22d-e332ca3a8806 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:17.394473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1b57564-bb0c-4622-a22d-e332ca3a8806 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:17.394916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1b57564-bb0c-4622-a22d-e332ca3a8806 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:17.395659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1b57564-bb0c-4622-a22d-e332ca3a8806 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:17.396087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1b57564-bb0c-4622-a22d-e332ca3a8806 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:17.424578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b1b57564-bb0c-4622-a22d-e332ca3a8806 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040972 Jul 14 09:45:17.425119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 427/876] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:17.961724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5f0b8ac8-e8b1-4b03-b0cc-6f140112926e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:17.963193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5f0b8ac8-e8b1-4b03-b0cc-6f140112926e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:17.969590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f0b8ac8-e8b1-4b03-b0cc-6f140112926e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:17.970036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f0b8ac8-e8b1-4b03-b0cc-6f140112926e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:17.970836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f0b8ac8-e8b1-4b03-b0cc-6f140112926e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:17.971267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f0b8ac8-e8b1-4b03-b0cc-6f140112926e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:17.999446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5f0b8ac8-e8b1-4b03-b0cc-6f140112926e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041700 Jul 14 09:45:17.999994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 450/877] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:18.032642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43a5d4ea-73e9-4619-adf1-f089edfa1469 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:18.033243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-43a5d4ea-73e9-4619-adf1-f089edfa1469 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:18.039713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a5d4ea-73e9-4619-adf1-f089edfa1469 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:18.040155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a5d4ea-73e9-4619-adf1-f089edfa1469 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:18.041548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a5d4ea-73e9-4619-adf1-f089edfa1469 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:18.041979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a5d4ea-73e9-4619-adf1-f089edfa1469 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:18.179419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43a5d4ea-73e9-4619-adf1-f089edfa1469 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:18.186840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-43a5d4ea-73e9-4619-adf1-f089edfa1469 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.157983 Jul 14 09:45:18.187398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 428/878] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:18 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:18.435729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-54ee70d4-55b7-4150-b01b-27a468abd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:18.436657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-54ee70d4-55b7-4150-b01b-27a468abd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:18.442659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-54ee70d4-55b7-4150-b01b-27a468abd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:18.443099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-54ee70d4-55b7-4150-b01b-27a468abd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:18.443840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-54ee70d4-55b7-4150-b01b-27a468abd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:18.444269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-54ee70d4-55b7-4150-b01b-27a468abd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:18.473301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-54ee70d4-55b7-4150-b01b-27a468abd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041510 Jul 14 09:45:18.473857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 451/879] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:19.011980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-69ab9de1-000e-454e-bab8-5700f762d96d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:19.012884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-69ab9de1-000e-454e-bab8-5700f762d96d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:19.018981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69ab9de1-000e-454e-bab8-5700f762d96d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:19.019423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69ab9de1-000e-454e-bab8-5700f762d96d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:19.020171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69ab9de1-000e-454e-bab8-5700f762d96d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:19.020597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69ab9de1-000e-454e-bab8-5700f762d96d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:19.047744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-69ab9de1-000e-454e-bab8-5700f762d96d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040479 Jul 14 09:45:19.048365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 429/880] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:19 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:19.203840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-891f143a-3428-4bfc-b34a-84d881470d72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:19.204442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-891f143a-3428-4bfc-b34a-84d881470d72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:19.210955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-891f143a-3428-4bfc-b34a-84d881470d72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:19.211398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-891f143a-3428-4bfc-b34a-84d881470d72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:19.212151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-891f143a-3428-4bfc-b34a-84d881470d72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:19.212586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-891f143a-3428-4bfc-b34a-84d881470d72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:19.339656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-891f143a-3428-4bfc-b34a-84d881470d72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:19.347127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-891f143a-3428-4bfc-b34a-84d881470d72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147113 Jul 14 09:45:19.347687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 452/881] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:19 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:19.485053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8c145de3-867f-4b65-8c89-c765bacc3cb6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:19.485954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8c145de3-867f-4b65-8c89-c765bacc3cb6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:19.491923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c145de3-867f-4b65-8c89-c765bacc3cb6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:19.492362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c145de3-867f-4b65-8c89-c765bacc3cb6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:19.493110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c145de3-867f-4b65-8c89-c765bacc3cb6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:19.493661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c145de3-867f-4b65-8c89-c765bacc3cb6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:19.521365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8c145de3-867f-4b65-8c89-c765bacc3cb6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040282 Jul 14 09:45:19.521926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 430/882] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:20.060042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0c10337a-7aae-4f0a-82d1-5ef2ce9c9e3b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:20.060958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0c10337a-7aae-4f0a-82d1-5ef2ce9c9e3b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:20.067030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c10337a-7aae-4f0a-82d1-5ef2ce9c9e3b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:20.067478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c10337a-7aae-4f0a-82d1-5ef2ce9c9e3b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:20.068235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c10337a-7aae-4f0a-82d1-5ef2ce9c9e3b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:20.068670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c10337a-7aae-4f0a-82d1-5ef2ce9c9e3b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:20.100835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0c10337a-7aae-4f0a-82d1-5ef2ce9c9e3b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Jul 14 09:45:20.101390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 453/883] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:20.364411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32a0222f-48d9-4e98-85d5-de7655f4cdc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:20.365018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-32a0222f-48d9-4e98-85d5-de7655f4cdc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:20.372052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32a0222f-48d9-4e98-85d5-de7655f4cdc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:20.372502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32a0222f-48d9-4e98-85d5-de7655f4cdc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:20.373294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32a0222f-48d9-4e98-85d5-de7655f4cdc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:20.373729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32a0222f-48d9-4e98-85d5-de7655f4cdc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:20.504983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32a0222f-48d9-4e98-85d5-de7655f4cdc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:20.513317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-32a0222f-48d9-4e98-85d5-de7655f4cdc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152614 Jul 14 09:45:20.513888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 431/884] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:20 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:20.532971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-55f6245e-7238-4554-9629-697dd47bda3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:20.533876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-55f6245e-7238-4554-9629-697dd47bda3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:20.540306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-55f6245e-7238-4554-9629-697dd47bda3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:20.540746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-55f6245e-7238-4554-9629-697dd47bda3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:20.541494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-55f6245e-7238-4554-9629-697dd47bda3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:20.542019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-55f6245e-7238-4554-9629-697dd47bda3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:20.573296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-55f6245e-7238-4554-9629-697dd47bda3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044281 Jul 14 09:45:20.573852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 454/885] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:21.112538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a28aa6b7-351b-4eb4-8646-d61f83a511d8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:21.113452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a28aa6b7-351b-4eb4-8646-d61f83a511d8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:21.120332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a28aa6b7-351b-4eb4-8646-d61f83a511d8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:21.120839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a28aa6b7-351b-4eb4-8646-d61f83a511d8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:21.121586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a28aa6b7-351b-4eb4-8646-d61f83a511d8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:21.122010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a28aa6b7-351b-4eb4-8646-d61f83a511d8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:21.149969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a28aa6b7-351b-4eb4-8646-d61f83a511d8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Jul 14 09:45:21.150539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 432/886] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:21.529488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8bdfcbf0-b7d9-4eda-97fb-30f73b8d4f43 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:21.530090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8bdfcbf0-b7d9-4eda-97fb-30f73b8d4f43 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:21.536141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8bdfcbf0-b7d9-4eda-97fb-30f73b8d4f43 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:21.536702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8bdfcbf0-b7d9-4eda-97fb-30f73b8d4f43 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:21.537343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8bdfcbf0-b7d9-4eda-97fb-30f73b8d4f43 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:21.537771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8bdfcbf0-b7d9-4eda-97fb-30f73b8d4f43 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:21.585049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ab11a34f-61b4-4a69-a71e-84cb762abe87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:21.586063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ab11a34f-61b4-4a69-a71e-84cb762abe87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:21.597830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab11a34f-61b4-4a69-a71e-84cb762abe87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:21.598355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab11a34f-61b4-4a69-a71e-84cb762abe87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:21.599149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab11a34f-61b4-4a69-a71e-84cb762abe87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:21.599580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab11a34f-61b4-4a69-a71e-84cb762abe87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:21.629768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ab11a34f-61b4-4a69-a71e-84cb762abe87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048706 Jul 14 09:45:21.630396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 433/887] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:21.671539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8bdfcbf0-b7d9-4eda-97fb-30f73b8d4f43 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:21.679062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8bdfcbf0-b7d9-4eda-97fb-30f73b8d4f43 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153450 Jul 14 09:45:21.679634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 455/888] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:21 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:22.161682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8fe99eea-3614-4837-8d04-db225edb9490 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:22.162620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8fe99eea-3614-4837-8d04-db225edb9490 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:22.168630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fe99eea-3614-4837-8d04-db225edb9490 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:22.169070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fe99eea-3614-4837-8d04-db225edb9490 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:22.169813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fe99eea-3614-4837-8d04-db225edb9490 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:22.170255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fe99eea-3614-4837-8d04-db225edb9490 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:22.198445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8fe99eea-3614-4837-8d04-db225edb9490 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039818 Jul 14 09:45:22.198915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 434/889] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:22 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:22.641783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-deda1e6c-6f31-4d7c-b86d-ae690e4a240d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:22.642711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-deda1e6c-6f31-4d7c-b86d-ae690e4a240d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:22.644997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=82 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:22.650621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-deda1e6c-6f31-4d7c-b86d-ae690e4a240d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:22.651581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-deda1e6c-6f31-4d7c-b86d-ae690e4a240d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:22.652389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-deda1e6c-6f31-4d7c-b86d-ae690e4a240d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:22.652832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-deda1e6c-6f31-4d7c-b86d-ae690e4a240d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:22.681550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-deda1e6c-6f31-4d7c-b86d-ae690e4a240d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043846 Jul 14 09:45:22.682106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 456/890] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:22.695799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-51f55d02-9e24-484b-932f-aa7213bc9f98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:22.696404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-51f55d02-9e24-484b-932f-aa7213bc9f98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:22.699116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=86 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:22.704535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51f55d02-9e24-484b-932f-aa7213bc9f98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:22.704977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51f55d02-9e24-484b-932f-aa7213bc9f98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:22.705732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51f55d02-9e24-484b-932f-aa7213bc9f98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:22.706164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51f55d02-9e24-484b-932f-aa7213bc9f98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:22.837299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-51f55d02-9e24-484b-932f-aa7213bc9f98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:22.845548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-51f55d02-9e24-484b-932f-aa7213bc9f98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153542 Jul 14 09:45:22.846102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 435/891] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:22 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:23.209084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c3182a33-d402-467d-a72d-060aeb2c4317 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:23.209996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c3182a33-d402-467d-a72d-060aeb2c4317 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:23.215934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3182a33-d402-467d-a72d-060aeb2c4317 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:23.216377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3182a33-d402-467d-a72d-060aeb2c4317 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:23.217124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3182a33-d402-467d-a72d-060aeb2c4317 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:23.217552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c3182a33-d402-467d-a72d-060aeb2c4317 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:23.244583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c3182a33-d402-467d-a72d-060aeb2c4317 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039446 Jul 14 09:45:23.245656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 457/892] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:23.693358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0b29932e-067e-407f-b408-dab869c0672f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:23.694307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0b29932e-067e-407f-b408-dab869c0672f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:23.701169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0b29932e-067e-407f-b408-dab869c0672f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:23.701730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0b29932e-067e-407f-b408-dab869c0672f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:23.702385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0b29932e-067e-407f-b408-dab869c0672f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:23.702817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0b29932e-067e-407f-b408-dab869c0672f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:23.730939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0b29932e-067e-407f-b408-dab869c0672f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041568 Jul 14 09:45:23.731477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 436/893] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:23.862214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1ffc0500-52a9-4de1-b758-144b96b196a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:23.862767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1ffc0500-52a9-4de1-b758-144b96b196a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:23.869285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ffc0500-52a9-4de1-b758-144b96b196a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:23.869768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ffc0500-52a9-4de1-b758-144b96b196a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:23.871055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ffc0500-52a9-4de1-b758-144b96b196a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:23.871483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ffc0500-52a9-4de1-b758-144b96b196a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:24.001211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1ffc0500-52a9-4de1-b758-144b96b196a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:24.008659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1ffc0500-52a9-4de1-b758-144b96b196a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150322 Jul 14 09:45:24.009204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 458/894] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:23 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:24.256868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b799278e-abe6-4675-98a2-b8777f425d4d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:24.257829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b799278e-abe6-4675-98a2-b8777f425d4d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:24.264631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b799278e-abe6-4675-98a2-b8777f425d4d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:24.265076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b799278e-abe6-4675-98a2-b8777f425d4d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:24.265846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b799278e-abe6-4675-98a2-b8777f425d4d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:24.266302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b799278e-abe6-4675-98a2-b8777f425d4d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:24.284369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:24.297257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b799278e-abe6-4675-98a2-b8777f425d4d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Jul 14 09:45:24.297815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 437/895] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:24 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:24.741899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-39704987-4a53-44b1-bd19-beea3c4ed27c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:24.742851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-39704987-4a53-44b1-bd19-beea3c4ed27c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:24.748850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39704987-4a53-44b1-bd19-beea3c4ed27c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:24.749355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39704987-4a53-44b1-bd19-beea3c4ed27c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:24.750334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39704987-4a53-44b1-bd19-beea3c4ed27c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:24.750815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39704987-4a53-44b1-bd19-beea3c4ed27c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:24.779216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-39704987-4a53-44b1-bd19-beea3c4ed27c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041308 Jul 14 09:45:24.779781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 459/896] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:25.025298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-366cc5f4-7f39-48b1-b4d0-69f289120360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:25.026509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-366cc5f4-7f39-48b1-b4d0-69f289120360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:25.033070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-366cc5f4-7f39-48b1-b4d0-69f289120360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:25.033514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-366cc5f4-7f39-48b1-b4d0-69f289120360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:25.034294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-366cc5f4-7f39-48b1-b4d0-69f289120360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:25.034730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-366cc5f4-7f39-48b1-b4d0-69f289120360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:25.162352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-366cc5f4-7f39-48b1-b4d0-69f289120360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:25.169711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-366cc5f4-7f39-48b1-b4d0-69f289120360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148226 Jul 14 09:45:25.170286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 438/897] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:25 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:25.309230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2be68dfe-7e6c-4cd3-b942-9b9a2699a283 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:25.310077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2be68dfe-7e6c-4cd3-b942-9b9a2699a283 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:25.316578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2be68dfe-7e6c-4cd3-b942-9b9a2699a283 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:25.317025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2be68dfe-7e6c-4cd3-b942-9b9a2699a283 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:25.317783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2be68dfe-7e6c-4cd3-b942-9b9a2699a283 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:25.318247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2be68dfe-7e6c-4cd3-b942-9b9a2699a283 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:25.343213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:25.348340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2be68dfe-7e6c-4cd3-b942-9b9a2699a283 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043183 Jul 14 09:45:25.348886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 460/898] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:25 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:25.791027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e4fee462-95fe-4474-a844-2ff90b254090 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:25.792455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e4fee462-95fe-4474-a844-2ff90b254090 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:25.798526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4fee462-95fe-4474-a844-2ff90b254090 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:25.798965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4fee462-95fe-4474-a844-2ff90b254090 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:25.799718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4fee462-95fe-4474-a844-2ff90b254090 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:25.800145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4fee462-95fe-4474-a844-2ff90b254090 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:25.830217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e4fee462-95fe-4474-a844-2ff90b254090 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043091 Jul 14 09:45:25.830698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 439/899] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:26.186939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1f71172e-5b61-44ad-9088-0ae30c81553e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:26.187550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1f71172e-5b61-44ad-9088-0ae30c81553e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:26.193525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f71172e-5b61-44ad-9088-0ae30c81553e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:26.193969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f71172e-5b61-44ad-9088-0ae30c81553e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:26.194764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f71172e-5b61-44ad-9088-0ae30c81553e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:26.195203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f71172e-5b61-44ad-9088-0ae30c81553e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:26.331014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1f71172e-5b61-44ad-9088-0ae30c81553e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:26.339062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1f71172e-5b61-44ad-9088-0ae30c81553e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.155622 Jul 14 09:45:26.339613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 461/900] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:26 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:26.360575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5299deaa-48ce-44d5-ab7c-56a9b2e1b0fe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:26.361484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5299deaa-48ce-44d5-ab7c-56a9b2e1b0fe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:26.367859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5299deaa-48ce-44d5-ab7c-56a9b2e1b0fe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:26.368294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5299deaa-48ce-44d5-ab7c-56a9b2e1b0fe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:26.369040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5299deaa-48ce-44d5-ab7c-56a9b2e1b0fe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:26.369465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5299deaa-48ce-44d5-ab7c-56a9b2e1b0fe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:26.397040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5299deaa-48ce-44d5-ab7c-56a9b2e1b0fe tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040496 Jul 14 09:45:26.397588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 440/901] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:26.842852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-00202675-648b-4127-8bcb-269e86fd5595 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:26.843685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-00202675-648b-4127-8bcb-269e86fd5595 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:26.849637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00202675-648b-4127-8bcb-269e86fd5595 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:26.850083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00202675-648b-4127-8bcb-269e86fd5595 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:26.850877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00202675-648b-4127-8bcb-269e86fd5595 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:26.851315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00202675-648b-4127-8bcb-269e86fd5595 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:26.879429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-00202675-648b-4127-8bcb-269e86fd5595 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041668 Jul 14 09:45:26.879967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 462/902] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:27.408052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-83bd6b4a-8b9e-4914-8a04-64a51b8282e8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:27.408957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-83bd6b4a-8b9e-4914-8a04-64a51b8282e8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:27.415076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-83bd6b4a-8b9e-4914-8a04-64a51b8282e8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:27.415515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-83bd6b4a-8b9e-4914-8a04-64a51b8282e8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:27.416269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-83bd6b4a-8b9e-4914-8a04-64a51b8282e8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:27.417231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-83bd6b4a-8b9e-4914-8a04-64a51b8282e8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:27.445459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-83bd6b4a-8b9e-4914-8a04-64a51b8282e8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 Jul 14 09:45:27.446005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 463/903] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:27.455184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ee5a4b45-d810-492c-8cff-e90fc0afcc54 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:27.455826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ee5a4b45-d810-492c-8cff-e90fc0afcc54 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:27.461757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee5a4b45-d810-492c-8cff-e90fc0afcc54 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:27.462209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee5a4b45-d810-492c-8cff-e90fc0afcc54 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:27.462984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee5a4b45-d810-492c-8cff-e90fc0afcc54 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:27.463431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee5a4b45-d810-492c-8cff-e90fc0afcc54 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:27.590538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ee5a4b45-d810-492c-8cff-e90fc0afcc54 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:27.598043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ee5a4b45-d810-492c-8cff-e90fc0afcc54 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.245621 Jul 14 09:45:27.598622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 441/904] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:27 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:27.891224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c062a745-bbfc-4017-94cb-e6aafde60302 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:27.892134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c062a745-bbfc-4017-94cb-e6aafde60302 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:27.898078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c062a745-bbfc-4017-94cb-e6aafde60302 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:27.898552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c062a745-bbfc-4017-94cb-e6aafde60302 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:27.899305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c062a745-bbfc-4017-94cb-e6aafde60302 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:27.899737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c062a745-bbfc-4017-94cb-e6aafde60302 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:27.929504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c062a745-bbfc-4017-94cb-e6aafde60302 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042270 Jul 14 09:45:27.930043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 464/905] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:28.457057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dfeb229d-5e15-42aa-af36-430dcefcab4c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:28.458037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dfeb229d-5e15-42aa-af36-430dcefcab4c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:28.464644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfeb229d-5e15-42aa-af36-430dcefcab4c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:28.465096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfeb229d-5e15-42aa-af36-430dcefcab4c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:28.465857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfeb229d-5e15-42aa-af36-430dcefcab4c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:28.466321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfeb229d-5e15-42aa-af36-430dcefcab4c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:28.493959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dfeb229d-5e15-42aa-af36-430dcefcab4c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040894 Jul 14 09:45:28.494527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 442/906] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:28.615187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-df828d5a-a61c-423f-85ba-928389eb85d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:28.615800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-df828d5a-a61c-423f-85ba-928389eb85d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:28.622400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df828d5a-a61c-423f-85ba-928389eb85d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:28.622851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df828d5a-a61c-423f-85ba-928389eb85d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:28.623613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df828d5a-a61c-423f-85ba-928389eb85d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:28.624053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df828d5a-a61c-423f-85ba-928389eb85d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:28.755801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-df828d5a-a61c-423f-85ba-928389eb85d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:28.763801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-df828d5a-a61c-423f-85ba-928389eb85d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152509 Jul 14 09:45:28.764353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 465/907] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:28 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:28.941103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4f9c840f-70ef-4546-930f-0c2b901dabe8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:28.942049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4f9c840f-70ef-4546-930f-0c2b901dabe8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:28.949074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4f9c840f-70ef-4546-930f-0c2b901dabe8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:28.949517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4f9c840f-70ef-4546-930f-0c2b901dabe8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:28.950352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4f9c840f-70ef-4546-930f-0c2b901dabe8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:28.950781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4f9c840f-70ef-4546-930f-0c2b901dabe8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:28.979035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4f9c840f-70ef-4546-930f-0c2b901dabe8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042009 Jul 14 09:45:28.979564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 443/908] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:29.504944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-46ec5a2d-e9c5-4f48-8566-a11a9f410c42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:29.505861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-46ec5a2d-e9c5-4f48-8566-a11a9f410c42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:29.511900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46ec5a2d-e9c5-4f48-8566-a11a9f410c42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:29.512353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46ec5a2d-e9c5-4f48-8566-a11a9f410c42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:29.513114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46ec5a2d-e9c5-4f48-8566-a11a9f410c42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:29.513555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46ec5a2d-e9c5-4f48-8566-a11a9f410c42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:29.541147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-46ec5a2d-e9c5-4f48-8566-a11a9f410c42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040127 Jul 14 09:45:29.541694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 466/909] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:29.780860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f0b2995e-1904-4432-8f61-e2346a8747e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:29.781382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f0b2995e-1904-4432-8f61-e2346a8747e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:29.787907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f0b2995e-1904-4432-8f61-e2346a8747e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:29.788348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f0b2995e-1904-4432-8f61-e2346a8747e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:29.789088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f0b2995e-1904-4432-8f61-e2346a8747e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:29.789515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f0b2995e-1904-4432-8f61-e2346a8747e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:29.919408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f0b2995e-1904-4432-8f61-e2346a8747e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:29.926855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f0b2995e-1904-4432-8f61-e2346a8747e3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150000 Jul 14 09:45:29.927400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 444/910] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:29 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:29.990565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-74cb1d99-1cd4-4150-b122-78b9e9956878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:29.991512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-74cb1d99-1cd4-4150-b122-78b9e9956878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:29.998463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74cb1d99-1cd4-4150-b122-78b9e9956878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:29.998918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74cb1d99-1cd4-4150-b122-78b9e9956878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:29.999680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74cb1d99-1cd4-4150-b122-78b9e9956878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:30.000122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74cb1d99-1cd4-4150-b122-78b9e9956878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:30.028606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-74cb1d99-1cd4-4150-b122-78b9e9956878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042003 Jul 14 09:45:30.029158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 467/911] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:30.553283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1e164970-11aa-4782-abe5-6238f4ce9bdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:30.554511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1e164970-11aa-4782-abe5-6238f4ce9bdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:30.561119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e164970-11aa-4782-abe5-6238f4ce9bdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:30.561559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e164970-11aa-4782-abe5-6238f4ce9bdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:30.562350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e164970-11aa-4782-abe5-6238f4ce9bdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:30.563122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e164970-11aa-4782-abe5-6238f4ce9bdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:30.591158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1e164970-11aa-4782-abe5-6238f4ce9bdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Jul 14 09:45:30.591706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 445/912] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:30 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:30.944257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-07555c2d-f099-4a02-8821-9a19733082a6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:30.944867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-07555c2d-f099-4a02-8821-9a19733082a6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:30.951817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07555c2d-f099-4a02-8821-9a19733082a6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:30.952267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07555c2d-f099-4a02-8821-9a19733082a6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:30.953026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07555c2d-f099-4a02-8821-9a19733082a6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:30.953463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07555c2d-f099-4a02-8821-9a19733082a6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:31.040287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-05da1258-e71c-431c-a369-7a46036ce927 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:31.041202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-05da1258-e71c-431c-a369-7a46036ce927 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:31.048231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-05da1258-e71c-431c-a369-7a46036ce927 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:31.048675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-05da1258-e71c-431c-a369-7a46036ce927 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:31.049427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-05da1258-e71c-431c-a369-7a46036ce927 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:31.049858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-05da1258-e71c-431c-a369-7a46036ce927 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:31.078819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-05da1258-e71c-431c-a369-7a46036ce927 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042442 Jul 14 09:45:31.079382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 446/913] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:31.081491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-07555c2d-f099-4a02-8821-9a19733082a6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:31.088982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-07555c2d-f099-4a02-8821-9a19733082a6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148577 Jul 14 09:45:31.089540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 468/914] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:30 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:31.602479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-645c63f1-81ec-4e74-8bc5-c0c27f5bd011 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:31.603422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-645c63f1-81ec-4e74-8bc5-c0c27f5bd011 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:31.610078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-645c63f1-81ec-4e74-8bc5-c0c27f5bd011 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:31.610548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-645c63f1-81ec-4e74-8bc5-c0c27f5bd011 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:31.611292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-645c63f1-81ec-4e74-8bc5-c0c27f5bd011 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:31.611782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-645c63f1-81ec-4e74-8bc5-c0c27f5bd011 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:31.639460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-645c63f1-81ec-4e74-8bc5-c0c27f5bd011 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Jul 14 09:45:31.640006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 447/915] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:31.846734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6c1513d0-2ab5-498f-ad68-e84cee35c08d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:31.847227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6c1513d0-2ab5-498f-ad68-e84cee35c08d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:31.853138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c1513d0-2ab5-498f-ad68-e84cee35c08d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:31.853581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c1513d0-2ab5-498f-ad68-e84cee35c08d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:31.854449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c1513d0-2ab5-498f-ad68-e84cee35c08d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:31.858496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c1513d0-2ab5-498f-ad68-e84cee35c08d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:31.884730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6c1513d0-2ab5-498f-ad68-e84cee35c08d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad/ips" status: 200 len: 150 microversion: 2.1 time: 0.093114 Jul 14 09:45:31.885270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 469/916] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 09:45:31 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:31.896527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46190db4-e605-49d6-b376-a7c45ff90461"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:45:31.897562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:31.904218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:31.904649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:31.905399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:31.905821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:32.092036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ab866af6-35d6-40c6-957f-ea46d7622f7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:32.092896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ab866af6-35d6-40c6-957f-ea46d7622f7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:32.099379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab866af6-35d6-40c6-957f-ea46d7622f7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:32.099827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab866af6-35d6-40c6-957f-ea46d7622f7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:32.100585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab866af6-35d6-40c6-957f-ea46d7622f7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:32.101019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab866af6-35d6-40c6-957f-ea46d7622f7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:32.129094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ab866af6-35d6-40c6-957f-ea46d7622f7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042646 Jul 14 09:45:32.129647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 470/917] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:32.133884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3343c17f-c236-44f3-b095-b0be120e88aa tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:32.134511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3343c17f-c236-44f3-b095-b0be120e88aa tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:32.140696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3343c17f-c236-44f3-b095-b0be120e88aa tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:32.141146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3343c17f-c236-44f3-b095-b0be120e88aa tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:32.141901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3343c17f-c236-44f3-b095-b0be120e88aa tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:32.142374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3343c17f-c236-44f3-b095-b0be120e88aa tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:32.275883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3343c17f-c236-44f3-b095-b0be120e88aa tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:32.283472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3343c17f-c236-44f3-b095-b0be120e88aa tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152901 Jul 14 09:45:32.284031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 471/918] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:32 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:32.651201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3eff07a0-ffbe-4259-be63-134694e03615 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:32.652162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3eff07a0-ffbe-4259-be63-134694e03615 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:32.658094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eff07a0-ffbe-4259-be63-134694e03615 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:32.658580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eff07a0-ffbe-4259-be63-134694e03615 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:32.659328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eff07a0-ffbe-4259-be63-134694e03615 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:32.659756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eff07a0-ffbe-4259-be63-134694e03615 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:32.688284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3eff07a0-ffbe-4259-be63-134694e03615 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041103 Jul 14 09:45:32.688815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 472/919] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:33.141496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-905cb9d5-52e3-4851-b19a-597126159aef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:33.142442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-905cb9d5-52e3-4851-b19a-597126159aef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:33.148964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-905cb9d5-52e3-4851-b19a-597126159aef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:33.149413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-905cb9d5-52e3-4851-b19a-597126159aef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:33.150172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-905cb9d5-52e3-4851-b19a-597126159aef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:33.150629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-905cb9d5-52e3-4851-b19a-597126159aef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:33.179448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-905cb9d5-52e3-4851-b19a-597126159aef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041910 Jul 14 09:45:33.179989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 473/920] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:33.300159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b494e36-f597-4a34-89fa-d21a3a1f88a5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:33.300756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b494e36-f597-4a34-89fa-d21a3a1f88a5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:33.306793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b494e36-f597-4a34-89fa-d21a3a1f88a5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:33.307232 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b494e36-f597-4a34-89fa-d21a3a1f88a5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:33.307978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b494e36-f597-4a34-89fa-d21a3a1f88a5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:33.308405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b494e36-f597-4a34-89fa-d21a3a1f88a5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:33.434493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b494e36-f597-4a34-89fa-d21a3a1f88a5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:33.442062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b494e36-f597-4a34-89fa-d21a3a1f88a5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.145588 Jul 14 09:45:33.442643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 474/921] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:33 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:33.699909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-494084de-6626-47e7-a51d-331a365d76c0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:33.700776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-494084de-6626-47e7-a51d-331a365d76c0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:33.706804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-494084de-6626-47e7-a51d-331a365d76c0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:33.707264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-494084de-6626-47e7-a51d-331a365d76c0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:33.707996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-494084de-6626-47e7-a51d-331a365d76c0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:33.708425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-494084de-6626-47e7-a51d-331a365d76c0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:33.736172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-494084de-6626-47e7-a51d-331a365d76c0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041087 Jul 14 09:45:33.736720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 475/922] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:34.190726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e81b8ab0-b4cc-49cb-947b-6832edcac357 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:34.191630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e81b8ab0-b4cc-49cb-947b-6832edcac357 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:34.198469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e81b8ab0-b4cc-49cb-947b-6832edcac357 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:34.198901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e81b8ab0-b4cc-49cb-947b-6832edcac357 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:34.199647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e81b8ab0-b4cc-49cb-947b-6832edcac357 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:34.200074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e81b8ab0-b4cc-49cb-947b-6832edcac357 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:34.229199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e81b8ab0-b4cc-49cb-947b-6832edcac357 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042439 Jul 14 09:45:34.230312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 476/923] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:34.459831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c2c9bfdc-8649-4262-9db4-5901e4054ae2 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:34.460381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c2c9bfdc-8649-4262-9db4-5901e4054ae2 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:34.467024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2c9bfdc-8649-4262-9db4-5901e4054ae2 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:34.467463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2c9bfdc-8649-4262-9db4-5901e4054ae2 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:34.468209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2c9bfdc-8649-4262-9db4-5901e4054ae2 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:34.468635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2c9bfdc-8649-4262-9db4-5901e4054ae2 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:34.600168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c2c9bfdc-8649-4262-9db4-5901e4054ae2 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:34.604144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:34.609694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c2c9bfdc-8649-4262-9db4-5901e4054ae2 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153817 Jul 14 09:45:34.610277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 477/924] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:34 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:34.748122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8b970a74-c984-4533-8409-be36b0642f07 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:34.748968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8b970a74-c984-4533-8409-be36b0642f07 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:34.754877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b970a74-c984-4533-8409-be36b0642f07 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:34.755320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b970a74-c984-4533-8409-be36b0642f07 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:34.756070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b970a74-c984-4533-8409-be36b0642f07 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:34.756501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b970a74-c984-4533-8409-be36b0642f07 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:34.785174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8b970a74-c984-4533-8409-be36b0642f07 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041309 Jul 14 09:45:34.785694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 478/925] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:35.241590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-358fea81-aaf8-48c0-b1ee-899a1a48c209 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:35.242521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-358fea81-aaf8-48c0-b1ee-899a1a48c209 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:35.249554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-358fea81-aaf8-48c0-b1ee-899a1a48c209 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:35.249996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-358fea81-aaf8-48c0-b1ee-899a1a48c209 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:35.250772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-358fea81-aaf8-48c0-b1ee-899a1a48c209 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:35.251205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-358fea81-aaf8-48c0-b1ee-899a1a48c209 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:35.279317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-358fea81-aaf8-48c0-b1ee-899a1a48c209 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041676 Jul 14 09:45:35.279861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 479/926] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:35.627360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a8f50cc3-7fa2-4a98-a837-4e07ed3b3f5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:35.627967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a8f50cc3-7fa2-4a98-a837-4e07ed3b3f5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:35.633887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a8f50cc3-7fa2-4a98-a837-4e07ed3b3f5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:35.634356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a8f50cc3-7fa2-4a98-a837-4e07ed3b3f5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:35.635109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a8f50cc3-7fa2-4a98-a837-4e07ed3b3f5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:35.635537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a8f50cc3-7fa2-4a98-a837-4e07ed3b3f5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:35.761968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a8f50cc3-7fa2-4a98-a837-4e07ed3b3f5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:35.769502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a8f50cc3-7fa2-4a98-a837-4e07ed3b3f5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146016 Jul 14 09:45:35.770059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 480/927] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:35 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:35.796816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0458e3f7-1900-4e10-b381-9b961553aadc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:35.797726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0458e3f7-1900-4e10-b381-9b961553aadc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:35.803670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0458e3f7-1900-4e10-b381-9b961553aadc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:35.804119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0458e3f7-1900-4e10-b381-9b961553aadc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:35.804879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0458e3f7-1900-4e10-b381-9b961553aadc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:35.805316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0458e3f7-1900-4e10-b381-9b961553aadc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:35.833715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0458e3f7-1900-4e10-b381-9b961553aadc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041134 Jul 14 09:45:35.834209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 481/928] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:35 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:36.291042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1bd104a1-5b32-4208-b359-e5c67448d287 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:36.291936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1bd104a1-5b32-4208-b359-e5c67448d287 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:36.298426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bd104a1-5b32-4208-b359-e5c67448d287 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:36.298877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bd104a1-5b32-4208-b359-e5c67448d287 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:36.299661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bd104a1-5b32-4208-b359-e5c67448d287 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:36.300099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bd104a1-5b32-4208-b359-e5c67448d287 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:36.328653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1bd104a1-5b32-4208-b359-e5c67448d287 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041591 Jul 14 09:45:36.329193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 482/929] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:36.785834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f69e8660-9fb0-4919-836b-b917725071c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:36.786477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f69e8660-9fb0-4919-836b-b917725071c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:36.792445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f69e8660-9fb0-4919-836b-b917725071c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:36.792888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f69e8660-9fb0-4919-836b-b917725071c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:36.793639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f69e8660-9fb0-4919-836b-b917725071c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:36.794074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f69e8660-9fb0-4919-836b-b917725071c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:36.921592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f69e8660-9fb0-4919-836b-b917725071c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:36.928996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f69e8660-9fb0-4919-836b-b917725071c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146949 Jul 14 09:45:36.929543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 483/930] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:36 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:36.934507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cb607b4c-f82e-41b3-aae7-e94b3d4426fd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:36.935398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cb607b4c-f82e-41b3-aae7-e94b3d4426fd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:36.941168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb607b4c-f82e-41b3-aae7-e94b3d4426fd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:36.941742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb607b4c-f82e-41b3-aae7-e94b3d4426fd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:36.942534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb607b4c-f82e-41b3-aae7-e94b3d4426fd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:36.942967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb607b4c-f82e-41b3-aae7-e94b3d4426fd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:36.973412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cb607b4c-f82e-41b3-aae7-e94b3d4426fd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 Jul 14 09:45:36.974311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 484/931] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:37.340652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c75fcf2-e9a0-45bb-8b6d-eb1d23e70f44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:37.341567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c75fcf2-e9a0-45bb-8b6d-eb1d23e70f44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:37.348380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c75fcf2-e9a0-45bb-8b6d-eb1d23e70f44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:37.348828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c75fcf2-e9a0-45bb-8b6d-eb1d23e70f44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:37.349662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c75fcf2-e9a0-45bb-8b6d-eb1d23e70f44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:37.350098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c75fcf2-e9a0-45bb-8b6d-eb1d23e70f44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:37.380752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c75fcf2-e9a0-45bb-8b6d-eb1d23e70f44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044020 Jul 14 09:45:37.381310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 485/932] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:37.947590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-197eea3d-834e-4259-90ed-18f6ec86ef9c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:37.948211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-197eea3d-834e-4259-90ed-18f6ec86ef9c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:37.954784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-197eea3d-834e-4259-90ed-18f6ec86ef9c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:37.955232 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-197eea3d-834e-4259-90ed-18f6ec86ef9c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:37.955996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-197eea3d-834e-4259-90ed-18f6ec86ef9c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:37.956426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-197eea3d-834e-4259-90ed-18f6ec86ef9c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:38.096996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-197eea3d-834e-4259-90ed-18f6ec86ef9c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:38.104829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-197eea3d-834e-4259-90ed-18f6ec86ef9c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.161279 Jul 14 09:45:38.105371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 486/933] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:37 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:38.110411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7bd51107-e180-41a0-bc04-b9bf1091d43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:38.111670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7bd51107-e180-41a0-bc04-b9bf1091d43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:38.119136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7bd51107-e180-41a0-bc04-b9bf1091d43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:38.119985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7bd51107-e180-41a0-bc04-b9bf1091d43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:38.121274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7bd51107-e180-41a0-bc04-b9bf1091d43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:38.121712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7bd51107-e180-41a0-bc04-b9bf1091d43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:38.151105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7bd51107-e180-41a0-bc04-b9bf1091d43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Jul 14 09:45:38.151680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 487/934] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:38.391674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5fa566cb-541e-4316-98c9-91b113989423 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:38.392499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5fa566cb-541e-4316-98c9-91b113989423 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:38.399092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fa566cb-541e-4316-98c9-91b113989423 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:38.399538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fa566cb-541e-4316-98c9-91b113989423 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:38.400436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fa566cb-541e-4316-98c9-91b113989423 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:38.400864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5fa566cb-541e-4316-98c9-91b113989423 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:38.430590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5fa566cb-541e-4316-98c9-91b113989423 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042965 Jul 14 09:45:38.431120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 488/935] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:39.127259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-131f7e68-28ca-4f79-bc05-624e315a8e52 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:39.127804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-131f7e68-28ca-4f79-bc05-624e315a8e52 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:39.133785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-131f7e68-28ca-4f79-bc05-624e315a8e52 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:39.134364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-131f7e68-28ca-4f79-bc05-624e315a8e52 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:39.135147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-131f7e68-28ca-4f79-bc05-624e315a8e52 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:39.135579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-131f7e68-28ca-4f79-bc05-624e315a8e52 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:39.262503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-131f7e68-28ca-4f79-bc05-624e315a8e52 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:39.269863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-131f7e68-28ca-4f79-bc05-624e315a8e52 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146489 Jul 14 09:45:39.270445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 489/936] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:39 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:39.274994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-91921d74-46bf-4abb-83fe-217b11b369c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:39.275887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-91921d74-46bf-4abb-83fe-217b11b369c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:39.281762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91921d74-46bf-4abb-83fe-217b11b369c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:39.282223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91921d74-46bf-4abb-83fe-217b11b369c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:39.282976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91921d74-46bf-4abb-83fe-217b11b369c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:39.283401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91921d74-46bf-4abb-83fe-217b11b369c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:39.311806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-91921d74-46bf-4abb-83fe-217b11b369c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040303 Jul 14 09:45:39.312351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 490/937] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:39.442509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-412e8328-a1bb-4c30-b899-d304841bd3d6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:39.443410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-412e8328-a1bb-4c30-b899-d304841bd3d6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:39.450418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-412e8328-a1bb-4c30-b899-d304841bd3d6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:39.450859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-412e8328-a1bb-4c30-b899-d304841bd3d6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:39.451606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-412e8328-a1bb-4c30-b899-d304841bd3d6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:39.452035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-412e8328-a1bb-4c30-b899-d304841bd3d6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:39.480619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-412e8328-a1bb-4c30-b899-d304841bd3d6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042081 Jul 14 09:45:39.481152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 491/938] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:40.286514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da6a8022-acdb-4495-ae14-bb2324a12847 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:40.287122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da6a8022-acdb-4495-ae14-bb2324a12847 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:40.293245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6a8022-acdb-4495-ae14-bb2324a12847 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:40.293694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6a8022-acdb-4495-ae14-bb2324a12847 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:40.294477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6a8022-acdb-4495-ae14-bb2324a12847 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:40.294913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6a8022-acdb-4495-ae14-bb2324a12847 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:40.679935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da6a8022-acdb-4495-ae14-bb2324a12847 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:40.687970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da6a8022-acdb-4495-ae14-bb2324a12847 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.405343 Jul 14 09:45:40.688526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 492/939] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:40 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:40.692984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b5f802b-1e30-4980-be50-96ad141cfa78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:40.693882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b5f802b-1e30-4980-be50-96ad141cfa78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:40.700221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b5f802b-1e30-4980-be50-96ad141cfa78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:40.700660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b5f802b-1e30-4980-be50-96ad141cfa78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:40.701413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b5f802b-1e30-4980-be50-96ad141cfa78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:40.701848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b5f802b-1e30-4980-be50-96ad141cfa78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:40.729256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b5f802b-1e30-4980-be50-96ad141cfa78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039756 Jul 14 09:45:40.730345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 493/940] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:40.734718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8023d395-d502-4ddb-a16b-98231aa72b69 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:40.735590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8023d395-d502-4ddb-a16b-98231aa72b69 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:40.741084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8023d395-d502-4ddb-a16b-98231aa72b69 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:40.741529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8023d395-d502-4ddb-a16b-98231aa72b69 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:40.742328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8023d395-d502-4ddb-a16b-98231aa72b69 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:40.742766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8023d395-d502-4ddb-a16b-98231aa72b69 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:40.759165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:40.771722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8023d395-d502-4ddb-a16b-98231aa72b69 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040445 Jul 14 09:45:40.772259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 494/941] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:41.705212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4a76f263-e652-4c17-a25b-4533f8ad8d50 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:41.705834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4a76f263-e652-4c17-a25b-4533f8ad8d50 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:41.712329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4a76f263-e652-4c17-a25b-4533f8ad8d50 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:41.712777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4a76f263-e652-4c17-a25b-4533f8ad8d50 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:41.713555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4a76f263-e652-4c17-a25b-4533f8ad8d50 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:41.713975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4a76f263-e652-4c17-a25b-4533f8ad8d50 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:41.838938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4a76f263-e652-4c17-a25b-4533f8ad8d50 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:41.846984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4a76f263-e652-4c17-a25b-4533f8ad8d50 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.145581 Jul 14 09:45:41.847541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 495/942] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:41 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:41.851981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-73c9449c-9b1f-4c38-a68e-7a195233586f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:41.852917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-73c9449c-9b1f-4c38-a68e-7a195233586f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:41.858604 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-73c9449c-9b1f-4c38-a68e-7a195233586f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:41.859051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-73c9449c-9b1f-4c38-a68e-7a195233586f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:41.859803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-73c9449c-9b1f-4c38-a68e-7a195233586f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:41.860236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-73c9449c-9b1f-4c38-a68e-7a195233586f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:41.888871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-73c9449c-9b1f-4c38-a68e-7a195233586f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040358 Jul 14 09:45:41.889564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 496/943] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:41.894436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1b9d3095-9ade-42d2-969d-2c86e66e9165 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:41.895325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1b9d3095-9ade-42d2-969d-2c86e66e9165 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:41.900963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b9d3095-9ade-42d2-969d-2c86e66e9165 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:41.901274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=27 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:41.901764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b9d3095-9ade-42d2-969d-2c86e66e9165 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:41.902175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b9d3095-9ade-42d2-969d-2c86e66e9165 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:41.902635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b9d3095-9ade-42d2-969d-2c86e66e9165 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:41.923408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=66 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:41.936550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1b9d3095-9ade-42d2-969d-2c86e66e9165 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045914 Jul 14 09:45:41.937119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 497/944] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:42.863995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-106c380b-fdcc-49c6-bb7e-9362e290ebd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:42.864597 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-106c380b-fdcc-49c6-bb7e-9362e290ebd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:42.871620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-106c380b-fdcc-49c6-bb7e-9362e290ebd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:42.872066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-106c380b-fdcc-49c6-bb7e-9362e290ebd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:42.872825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-106c380b-fdcc-49c6-bb7e-9362e290ebd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:42.873268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-106c380b-fdcc-49c6-bb7e-9362e290ebd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.006459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-106c380b-fdcc-49c6-bb7e-9362e290ebd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:43.013876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-106c380b-fdcc-49c6-bb7e-9362e290ebd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153765 Jul 14 09:45:43.014469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 498/945] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:42 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:43.018909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f824b8f5-1118-46ab-8004-583b0ad13b12 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:43.019805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f824b8f5-1118-46ab-8004-583b0ad13b12 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:43.025353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f824b8f5-1118-46ab-8004-583b0ad13b12 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:43.025799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f824b8f5-1118-46ab-8004-583b0ad13b12 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.026584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f824b8f5-1118-46ab-8004-583b0ad13b12 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:43.027023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f824b8f5-1118-46ab-8004-583b0ad13b12 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.054955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f824b8f5-1118-46ab-8004-583b0ad13b12 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039513 Jul 14 09:45:43.055490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 499/946] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:43.060424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9d779ebe-4e17-45c6-bb18-06e9f7a1b55e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:43.061294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9d779ebe-4e17-45c6-bb18-06e9f7a1b55e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:43.066814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d779ebe-4e17-45c6-bb18-06e9f7a1b55e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:43.067264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d779ebe-4e17-45c6-bb18-06e9f7a1b55e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.068013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d779ebe-4e17-45c6-bb18-06e9f7a1b55e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:43.068447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d779ebe-4e17-45c6-bb18-06e9f7a1b55e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.096119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9d779ebe-4e17-45c6-bb18-06e9f7a1b55e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039678 Jul 14 09:45:43.096652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 500/947] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:43.662719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: volume 46190db4-e605-49d6-b376-a7c45ff90461 is already attached to instances: 7f265cbd-76a7-486d-873c-085ab051c168 Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: POST /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad/os-volume_attachments HTTP/1.1 Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 74 Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:45:43.664705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {"volumeAttachment": {"volumeId": "46190db4-e605-49d6-b376-a7c45ff90461"}} Jul 14 09:45:43.666401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: volume 46190db4-e605-49d6-b376-a7c45ff90461 is already attached to instances: 7f265cbd-76a7-486d-873c-085ab051c168 Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '70e1234d-e61b-402a-8ad9-380bbe756dad', 'body': {'volumeAttachment': {'volumeId': '46190db4-e605-49d6-b376-a7c45ff90461'}}} Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 46190db4-e605-49d6-b376-a7c45ff90461 is already attached to instances: 7f265cbd-76a7-486d-873c-085ab051c168 Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:45:43.667188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 46190db4-e605-49d6-b376-a7c45ff90461 is already attached to instances: 7f265cbd-76a7-486d-873c-085ab051c168 Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:45:43.668939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:45:43.670332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:45:43.670332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:45:43.670332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:45:43.670332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 46190db4-e605-49d6-b376-a7c45ff90461 is already attached to instances: 7f265cbd-76a7-486d-873c-085ab051c168 Jul 14 09:45:43.670332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:45:43.670332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: volume 46190db4-e605-49d6-b376-a7c45ff90461 is already attached to instances: 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:45:43.670332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5e95bf74-cbf9-4844-9186-014ce910bc0a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 11.773582 Jul 14 09:45:43.670332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 448/948] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 09:45:31 2022] POST /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad/os-volume_attachments => generated 174 bytes in 11775 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:45:43.675613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d5528104-0bd2-4131-9e54-c7291a1f3198 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:43.676117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d5528104-0bd2-4131-9e54-c7291a1f3198 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:43.682039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5528104-0bd2-4131-9e54-c7291a1f3198 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:43.682528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5528104-0bd2-4131-9e54-c7291a1f3198 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.683318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5528104-0bd2-4131-9e54-c7291a1f3198 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:43.683758 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5528104-0bd2-4131-9e54-c7291a1f3198 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.708626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d5528104-0bd2-4131-9e54-c7291a1f3198 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:45:43.783149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d5528104-0bd2-4131-9e54-c7291a1f3198 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 204 len: 0 microversion: 2.1 time: 0.111207 Jul 14 09:45:43.783724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 501/949] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:45:43 2022] DELETE /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:45:43.792004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4e8757a5-f695-42e1-a24a-749148a3a354 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:43.792641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4e8757a5-f695-42e1-a24a-749148a3a354 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:43.798959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e8757a5-f695-42e1-a24a-749148a3a354 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:43.799405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e8757a5-f695-42e1-a24a-749148a3a354 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.800164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e8757a5-f695-42e1-a24a-749148a3a354 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:43.800596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e8757a5-f695-42e1-a24a-749148a3a354 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:43.929685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4e8757a5-f695-42e1-a24a-749148a3a354 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:43.937765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4e8757a5-f695-42e1-a24a-749148a3a354 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1682 microversion: 2.1 time: 0.149666 Jul 14 09:45:43.938366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 449/950] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:43 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:44.031730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-12867ba0-6336-4d13-852c-e9b6a59df10d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:44.032341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-12867ba0-6336-4d13-852c-e9b6a59df10d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:44.039419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12867ba0-6336-4d13-852c-e9b6a59df10d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:44.039864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12867ba0-6336-4d13-852c-e9b6a59df10d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:44.040619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12867ba0-6336-4d13-852c-e9b6a59df10d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:44.041123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12867ba0-6336-4d13-852c-e9b6a59df10d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:44.066182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f75a8298-7d4f-4489-9012-c443a4848bb0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:44.067168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f75a8298-7d4f-4489-9012-c443a4848bb0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:44.073326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f75a8298-7d4f-4489-9012-c443a4848bb0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:44.073799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f75a8298-7d4f-4489-9012-c443a4848bb0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:44.074662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f75a8298-7d4f-4489-9012-c443a4848bb0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:44.075089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f75a8298-7d4f-4489-9012-c443a4848bb0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:44.106621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f75a8298-7d4f-4489-9012-c443a4848bb0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Jul 14 09:45:44.107612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 450/951] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:44.112464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8bdb069a-ea60-4a7a-bae8-17c1db01c74c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:44.113370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8bdb069a-ea60-4a7a-bae8-17c1db01c74c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:44.119425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8bdb069a-ea60-4a7a-bae8-17c1db01c74c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:44.119873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8bdb069a-ea60-4a7a-bae8-17c1db01c74c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:44.120670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8bdb069a-ea60-4a7a-bae8-17c1db01c74c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:44.121104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8bdb069a-ea60-4a7a-bae8-17c1db01c74c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:44.157751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8bdb069a-ea60-4a7a-bae8-17c1db01c74c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048981 Jul 14 09:45:44.158538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 451/952] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:44.197235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-12867ba0-6336-4d13-852c-e9b6a59df10d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:44.204908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-12867ba0-6336-4d13-852c-e9b6a59df10d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.177465 Jul 14 09:45:44.205472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 502/953] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:44 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:44.955043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-648e575a-ae6b-4da7-98fb-b3a5aeea187d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:44.955651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-648e575a-ae6b-4da7-98fb-b3a5aeea187d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:44.962471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-648e575a-ae6b-4da7-98fb-b3a5aeea187d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:44.962922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-648e575a-ae6b-4da7-98fb-b3a5aeea187d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:44.963679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-648e575a-ae6b-4da7-98fb-b3a5aeea187d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:44.964111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-648e575a-ae6b-4da7-98fb-b3a5aeea187d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:45.089988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-648e575a-ae6b-4da7-98fb-b3a5aeea187d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:45.097305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-648e575a-ae6b-4da7-98fb-b3a5aeea187d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1682 microversion: 2.1 time: 0.146110 Jul 14 09:45:45.097855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 452/954] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:44 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:45.118434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-89972bd6-2e3c-401d-b628-3031edf82138 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:45.119392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-89972bd6-2e3c-401d-b628-3031edf82138 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:45.122348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:45.128510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89972bd6-2e3c-401d-b628-3031edf82138 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:45.128964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89972bd6-2e3c-401d-b628-3031edf82138 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:45.129736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89972bd6-2e3c-401d-b628-3031edf82138 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:45.130174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89972bd6-2e3c-401d-b628-3031edf82138 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:45.159243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-89972bd6-2e3c-401d-b628-3031edf82138 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044854 Jul 14 09:45:45.159793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 503/955] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:45 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:45.168863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1ca34484-f1cd-4cc2-9b03-635dc2cb869b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:45.169912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ca34484-f1cd-4cc2-9b03-635dc2cb869b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:45.175858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ca34484-f1cd-4cc2-9b03-635dc2cb869b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:45.176295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ca34484-f1cd-4cc2-9b03-635dc2cb869b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:45.177041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ca34484-f1cd-4cc2-9b03-635dc2cb869b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:45.177465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ca34484-f1cd-4cc2-9b03-635dc2cb869b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:45.206592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1ca34484-f1cd-4cc2-9b03-635dc2cb869b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041617 Jul 14 09:45:45.207274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 453/956] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:45.221133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-63e941cc-9cde-4f4e-8a75-0acce31b8c5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:45.221747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-63e941cc-9cde-4f4e-8a75-0acce31b8c5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:45.227793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63e941cc-9cde-4f4e-8a75-0acce31b8c5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:45.228242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63e941cc-9cde-4f4e-8a75-0acce31b8c5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:45.229004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63e941cc-9cde-4f4e-8a75-0acce31b8c5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:45.229448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63e941cc-9cde-4f4e-8a75-0acce31b8c5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:45.366254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-63e941cc-9cde-4f4e-8a75-0acce31b8c5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:45.374351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-63e941cc-9cde-4f4e-8a75-0acce31b8c5d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.157016 Jul 14 09:45:45.374907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 504/957] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:45 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:46.116038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0fb8a32d-c29c-44b1-ac17-3f95f39e3618 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:46.116644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0fb8a32d-c29c-44b1-ac17-3f95f39e3618 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:46.123122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0fb8a32d-c29c-44b1-ac17-3f95f39e3618 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:46.123554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0fb8a32d-c29c-44b1-ac17-3f95f39e3618 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:46.124299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0fb8a32d-c29c-44b1-ac17-3f95f39e3618 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:46.124734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0fb8a32d-c29c-44b1-ac17-3f95f39e3618 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:46.171070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6ccbebf0-7fbb-4118-985f-03ed38c38395 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:46.172062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6ccbebf0-7fbb-4118-985f-03ed38c38395 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:46.178709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ccbebf0-7fbb-4118-985f-03ed38c38395 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:46.179159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ccbebf0-7fbb-4118-985f-03ed38c38395 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:46.179961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ccbebf0-7fbb-4118-985f-03ed38c38395 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:46.180400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ccbebf0-7fbb-4118-985f-03ed38c38395 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:46.211266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6ccbebf0-7fbb-4118-985f-03ed38c38395 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Jul 14 09:45:46.212170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 505/958] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:46.220740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-db69cf87-c7e1-46e9-9d7c-747cc85f152d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:46.221732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-db69cf87-c7e1-46e9-9d7c-747cc85f152d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:46.228103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db69cf87-c7e1-46e9-9d7c-747cc85f152d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:46.228625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db69cf87-c7e1-46e9-9d7c-747cc85f152d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:46.229457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db69cf87-c7e1-46e9-9d7c-747cc85f152d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:46.229956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db69cf87-c7e1-46e9-9d7c-747cc85f152d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:46.260953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-db69cf87-c7e1-46e9-9d7c-747cc85f152d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043929 Jul 14 09:45:46.261721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 506/959] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:46.262134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0fb8a32d-c29c-44b1-ac17-3f95f39e3618 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:46.270206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0fb8a32d-c29c-44b1-ac17-3f95f39e3618 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1682 microversion: 2.1 time: 0.159739 Jul 14 09:45:46.270753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 454/960] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:46 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:46.391945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-78918721-4899-4219-9736-fa25b71a6400 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:46.392643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-78918721-4899-4219-9736-fa25b71a6400 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:46.398663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78918721-4899-4219-9736-fa25b71a6400 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:46.399094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78918721-4899-4219-9736-fa25b71a6400 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:46.399853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78918721-4899-4219-9736-fa25b71a6400 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:46.400285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78918721-4899-4219-9736-fa25b71a6400 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:46.530104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78918721-4899-4219-9736-fa25b71a6400 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:46.537725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-78918721-4899-4219-9736-fa25b71a6400 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150314 Jul 14 09:45:46.538392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 507/961] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:46 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:47.182721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-754dae39-f698-4396-a956-f0649b883d49 req-f39c40e4-25b5-4dee-b394-374ae9608348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e1234d-e61b-402a-8ad9-380bbe756dad", "name": "network-vif-deleted", "tag": "b0f598f1-c7bf-4e57-8fc5-a6a7a4f165d5"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:45:47.191462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-754dae39-f698-4396-a956-f0649b883d49 req-f39c40e4-25b5-4dee-b394-374ae9608348 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.191906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-754dae39-f698-4396-a956-f0649b883d49 req-f39c40e4-25b5-4dee-b394-374ae9608348 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.203615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-754dae39-f698-4396-a956-f0649b883d49 req-f39c40e4-25b5-4dee-b394-374ae9608348 service nova] Creating event network-vif-deleted:b0f598f1-c7bf-4e57-8fc5-a6a7a4f165d5 for instance 70e1234d-e61b-402a-8ad9-380bbe756dad on hv-cinder-82549 Jul 14 09:45:47.208807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-754dae39-f698-4396-a956-f0649b883d49 req-f39c40e4-25b5-4dee-b394-374ae9608348 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188399 Jul 14 09:45:47.209392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 455/962] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:47.223319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-19824859-5832-4919-a4f4-ce686caedf34 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:47.224256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-19824859-5832-4919-a4f4-ce686caedf34 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:47.230864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-19824859-5832-4919-a4f4-ce686caedf34 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.231396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-19824859-5832-4919-a4f4-ce686caedf34 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.232245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-19824859-5832-4919-a4f4-ce686caedf34 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.232785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-19824859-5832-4919-a4f4-ce686caedf34 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.266807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-19824859-5832-4919-a4f4-ce686caedf34 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047359 Jul 14 09:45:47.268046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 508/963] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:47.275431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d8439ebc-1412-4f5b-adcd-307ff2eb2d29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:47.277735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d8439ebc-1412-4f5b-adcd-307ff2eb2d29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:47.284693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d8439ebc-1412-4f5b-adcd-307ff2eb2d29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.285151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d8439ebc-1412-4f5b-adcd-307ff2eb2d29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.285916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d8439ebc-1412-4f5b-adcd-307ff2eb2d29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.286374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d8439ebc-1412-4f5b-adcd-307ff2eb2d29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.289603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:47.291466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:47.297695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.298140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.300277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.300830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.333045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:47.337749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d8439ebc-1412-4f5b-adcd-307ff2eb2d29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068264 Jul 14 09:45:47.338571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 456/964] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:47.353526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.353967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.354434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'fault' on Instance uuid 70e1234d-e61b-402a-8ad9-380bbe756dad {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:45:47.400525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:47.408592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f1eda040-7ca0-4457-a0be-0d4360c317d7 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 200 len: 1332 microversion: 2.1 time: 0.123107 Jul 14 09:45:47.418200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 509/965] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:47 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:47.558781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-63866b28-57a2-4bf0-a942-1a57e449abfd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:47.560308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-63866b28-57a2-4bf0-a942-1a57e449abfd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:47.566644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63866b28-57a2-4bf0-a942-1a57e449abfd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.567086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63866b28-57a2-4bf0-a942-1a57e449abfd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.567988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63866b28-57a2-4bf0-a942-1a57e449abfd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:47.568427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63866b28-57a2-4bf0-a942-1a57e449abfd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:47.740580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-63866b28-57a2-4bf0-a942-1a57e449abfd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:47.751822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-63866b28-57a2-4bf0-a942-1a57e449abfd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.201289 Jul 14 09:45:47.752678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 457/966] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:47 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:48.279330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-84f287ad-fea9-4294-9424-190c444b1335 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:48.280384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-84f287ad-fea9-4294-9424-190c444b1335 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:48.287013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84f287ad-fea9-4294-9424-190c444b1335 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:48.287457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84f287ad-fea9-4294-9424-190c444b1335 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:48.288209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84f287ad-fea9-4294-9424-190c444b1335 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:48.288639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84f287ad-fea9-4294-9424-190c444b1335 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:48.316695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-84f287ad-fea9-4294-9424-190c444b1335 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Jul 14 09:45:48.317249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 510/967] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:48.349233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9b0da6d6-abf3-4fe0-aaf4-2c68673e9b29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:48.350085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9b0da6d6-abf3-4fe0-aaf4-2c68673e9b29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:48.356728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b0da6d6-abf3-4fe0-aaf4-2c68673e9b29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:48.357178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b0da6d6-abf3-4fe0-aaf4-2c68673e9b29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:48.357941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b0da6d6-abf3-4fe0-aaf4-2c68673e9b29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:48.358405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b0da6d6-abf3-4fe0-aaf4-2c68673e9b29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:48.388840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9b0da6d6-abf3-4fe0-aaf4-2c68673e9b29 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043689 Jul 14 09:45:48.389388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 458/968] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:48.424831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:48.425437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:48.431619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:48.432062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:48.432816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:48.433279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:48.446477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad HTTP/1.1 Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:45:48.448112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 09:45:48.450219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '70e1234d-e61b-402a-8ad9-380bbe756dad'} Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:45:48.451127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 09:45:48.452640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:45:48.454209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:45:48.454209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6d7bc3e1-e8da-4a1e-83d7-2adc22b06451 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 404 len: 111 microversion: 2.1 time: 0.028797 Jul 14 09:45:48.454209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 511/969] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:48 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:45:48.464650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1f91bed7-b82e-4eca-8312-cd1e3d406795 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '.version_select at 0x7f7da1c74e50>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:48.486817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1f91bed7-b82e-4eca-8312-cd1e3d406795 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661548706" status: 202 len: 0 microversion: 2.1 time: 0.025740 Jul 14 09:45:48.487682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 459/970] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jul 14 09:45:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661548706 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:45:48.769516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-23c7cc21-4d04-43bc-872a-66f08332bf62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:48.770292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-23c7cc21-4d04-43bc-872a-66f08332bf62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:48.776827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-23c7cc21-4d04-43bc-872a-66f08332bf62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:48.777381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-23c7cc21-4d04-43bc-872a-66f08332bf62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:48.778303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-23c7cc21-4d04-43bc-872a-66f08332bf62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:48.778815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-23c7cc21-4d04-43bc-872a-66f08332bf62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:48.936196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-23c7cc21-4d04-43bc-872a-66f08332bf62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:48.944602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-23c7cc21-4d04-43bc-872a-66f08332bf62 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.179023 Jul 14 09:45:48.945329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 512/971] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:48 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:49.328694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-44a96b22-8a9b-4d12-a541-ecc455875c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:49.329597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-44a96b22-8a9b-4d12-a541-ecc455875c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:49.335499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44a96b22-8a9b-4d12-a541-ecc455875c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:49.335937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44a96b22-8a9b-4d12-a541-ecc455875c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:49.336677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44a96b22-8a9b-4d12-a541-ecc455875c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:49.337103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44a96b22-8a9b-4d12-a541-ecc455875c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:49.365924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-44a96b22-8a9b-4d12-a541-ecc455875c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041328 Jul 14 09:45:49.366575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 460/972] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:49.400353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0d2e6f6b-c2da-462d-a19f-0d540d3deeb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:49.401295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0d2e6f6b-c2da-462d-a19f-0d540d3deeb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:49.408450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d2e6f6b-c2da-462d-a19f-0d540d3deeb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:49.408912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d2e6f6b-c2da-462d-a19f-0d540d3deeb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:49.409671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d2e6f6b-c2da-462d-a19f-0d540d3deeb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:49.410102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d2e6f6b-c2da-462d-a19f-0d540d3deeb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:49.440127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0d2e6f6b-c2da-462d-a19f-0d540d3deeb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043471 Jul 14 09:45:49.440944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 513/973] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:49.961774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-df9df246-a1c6-4915-912c-fe8a5dde4b34 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:49.962443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-df9df246-a1c6-4915-912c-fe8a5dde4b34 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:49.968419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-df9df246-a1c6-4915-912c-fe8a5dde4b34 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:49.968861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-df9df246-a1c6-4915-912c-fe8a5dde4b34 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:49.969604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-df9df246-a1c6-4915-912c-fe8a5dde4b34 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:49.970027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-df9df246-a1c6-4915-912c-fe8a5dde4b34 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:50.098452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-df9df246-a1c6-4915-912c-fe8a5dde4b34 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:50.106811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-df9df246-a1c6-4915-912c-fe8a5dde4b34 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148239 Jul 14 09:45:50.107383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 461/974] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:49 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:50.376892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-13c3ff0a-9f1b-41d0-80f0-d0e7f13d5588 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:50.377802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-13c3ff0a-9f1b-41d0-80f0-d0e7f13d5588 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:50.383991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13c3ff0a-9f1b-41d0-80f0-d0e7f13d5588 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:50.384436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13c3ff0a-9f1b-41d0-80f0-d0e7f13d5588 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:50.385192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13c3ff0a-9f1b-41d0-80f0-d0e7f13d5588 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:50.385625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13c3ff0a-9f1b-41d0-80f0-d0e7f13d5588 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:50.414488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-13c3ff0a-9f1b-41d0-80f0-d0e7f13d5588 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041455 Jul 14 09:45:50.415090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 514/975] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:50.452367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d24d7e0f-080a-4fec-bf73-402b29106d7a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:50.453281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d24d7e0f-080a-4fec-bf73-402b29106d7a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:50.459708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d24d7e0f-080a-4fec-bf73-402b29106d7a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:50.460146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d24d7e0f-080a-4fec-bf73-402b29106d7a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:50.460897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d24d7e0f-080a-4fec-bf73-402b29106d7a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:50.461324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d24d7e0f-080a-4fec-bf73-402b29106d7a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:50.489962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d24d7e0f-080a-4fec-bf73-402b29106d7a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042093 Jul 14 09:45:50.490540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 462/976] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:51.123295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b5f47ffe-d320-4765-b68d-f1c0f8787173 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:51.123901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b5f47ffe-d320-4765-b68d-f1c0f8787173 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:51.129960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5f47ffe-d320-4765-b68d-f1c0f8787173 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:51.130438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5f47ffe-d320-4765-b68d-f1c0f8787173 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:51.131195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5f47ffe-d320-4765-b68d-f1c0f8787173 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:51.131629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5f47ffe-d320-4765-b68d-f1c0f8787173 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:51.263474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b5f47ffe-d320-4765-b68d-f1c0f8787173 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:51.270937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b5f47ffe-d320-4765-b68d-f1c0f8787173 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151969 Jul 14 09:45:51.271493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 515/977] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:51 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:51.426224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-85e5bcd9-7968-459e-b8ee-cfa921fdb530 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:51.427148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-85e5bcd9-7968-459e-b8ee-cfa921fdb530 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:51.433031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85e5bcd9-7968-459e-b8ee-cfa921fdb530 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:51.433472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85e5bcd9-7968-459e-b8ee-cfa921fdb530 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:51.434967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85e5bcd9-7968-459e-b8ee-cfa921fdb530 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:51.435392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85e5bcd9-7968-459e-b8ee-cfa921fdb530 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:51.463167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-85e5bcd9-7968-459e-b8ee-cfa921fdb530 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 Jul 14 09:45:51.463758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 463/978] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:51.502068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9389611c-85b5-4561-8dba-37ef91537a09 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:51.503007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9389611c-85b5-4561-8dba-37ef91537a09 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:51.509368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9389611c-85b5-4561-8dba-37ef91537a09 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:51.509811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9389611c-85b5-4561-8dba-37ef91537a09 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:51.510667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9389611c-85b5-4561-8dba-37ef91537a09 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:51.511096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9389611c-85b5-4561-8dba-37ef91537a09 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:51.539217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9389611c-85b5-4561-8dba-37ef91537a09 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041111 Jul 14 09:45:51.539756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 516/979] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:52.288848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0db9b1ec-57fa-4f20-af44-e4ee43adc182 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:52.289402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0db9b1ec-57fa-4f20-af44-e4ee43adc182 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:52.295645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0db9b1ec-57fa-4f20-af44-e4ee43adc182 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:52.296097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0db9b1ec-57fa-4f20-af44-e4ee43adc182 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:52.296862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0db9b1ec-57fa-4f20-af44-e4ee43adc182 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:52.297304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0db9b1ec-57fa-4f20-af44-e4ee43adc182 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:52.432136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0db9b1ec-57fa-4f20-af44-e4ee43adc182 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:52.440119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0db9b1ec-57fa-4f20-af44-e4ee43adc182 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.155292 Jul 14 09:45:52.440687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 464/980] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:52 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:52.474923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8a658dcb-99d5-4f80-97c3-d7e0f8836639 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:52.475873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8a658dcb-99d5-4f80-97c3-d7e0f8836639 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:52.481943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a658dcb-99d5-4f80-97c3-d7e0f8836639 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:52.482428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a658dcb-99d5-4f80-97c3-d7e0f8836639 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:52.483196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a658dcb-99d5-4f80-97c3-d7e0f8836639 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:52.483635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a658dcb-99d5-4f80-97c3-d7e0f8836639 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:52.514951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8a658dcb-99d5-4f80-97c3-d7e0f8836639 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Jul 14 09:45:52.515548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 517/981] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:52.550841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c4ccb980-d073-4c76-8482-fbce898f23e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:52.551696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c4ccb980-d073-4c76-8482-fbce898f23e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:52.558446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4ccb980-d073-4c76-8482-fbce898f23e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:52.558896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4ccb980-d073-4c76-8482-fbce898f23e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:52.560180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4ccb980-d073-4c76-8482-fbce898f23e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:52.560631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4ccb980-d073-4c76-8482-fbce898f23e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:52.590069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c4ccb980-d073-4c76-8482-fbce898f23e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043293 Jul 14 09:45:52.590662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 465/982] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:53.457198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-46c58f75-97d0-412b-abd7-b8e02d44e546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:53.457807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-46c58f75-97d0-412b-abd7-b8e02d44e546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:53.463976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46c58f75-97d0-412b-abd7-b8e02d44e546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:53.464414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46c58f75-97d0-412b-abd7-b8e02d44e546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:53.465159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46c58f75-97d0-412b-abd7-b8e02d44e546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:53.465586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46c58f75-97d0-412b-abd7-b8e02d44e546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:53.526638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0c205c34-224d-425c-825e-4afdc0615550 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:53.527661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0c205c34-224d-425c-825e-4afdc0615550 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:53.534387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c205c34-224d-425c-825e-4afdc0615550 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:53.534835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c205c34-224d-425c-825e-4afdc0615550 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:53.535603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c205c34-224d-425c-825e-4afdc0615550 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:53.536033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c205c34-224d-425c-825e-4afdc0615550 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:53.563232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:53.566378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0c205c34-224d-425c-825e-4afdc0615550 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Jul 14 09:45:53.566949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 466/983] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:53 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:45:53.594539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-46c58f75-97d0-412b-abd7-b8e02d44e546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:53.601228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6f8a9b66-f006-4606-9024-b3a49f2bbd78 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:53.602177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6f8a9b66-f006-4606-9024-b3a49f2bbd78 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:53.602330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-46c58f75-97d0-412b-abd7-b8e02d44e546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148820 Jul 14 09:45:53.602950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 518/984] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:53 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:53.608355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f8a9b66-f006-4606-9024-b3a49f2bbd78 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:53.608805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f8a9b66-f006-4606-9024-b3a49f2bbd78 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:53.609558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f8a9b66-f006-4606-9024-b3a49f2bbd78 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:53.609987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f8a9b66-f006-4606-9024-b3a49f2bbd78 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:53.637645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6f8a9b66-f006-4606-9024-b3a49f2bbd78 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040633 Jul 14 09:45:53.638737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 467/985] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:54.577179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-94d2ebf6-c4f4-4b85-af00-89cda6ec37f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:54.578100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-94d2ebf6-c4f4-4b85-af00-89cda6ec37f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:54.584773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-94d2ebf6-c4f4-4b85-af00-89cda6ec37f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:54.585252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-94d2ebf6-c4f4-4b85-af00-89cda6ec37f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:54.586013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-94d2ebf6-c4f4-4b85-af00-89cda6ec37f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:54.586491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-94d2ebf6-c4f4-4b85-af00-89cda6ec37f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:54.615352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-94d2ebf6-c4f4-4b85-af00-89cda6ec37f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042089 Jul 14 09:45:54.615964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 519/986] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:54.619385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e6a4ab50-a758-4b0d-96f5-1f7e9af47a98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:54.620035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e6a4ab50-a758-4b0d-96f5-1f7e9af47a98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:54.626604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6a4ab50-a758-4b0d-96f5-1f7e9af47a98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:54.627048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6a4ab50-a758-4b0d-96f5-1f7e9af47a98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:54.627807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6a4ab50-a758-4b0d-96f5-1f7e9af47a98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:54.628235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6a4ab50-a758-4b0d-96f5-1f7e9af47a98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:54.648874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0868af66-f8cd-4bee-b2cb-4c36b2bc7dab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:54.649812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0868af66-f8cd-4bee-b2cb-4c36b2bc7dab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:54.656322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0868af66-f8cd-4bee-b2cb-4c36b2bc7dab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:54.656774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0868af66-f8cd-4bee-b2cb-4c36b2bc7dab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:54.657547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0868af66-f8cd-4bee-b2cb-4c36b2bc7dab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:54.657990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0868af66-f8cd-4bee-b2cb-4c36b2bc7dab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:54.689212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0868af66-f8cd-4bee-b2cb-4c36b2bc7dab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044112 Jul 14 09:45:54.690026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 520/987] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:45:54.772140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e6a4ab50-a758-4b0d-96f5-1f7e9af47a98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:54.780339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e6a4ab50-a758-4b0d-96f5-1f7e9af47a98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.165084 Jul 14 09:45:54.780970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 468/988] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:54 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:45:55.627414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fcecf940-26c1-4655-9fd4-57c8235214f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:55.628350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fcecf940-26c1-4655-9fd4-57c8235214f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:55.634898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcecf940-26c1-4655-9fd4-57c8235214f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:55.635338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcecf940-26c1-4655-9fd4-57c8235214f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:55.636086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcecf940-26c1-4655-9fd4-57c8235214f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:55.636515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcecf940-26c1-4655-9fd4-57c8235214f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:55.665450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fcecf940-26c1-4655-9fd4-57c8235214f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041928 Jul 14 09:45:55.665988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 521/989] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:55.701118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f6f16f37-4b03-48a3-a97f-83ed487ba735 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:55.702027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f6f16f37-4b03-48a3-a97f-83ed487ba735 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:55.708496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6f16f37-4b03-48a3-a97f-83ed487ba735 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:55.708933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6f16f37-4b03-48a3-a97f-83ed487ba735 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:55.709680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6f16f37-4b03-48a3-a97f-83ed487ba735 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:55.710108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6f16f37-4b03-48a3-a97f-83ed487ba735 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:55.739965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f6f16f37-4b03-48a3-a97f-83ed487ba735 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042773 Jul 14 09:45:55.740515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 469/990] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:55.797193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-58b97e70-4d08-4ff6-83da-79eecc556131 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:55.797798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-58b97e70-4d08-4ff6-83da-79eecc556131 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:55.803801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-58b97e70-4d08-4ff6-83da-79eecc556131 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:55.804259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-58b97e70-4d08-4ff6-83da-79eecc556131 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:55.805018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-58b97e70-4d08-4ff6-83da-79eecc556131 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:55.805456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-58b97e70-4d08-4ff6-83da-79eecc556131 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:55.934781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-58b97e70-4d08-4ff6-83da-79eecc556131 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:55.943718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-58b97e70-4d08-4ff6-83da-79eecc556131 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150715 Jul 14 09:45:55.944306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 522/991] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:55 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:56.677707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4414ff49-5b68-438f-bc0d-ebf37e34a3d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:56.678694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4414ff49-5b68-438f-bc0d-ebf37e34a3d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:56.685289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4414ff49-5b68-438f-bc0d-ebf37e34a3d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:56.685726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4414ff49-5b68-438f-bc0d-ebf37e34a3d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:56.686534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4414ff49-5b68-438f-bc0d-ebf37e34a3d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:56.686983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4414ff49-5b68-438f-bc0d-ebf37e34a3d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:56.714828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4414ff49-5b68-438f-bc0d-ebf37e34a3d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041104 Jul 14 09:45:56.715447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 470/992] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:56.751191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c2ba70ed-4310-4aad-8a48-55b7235c4237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:56.752029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c2ba70ed-4310-4aad-8a48-55b7235c4237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:56.758478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2ba70ed-4310-4aad-8a48-55b7235c4237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:56.758917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2ba70ed-4310-4aad-8a48-55b7235c4237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:56.759666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2ba70ed-4310-4aad-8a48-55b7235c4237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:56.760098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2ba70ed-4310-4aad-8a48-55b7235c4237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:56.789043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c2ba70ed-4310-4aad-8a48-55b7235c4237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042430 Jul 14 09:45:56.789659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 523/993] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:56.960625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-351fcfce-898a-4b5f-bf5e-a20f1ba74b4a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:56.961254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-351fcfce-898a-4b5f-bf5e-a20f1ba74b4a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:56.967709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-351fcfce-898a-4b5f-bf5e-a20f1ba74b4a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:56.968142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-351fcfce-898a-4b5f-bf5e-a20f1ba74b4a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:56.968882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-351fcfce-898a-4b5f-bf5e-a20f1ba74b4a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:56.969305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-351fcfce-898a-4b5f-bf5e-a20f1ba74b4a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:57.099940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-351fcfce-898a-4b5f-bf5e-a20f1ba74b4a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:57.108193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-351fcfce-898a-4b5f-bf5e-a20f1ba74b4a tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151391 Jul 14 09:45:57.108753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 471/994] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:56 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:57.726574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c119d7ff-6780-49a2-aff5-0634074144e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:57.727491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c119d7ff-6780-49a2-aff5-0634074144e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:57.733520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c119d7ff-6780-49a2-aff5-0634074144e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:57.733973 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c119d7ff-6780-49a2-aff5-0634074144e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:57.734774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c119d7ff-6780-49a2-aff5-0634074144e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:57.735212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c119d7ff-6780-49a2-aff5-0634074144e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:57.764326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c119d7ff-6780-49a2-aff5-0634074144e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041769 Jul 14 09:45:57.764904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 524/995] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:57.800624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-88cfc46d-8461-4bee-872c-a93396e8df1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:57.801533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-88cfc46d-8461-4bee-872c-a93396e8df1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:57.808090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88cfc46d-8461-4bee-872c-a93396e8df1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:57.808530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88cfc46d-8461-4bee-872c-a93396e8df1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:57.809832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88cfc46d-8461-4bee-872c-a93396e8df1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:57.810227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88cfc46d-8461-4bee-872c-a93396e8df1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:57.838836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-88cfc46d-8461-4bee-872c-a93396e8df1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042209 Jul 14 09:45:57.839377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 472/996] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:58.125585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6451f9b3-608e-4c98-b441-edab658c268c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:58.132558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6451f9b3-608e-4c98-b441-edab658c268c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:58.133450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6451f9b3-608e-4c98-b441-edab658c268c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:58.133894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6451f9b3-608e-4c98-b441-edab658c268c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:58.134682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6451f9b3-608e-4c98-b441-edab658c268c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:58.135112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6451f9b3-608e-4c98-b441-edab658c268c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:58.266591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6451f9b3-608e-4c98-b441-edab658c268c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:58.273956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6451f9b3-608e-4c98-b441-edab658c268c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153026 Jul 14 09:45:58.274544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 525/997] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:58 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:58.776731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e6dff264-50a2-4feb-8806-52d004853a52 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:58.777571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e6dff264-50a2-4feb-8806-52d004853a52 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:58.784205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6dff264-50a2-4feb-8806-52d004853a52 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:58.784650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6dff264-50a2-4feb-8806-52d004853a52 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:58.785401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6dff264-50a2-4feb-8806-52d004853a52 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:58.785833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6dff264-50a2-4feb-8806-52d004853a52 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:58.813740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e6dff264-50a2-4feb-8806-52d004853a52 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 Jul 14 09:45:58.814364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 473/998] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:58.850437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f4308b61-7b2d-4c79-9e7e-892d13fe91d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:58.851354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f4308b61-7b2d-4c79-9e7e-892d13fe91d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:58.858002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4308b61-7b2d-4c79-9e7e-892d13fe91d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:58.858570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4308b61-7b2d-4c79-9e7e-892d13fe91d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:58.859330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4308b61-7b2d-4c79-9e7e-892d13fe91d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:58.859765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4308b61-7b2d-4c79-9e7e-892d13fe91d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:58.876068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:45:58.889380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f4308b61-7b2d-4c79-9e7e-892d13fe91d0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042999 Jul 14 09:45:58.889898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 526/999] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:45:59.291736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fcc2e681-155b-4668-837b-bcb78b4e9568 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:59.292378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fcc2e681-155b-4668-837b-bcb78b4e9568 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:59.299081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcc2e681-155b-4668-837b-bcb78b4e9568 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:59.299526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcc2e681-155b-4668-837b-bcb78b4e9568 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:59.300284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcc2e681-155b-4668-837b-bcb78b4e9568 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:59.300713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcc2e681-155b-4668-837b-bcb78b4e9568 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:59.431379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fcc2e681-155b-4668-837b-bcb78b4e9568 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:45:59.439121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fcc2e681-155b-4668-837b-bcb78b4e9568 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151220 Jul 14 09:45:59.439707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 474/1000] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:45:59 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:45:59.825392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c210975e-d18b-4bab-9336-c2c3e9057777 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:59.826253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c210975e-d18b-4bab-9336-c2c3e9057777 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:59.832338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c210975e-d18b-4bab-9336-c2c3e9057777 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:59.832785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c210975e-d18b-4bab-9336-c2c3e9057777 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:59.833541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c210975e-d18b-4bab-9336-c2c3e9057777 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:59.833972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c210975e-d18b-4bab-9336-c2c3e9057777 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:59.863529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c210975e-d18b-4bab-9336-c2c3e9057777 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042425 Jul 14 09:45:59.864158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 527/1001] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:45:59 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:45:59.900754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2879b4b1-f012-48cb-aeea-73595ecc179e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:45:59.901666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2879b4b1-f012-48cb-aeea-73595ecc179e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:45:59.908826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2879b4b1-f012-48cb-aeea-73595ecc179e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:59.909538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2879b4b1-f012-48cb-aeea-73595ecc179e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:59.910040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2879b4b1-f012-48cb-aeea-73595ecc179e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:45:59.910495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2879b4b1-f012-48cb-aeea-73595ecc179e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:45:59.940118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2879b4b1-f012-48cb-aeea-73595ecc179e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043210 Jul 14 09:45:59.940669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 475/1002] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:45:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:00.456913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-becf898f-322c-49bd-b516-25d0b104d1f0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:00.457530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-becf898f-322c-49bd-b516-25d0b104d1f0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:00.463667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-becf898f-322c-49bd-b516-25d0b104d1f0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:00.464115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-becf898f-322c-49bd-b516-25d0b104d1f0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:00.464879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-becf898f-322c-49bd-b516-25d0b104d1f0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:00.465323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-becf898f-322c-49bd-b516-25d0b104d1f0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:00.594545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-becf898f-322c-49bd-b516-25d0b104d1f0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:00.601911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-becf898f-322c-49bd-b516-25d0b104d1f0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148917 Jul 14 09:46:00.602484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 528/1003] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:00 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:00.875877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a2b2f4ba-8e43-4f2e-b3ce-43fe410de758 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:00.876697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a2b2f4ba-8e43-4f2e-b3ce-43fe410de758 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:00.882664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a2b2f4ba-8e43-4f2e-b3ce-43fe410de758 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:00.883110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a2b2f4ba-8e43-4f2e-b3ce-43fe410de758 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:00.883857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a2b2f4ba-8e43-4f2e-b3ce-43fe410de758 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:00.884286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a2b2f4ba-8e43-4f2e-b3ce-43fe410de758 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:00.912906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a2b2f4ba-8e43-4f2e-b3ce-43fe410de758 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041707 Jul 14 09:46:00.913532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 476/1004] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:00 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:00.952279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b9c9a665-cd9a-47b5-bcb5-46d5bcb51b4b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:00.953203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b9c9a665-cd9a-47b5-bcb5-46d5bcb51b4b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:00.959571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9c9a665-cd9a-47b5-bcb5-46d5bcb51b4b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:00.960008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9c9a665-cd9a-47b5-bcb5-46d5bcb51b4b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:00.960753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9c9a665-cd9a-47b5-bcb5-46d5bcb51b4b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:00.961182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9c9a665-cd9a-47b5-bcb5-46d5bcb51b4b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:00.989896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b9c9a665-cd9a-47b5-bcb5-46d5bcb51b4b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041589 Jul 14 09:46:00.990488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 529/1005] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:01.618946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-86f7a521-d6ae-4b3c-ba82-de3f6fc4aa79 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:01.619555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-86f7a521-d6ae-4b3c-ba82-de3f6fc4aa79 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:01.626306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-86f7a521-d6ae-4b3c-ba82-de3f6fc4aa79 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:01.626754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-86f7a521-d6ae-4b3c-ba82-de3f6fc4aa79 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:01.627511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-86f7a521-d6ae-4b3c-ba82-de3f6fc4aa79 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:01.627949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-86f7a521-d6ae-4b3c-ba82-de3f6fc4aa79 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:01.755231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-86f7a521-d6ae-4b3c-ba82-de3f6fc4aa79 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:01.763319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-86f7a521-d6ae-4b3c-ba82-de3f6fc4aa79 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148439 Jul 14 09:46:01.763880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 477/1006] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:01 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:01.924508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8968973e-d4cf-4474-a509-63a8789d0d1a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:01.925350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8968973e-d4cf-4474-a509-63a8789d0d1a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:01.931460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8968973e-d4cf-4474-a509-63a8789d0d1a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:01.931905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8968973e-d4cf-4474-a509-63a8789d0d1a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:01.932663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8968973e-d4cf-4474-a509-63a8789d0d1a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:01.933098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8968973e-d4cf-4474-a509-63a8789d0d1a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:01.961465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8968973e-d4cf-4474-a509-63a8789d0d1a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040985 Jul 14 09:46:01.962045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 530/1007] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:02.000914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e63759f1-3ecf-40f9-b37c-f142b1138500 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:02.001830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e63759f1-3ecf-40f9-b37c-f142b1138500 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:02.007893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e63759f1-3ecf-40f9-b37c-f142b1138500 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:02.008336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e63759f1-3ecf-40f9-b37c-f142b1138500 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:02.009086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e63759f1-3ecf-40f9-b37c-f142b1138500 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:02.009518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e63759f1-3ecf-40f9-b37c-f142b1138500 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:02.038787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e63759f1-3ecf-40f9-b37c-f142b1138500 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041841 Jul 14 09:46:02.039319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 478/1008] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:02.780753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2d66f1b5-da09-407f-81d5-d612f69de7e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:02.781400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2d66f1b5-da09-407f-81d5-d612f69de7e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:02.787483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d66f1b5-da09-407f-81d5-d612f69de7e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:02.787942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d66f1b5-da09-407f-81d5-d612f69de7e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:02.788712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d66f1b5-da09-407f-81d5-d612f69de7e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:02.789152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d66f1b5-da09-407f-81d5-d612f69de7e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:02.919235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2d66f1b5-da09-407f-81d5-d612f69de7e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:02.926714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2d66f1b5-da09-407f-81d5-d612f69de7e5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150364 Jul 14 09:46:02.927280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 531/1009] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:02 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:02.972846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d128ff03-2446-47af-85be-7ceb0ac95f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:02.973761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d128ff03-2446-47af-85be-7ceb0ac95f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:02.980242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d128ff03-2446-47af-85be-7ceb0ac95f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:02.980679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d128ff03-2446-47af-85be-7ceb0ac95f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:02.982089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d128ff03-2446-47af-85be-7ceb0ac95f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:02.982544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d128ff03-2446-47af-85be-7ceb0ac95f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:03.010618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d128ff03-2446-47af-85be-7ceb0ac95f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Jul 14 09:46:03.011259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 479/1010] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:02 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:03.050867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-27549dad-dc0c-49fb-bb7f-e85162cd66d2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:03.051703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-27549dad-dc0c-49fb-bb7f-e85162cd66d2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:03.058071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27549dad-dc0c-49fb-bb7f-e85162cd66d2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:03.058541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27549dad-dc0c-49fb-bb7f-e85162cd66d2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:03.059286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27549dad-dc0c-49fb-bb7f-e85162cd66d2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:03.059711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27549dad-dc0c-49fb-bb7f-e85162cd66d2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:03.087741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-27549dad-dc0c-49fb-bb7f-e85162cd66d2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040920 Jul 14 09:46:03.088284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 532/1011] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:03.944190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d1dc20c2-139b-4a2d-93bf-fdefaa5d210f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:03.944800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d1dc20c2-139b-4a2d-93bf-fdefaa5d210f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:03.951712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1dc20c2-139b-4a2d-93bf-fdefaa5d210f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:03.952176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1dc20c2-139b-4a2d-93bf-fdefaa5d210f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:03.952909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1dc20c2-139b-4a2d-93bf-fdefaa5d210f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:03.953341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1dc20c2-139b-4a2d-93bf-fdefaa5d210f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:04.022001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-81e7ee21-4dac-4559-847f-9c153b087ced tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:04.023139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-81e7ee21-4dac-4559-847f-9c153b087ced tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:04.030324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81e7ee21-4dac-4559-847f-9c153b087ced tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:04.030769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81e7ee21-4dac-4559-847f-9c153b087ced tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:04.031856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81e7ee21-4dac-4559-847f-9c153b087ced tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:04.031959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81e7ee21-4dac-4559-847f-9c153b087ced tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:04.061113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-81e7ee21-4dac-4559-847f-9c153b087ced tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Jul 14 09:46:04.061766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 533/1012] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:04.088310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d1dc20c2-139b-4a2d-93bf-fdefaa5d210f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:04.097320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d1dc20c2-139b-4a2d-93bf-fdefaa5d210f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.157021 Jul 14 09:46:04.097888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 480/1013] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:03 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:04.099031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-69c9c18c-46c0-420b-af4a-6c538082b207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:04.099978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-69c9c18c-46c0-420b-af4a-6c538082b207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:04.106146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-69c9c18c-46c0-420b-af4a-6c538082b207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:04.106762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-69c9c18c-46c0-420b-af4a-6c538082b207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:04.107530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-69c9c18c-46c0-420b-af4a-6c538082b207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:04.107976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-69c9c18c-46c0-420b-af4a-6c538082b207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:04.135943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-69c9c18c-46c0-420b-af4a-6c538082b207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040858 Jul 14 09:46:04.136486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 534/1014] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:05.073229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-438352e1-4488-44bc-9f88-7ac854851adf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:05.074169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-438352e1-4488-44bc-9f88-7ac854851adf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:05.080825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-438352e1-4488-44bc-9f88-7ac854851adf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:05.081268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-438352e1-4488-44bc-9f88-7ac854851adf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:05.082027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-438352e1-4488-44bc-9f88-7ac854851adf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:05.082497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-438352e1-4488-44bc-9f88-7ac854851adf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:05.111938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-438352e1-4488-44bc-9f88-7ac854851adf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 Jul 14 09:46:05.112572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 481/1015] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:05.114235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-34996c8a-8f80-4b86-af1c-e99729c115b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:05.114842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-34996c8a-8f80-4b86-af1c-e99729c115b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:05.121332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34996c8a-8f80-4b86-af1c-e99729c115b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:05.121767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34996c8a-8f80-4b86-af1c-e99729c115b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:05.122631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34996c8a-8f80-4b86-af1c-e99729c115b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:05.123061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34996c8a-8f80-4b86-af1c-e99729c115b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:05.147912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-987c4849-4f39-4a63-83b2-9f352a34847e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:05.148821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-987c4849-4f39-4a63-83b2-9f352a34847e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:05.155404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-987c4849-4f39-4a63-83b2-9f352a34847e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:05.155848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-987c4849-4f39-4a63-83b2-9f352a34847e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:05.156610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-987c4849-4f39-4a63-83b2-9f352a34847e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:05.157038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-987c4849-4f39-4a63-83b2-9f352a34847e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:05.186571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-987c4849-4f39-4a63-83b2-9f352a34847e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042446 Jul 14 09:46:05.187254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 482/1016] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:05.256404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-34996c8a-8f80-4b86-af1c-e99729c115b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:05.264073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-34996c8a-8f80-4b86-af1c-e99729c115b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153578 Jul 14 09:46:05.264676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 535/1017] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:05 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:06.123663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e6fe7b2b-8625-4640-9920-3a34ffb5df19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:06.124589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e6fe7b2b-8625-4640-9920-3a34ffb5df19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:06.130982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6fe7b2b-8625-4640-9920-3a34ffb5df19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:06.131422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6fe7b2b-8625-4640-9920-3a34ffb5df19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:06.132167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6fe7b2b-8625-4640-9920-3a34ffb5df19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:06.132589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6fe7b2b-8625-4640-9920-3a34ffb5df19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:06.149237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:06.161457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e6fe7b2b-8625-4640-9920-3a34ffb5df19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042281 Jul 14 09:46:06.162000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 483/1018] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:06 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:06.197983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d6c3f81b-1e34-438b-97b1-44986802d96e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:06.198934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d6c3f81b-1e34-438b-97b1-44986802d96e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:06.205380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6c3f81b-1e34-438b-97b1-44986802d96e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:06.206008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6c3f81b-1e34-438b-97b1-44986802d96e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:06.206811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6c3f81b-1e34-438b-97b1-44986802d96e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:06.207248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6c3f81b-1e34-438b-97b1-44986802d96e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:06.236421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d6c3f81b-1e34-438b-97b1-44986802d96e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042600 Jul 14 09:46:06.236967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 536/1019] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:06.280421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0e9d23d0-9925-4cbc-8b08-2ae352d5d14b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:06.280939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0e9d23d0-9925-4cbc-8b08-2ae352d5d14b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:06.286986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0e9d23d0-9925-4cbc-8b08-2ae352d5d14b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:06.287426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0e9d23d0-9925-4cbc-8b08-2ae352d5d14b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:06.288170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0e9d23d0-9925-4cbc-8b08-2ae352d5d14b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:06.288602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0e9d23d0-9925-4cbc-8b08-2ae352d5d14b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:06.425887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0e9d23d0-9925-4cbc-8b08-2ae352d5d14b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:06.433250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0e9d23d0-9925-4cbc-8b08-2ae352d5d14b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.156765 Jul 14 09:46:06.433842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 484/1020] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:06 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:07.173057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-845fcff6-aed2-46de-b3cb-bfe59a144e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:07.173980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-845fcff6-aed2-46de-b3cb-bfe59a144e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:07.180036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-845fcff6-aed2-46de-b3cb-bfe59a144e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:07.180485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-845fcff6-aed2-46de-b3cb-bfe59a144e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:07.181244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-845fcff6-aed2-46de-b3cb-bfe59a144e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:07.181684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-845fcff6-aed2-46de-b3cb-bfe59a144e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:07.210395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-845fcff6-aed2-46de-b3cb-bfe59a144e26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041268 Jul 14 09:46:07.210991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 537/1021] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:07.247832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b250c674-909b-4100-bf3d-3cf6a10a71a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:07.248741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b250c674-909b-4100-bf3d-3cf6a10a71a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:07.255188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b250c674-909b-4100-bf3d-3cf6a10a71a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:07.255630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b250c674-909b-4100-bf3d-3cf6a10a71a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:07.256379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b250c674-909b-4100-bf3d-3cf6a10a71a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:07.256805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b250c674-909b-4100-bf3d-3cf6a10a71a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:07.286143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b250c674-909b-4100-bf3d-3cf6a10a71a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042346 Jul 14 09:46:07.286705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 485/1022] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:07.451251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f9d0c7a5-43e7-4b0b-bb42-4fb27b550591 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:07.451853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f9d0c7a5-43e7-4b0b-bb42-4fb27b550591 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:07.458611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9d0c7a5-43e7-4b0b-bb42-4fb27b550591 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:07.459058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9d0c7a5-43e7-4b0b-bb42-4fb27b550591 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:07.459821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9d0c7a5-43e7-4b0b-bb42-4fb27b550591 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:07.460263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9d0c7a5-43e7-4b0b-bb42-4fb27b550591 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:07.592821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f9d0c7a5-43e7-4b0b-bb42-4fb27b550591 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:07.600406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f9d0c7a5-43e7-4b0b-bb42-4fb27b550591 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152948 Jul 14 09:46:07.600993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 538/1023] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:07 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:08.221963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-18e51f29-3192-4537-82b6-3410c99a4a0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:08.222936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-18e51f29-3192-4537-82b6-3410c99a4a0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:08.229035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18e51f29-3192-4537-82b6-3410c99a4a0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:08.229478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18e51f29-3192-4537-82b6-3410c99a4a0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:08.230256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18e51f29-3192-4537-82b6-3410c99a4a0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:08.230687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18e51f29-3192-4537-82b6-3410c99a4a0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:08.259054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-18e51f29-3192-4537-82b6-3410c99a4a0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Jul 14 09:46:08.260010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 486/1024] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:08.297034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-803eaffc-86bd-48e2-99cd-60732a2a25e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:08.297964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-803eaffc-86bd-48e2-99cd-60732a2a25e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:08.304497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-803eaffc-86bd-48e2-99cd-60732a2a25e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:08.304940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-803eaffc-86bd-48e2-99cd-60732a2a25e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:08.305689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-803eaffc-86bd-48e2-99cd-60732a2a25e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:08.306116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-803eaffc-86bd-48e2-99cd-60732a2a25e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:08.336307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-803eaffc-86bd-48e2-99cd-60732a2a25e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043297 Jul 14 09:46:08.336854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 539/1025] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:08.617334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6b249d78-5429-48a7-9d6d-228f422dea74 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:08.617965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6b249d78-5429-48a7-9d6d-228f422dea74 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:08.624208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b249d78-5429-48a7-9d6d-228f422dea74 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:08.624655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b249d78-5429-48a7-9d6d-228f422dea74 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:08.625445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b249d78-5429-48a7-9d6d-228f422dea74 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:08.625874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b249d78-5429-48a7-9d6d-228f422dea74 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:08.759616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b249d78-5429-48a7-9d6d-228f422dea74 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:08.767621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6b249d78-5429-48a7-9d6d-228f422dea74 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154122 Jul 14 09:46:08.768546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 487/1026] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:08 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:09.271415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-060678e1-eb72-48bd-bf0a-006f0b4d7957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:09.272350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-060678e1-eb72-48bd-bf0a-006f0b4d7957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:09.279095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-060678e1-eb72-48bd-bf0a-006f0b4d7957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:09.279537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-060678e1-eb72-48bd-bf0a-006f0b4d7957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:09.280309 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-060678e1-eb72-48bd-bf0a-006f0b4d7957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:09.280741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-060678e1-eb72-48bd-bf0a-006f0b4d7957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:09.310751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-060678e1-eb72-48bd-bf0a-006f0b4d7957 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043210 Jul 14 09:46:09.311398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 540/1027] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:09.348047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3c4f0370-41eb-4538-9fc7-25d7a4670b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:09.348971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3c4f0370-41eb-4538-9fc7-25d7a4670b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:09.356147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c4f0370-41eb-4538-9fc7-25d7a4670b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:09.356594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c4f0370-41eb-4538-9fc7-25d7a4670b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:09.357351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c4f0370-41eb-4538-9fc7-25d7a4670b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:09.357783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c4f0370-41eb-4538-9fc7-25d7a4670b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:09.386920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3c4f0370-41eb-4538-9fc7-25d7a4670b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042885 Jul 14 09:46:09.387481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 488/1028] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:09 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:09.784462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1ebaaec0-6f4c-4e84-9173-6620edb2f477 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:09.785094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1ebaaec0-6f4c-4e84-9173-6620edb2f477 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:09.791102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ebaaec0-6f4c-4e84-9173-6620edb2f477 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:09.791552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ebaaec0-6f4c-4e84-9173-6620edb2f477 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:09.792310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ebaaec0-6f4c-4e84-9173-6620edb2f477 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:09.792773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ebaaec0-6f4c-4e84-9173-6620edb2f477 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:09.923256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1ebaaec0-6f4c-4e84-9173-6620edb2f477 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:09.930764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1ebaaec0-6f4c-4e84-9173-6620edb2f477 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150203 Jul 14 09:46:09.931318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 541/1029] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:09 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:10.322762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1c158320-67ed-4337-895f-3c2a5cb81d5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:10.323700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1c158320-67ed-4337-895f-3c2a5cb81d5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:10.330341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c158320-67ed-4337-895f-3c2a5cb81d5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:10.330781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c158320-67ed-4337-895f-3c2a5cb81d5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:10.331524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c158320-67ed-4337-895f-3c2a5cb81d5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:10.331950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c158320-67ed-4337-895f-3c2a5cb81d5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:10.360104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1c158320-67ed-4337-895f-3c2a5cb81d5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041635 Jul 14 09:46:10.360745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 489/1030] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:10.397782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b30d368b-485c-44ad-b968-4a27b202070d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:10.398747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b30d368b-485c-44ad-b968-4a27b202070d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:10.404893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b30d368b-485c-44ad-b968-4a27b202070d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:10.405337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b30d368b-485c-44ad-b968-4a27b202070d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:10.406092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b30d368b-485c-44ad-b968-4a27b202070d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:10.406559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b30d368b-485c-44ad-b968-4a27b202070d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:10.434780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b30d368b-485c-44ad-b968-4a27b202070d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040998 Jul 14 09:46:10.435318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 542/1031] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:10.948660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0af3c9e6-c5f3-45b9-9488-f53ecfe97d97 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:10.949441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0af3c9e6-c5f3-45b9-9488-f53ecfe97d97 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:10.955411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0af3c9e6-c5f3-45b9-9488-f53ecfe97d97 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:10.955846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0af3c9e6-c5f3-45b9-9488-f53ecfe97d97 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:10.956589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0af3c9e6-c5f3-45b9-9488-f53ecfe97d97 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:10.957012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0af3c9e6-c5f3-45b9-9488-f53ecfe97d97 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:11.089402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0af3c9e6-c5f3-45b9-9488-f53ecfe97d97 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:11.096897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0af3c9e6-c5f3-45b9-9488-f53ecfe97d97 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152475 Jul 14 09:46:11.097458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 490/1032] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:10 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:11.371403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a0c977d6-e83a-4f76-ae1e-6c7cecff037c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:11.372243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a0c977d6-e83a-4f76-ae1e-6c7cecff037c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:11.378180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0c977d6-e83a-4f76-ae1e-6c7cecff037c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:11.378662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0c977d6-e83a-4f76-ae1e-6c7cecff037c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:11.379416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0c977d6-e83a-4f76-ae1e-6c7cecff037c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:11.379851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0c977d6-e83a-4f76-ae1e-6c7cecff037c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:11.383906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:11.410014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a0c977d6-e83a-4f76-ae1e-6c7cecff037c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Jul 14 09:46:11.410681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 543/1033] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:11 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:11.446690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0b711dae-d204-49cc-af81-8415d488434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:11.447601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0b711dae-d204-49cc-af81-8415d488434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:11.457261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0b711dae-d204-49cc-af81-8415d488434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:11.457698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0b711dae-d204-49cc-af81-8415d488434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:11.458491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0b711dae-d204-49cc-af81-8415d488434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:11.458935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0b711dae-d204-49cc-af81-8415d488434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:11.488831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0b711dae-d204-49cc-af81-8415d488434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046431 Jul 14 09:46:11.489377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 491/1034] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:12.114051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-02f72e06-1615-4b41-82bf-c783100d2457 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:12.114691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-02f72e06-1615-4b41-82bf-c783100d2457 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:12.120733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02f72e06-1615-4b41-82bf-c783100d2457 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:12.121178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02f72e06-1615-4b41-82bf-c783100d2457 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:12.121933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02f72e06-1615-4b41-82bf-c783100d2457 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:12.122400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02f72e06-1615-4b41-82bf-c783100d2457 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:12.250135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-02f72e06-1615-4b41-82bf-c783100d2457 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:12.257466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-02f72e06-1615-4b41-82bf-c783100d2457 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147301 Jul 14 09:46:12.258020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 544/1035] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:12 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:12.421193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1d732356-26a5-4b39-9298-885fd2ff3c89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:12.422058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1d732356-26a5-4b39-9298-885fd2ff3c89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:12.423990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:12.430039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d732356-26a5-4b39-9298-885fd2ff3c89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:12.430540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d732356-26a5-4b39-9298-885fd2ff3c89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:12.431317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d732356-26a5-4b39-9298-885fd2ff3c89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:12.431751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d732356-26a5-4b39-9298-885fd2ff3c89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:12.461226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1d732356-26a5-4b39-9298-885fd2ff3c89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Jul 14 09:46:12.461843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 492/1036] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:12.500430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ecf83181-d6e3-4aa3-8072-b96cc7cc3016 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:12.501349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ecf83181-d6e3-4aa3-8072-b96cc7cc3016 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:12.507745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecf83181-d6e3-4aa3-8072-b96cc7cc3016 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:12.508195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecf83181-d6e3-4aa3-8072-b96cc7cc3016 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:12.508954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecf83181-d6e3-4aa3-8072-b96cc7cc3016 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:12.509392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecf83181-d6e3-4aa3-8072-b96cc7cc3016 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:12.538670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ecf83181-d6e3-4aa3-8072-b96cc7cc3016 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042189 Jul 14 09:46:12.539217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 545/1037] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:13.274892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6582e3d7-8f56-4aba-a1b1-810a80f84eef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:13.275492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6582e3d7-8f56-4aba-a1b1-810a80f84eef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:13.282453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6582e3d7-8f56-4aba-a1b1-810a80f84eef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:13.283061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6582e3d7-8f56-4aba-a1b1-810a80f84eef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:13.283901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6582e3d7-8f56-4aba-a1b1-810a80f84eef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:13.284354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6582e3d7-8f56-4aba-a1b1-810a80f84eef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:13.415731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6582e3d7-8f56-4aba-a1b1-810a80f84eef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:13.423510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6582e3d7-8f56-4aba-a1b1-810a80f84eef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152430 Jul 14 09:46:13.424079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 493/1038] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:13 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:13.473380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8db74516-7224-48bb-b6dc-0d3ec3847268 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:13.474319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8db74516-7224-48bb-b6dc-0d3ec3847268 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:13.480424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8db74516-7224-48bb-b6dc-0d3ec3847268 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:13.480874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8db74516-7224-48bb-b6dc-0d3ec3847268 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:13.481636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8db74516-7224-48bb-b6dc-0d3ec3847268 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:13.482075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8db74516-7224-48bb-b6dc-0d3ec3847268 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:13.510400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8db74516-7224-48bb-b6dc-0d3ec3847268 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040950 Jul 14 09:46:13.511015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 546/1039] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:13 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:13.550358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0365f621-035c-4d6b-8bd7-fb32b298eee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:13.551210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0365f621-035c-4d6b-8bd7-fb32b298eee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:13.557620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0365f621-035c-4d6b-8bd7-fb32b298eee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:13.558066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0365f621-035c-4d6b-8bd7-fb32b298eee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:13.559396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0365f621-035c-4d6b-8bd7-fb32b298eee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:13.560229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0365f621-035c-4d6b-8bd7-fb32b298eee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:13.589040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0365f621-035c-4d6b-8bd7-fb32b298eee7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042763 Jul 14 09:46:13.589594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 494/1040] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:14.440477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1a7e68cb-5a73-457b-a0c1-367809355cb4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:14.441085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1a7e68cb-5a73-457b-a0c1-367809355cb4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:14.447335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a7e68cb-5a73-457b-a0c1-367809355cb4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:14.447776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a7e68cb-5a73-457b-a0c1-367809355cb4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:14.448523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a7e68cb-5a73-457b-a0c1-367809355cb4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:14.451449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a7e68cb-5a73-457b-a0c1-367809355cb4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:14.522548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-29e396b2-7071-4ad3-b772-7d0e67925173 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:14.523468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-29e396b2-7071-4ad3-b772-7d0e67925173 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:14.529626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29e396b2-7071-4ad3-b772-7d0e67925173 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:14.530077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29e396b2-7071-4ad3-b772-7d0e67925173 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:14.530884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29e396b2-7071-4ad3-b772-7d0e67925173 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:14.531314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29e396b2-7071-4ad3-b772-7d0e67925173 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:14.561861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-29e396b2-7071-4ad3-b772-7d0e67925173 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043271 Jul 14 09:46:14.562817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 495/1041] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:14.583326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1a7e68cb-5a73-457b-a0c1-367809355cb4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:14.590914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1a7e68cb-5a73-457b-a0c1-367809355cb4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154268 Jul 14 09:46:14.591472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 547/1042] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:14 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:14.599578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d0d68c56-364b-4552-93da-dca889de6da3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:14.600581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d0d68c56-364b-4552-93da-dca889de6da3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:14.607166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d0d68c56-364b-4552-93da-dca889de6da3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:14.607619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d0d68c56-364b-4552-93da-dca889de6da3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:14.608377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d0d68c56-364b-4552-93da-dca889de6da3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:14.608812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d0d68c56-364b-4552-93da-dca889de6da3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:14.637392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d0d68c56-364b-4552-93da-dca889de6da3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041768 Jul 14 09:46:14.637937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 496/1043] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:15.573219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-91b57d51-9b75-4131-a25d-afb402bdf553 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:15.574776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-91b57d51-9b75-4131-a25d-afb402bdf553 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:15.577187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=92 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:15.582462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91b57d51-9b75-4131-a25d-afb402bdf553 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:15.582905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91b57d51-9b75-4131-a25d-afb402bdf553 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:15.583649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91b57d51-9b75-4131-a25d-afb402bdf553 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:15.584177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91b57d51-9b75-4131-a25d-afb402bdf553 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:15.606963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dedcd2b7-e322-4a69-b025-d35721fc83a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:15.607599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dedcd2b7-e322-4a69-b025-d35721fc83a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:15.612040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-91b57d51-9b75-4131-a25d-afb402bdf553 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043012 Jul 14 09:46:15.612801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 548/1044] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:15.614163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dedcd2b7-e322-4a69-b025-d35721fc83a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:15.614638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dedcd2b7-e322-4a69-b025-d35721fc83a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:15.615399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dedcd2b7-e322-4a69-b025-d35721fc83a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:15.615828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dedcd2b7-e322-4a69-b025-d35721fc83a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:15.649074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-54a039a3-ae3a-4f09-9644-c32adb492207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:15.649977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-54a039a3-ae3a-4f09-9644-c32adb492207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:15.656077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-54a039a3-ae3a-4f09-9644-c32adb492207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:15.656522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-54a039a3-ae3a-4f09-9644-c32adb492207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:15.657274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-54a039a3-ae3a-4f09-9644-c32adb492207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:15.657707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-54a039a3-ae3a-4f09-9644-c32adb492207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:15.686904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-54a039a3-ae3a-4f09-9644-c32adb492207 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041623 Jul 14 09:46:15.687458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 549/1045] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:15.744248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dedcd2b7-e322-4a69-b025-d35721fc83a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:15.753049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dedcd2b7-e322-4a69-b025-d35721fc83a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149862 Jul 14 09:46:15.753611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 497/1046] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:15 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:16.623824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cc3d8377-2557-449d-a89a-1c3ea253af65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:16.624740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cc3d8377-2557-449d-a89a-1c3ea253af65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:16.631242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc3d8377-2557-449d-a89a-1c3ea253af65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:16.631695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc3d8377-2557-449d-a89a-1c3ea253af65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:16.632451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc3d8377-2557-449d-a89a-1c3ea253af65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:16.632886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc3d8377-2557-449d-a89a-1c3ea253af65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:16.660962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cc3d8377-2557-449d-a89a-1c3ea253af65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041585 Jul 14 09:46:16.661544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 550/1047] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:16 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:16.698661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-26312bc5-b1b4-4055-8740-f0f6428b4702 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:16.699590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-26312bc5-b1b4-4055-8740-f0f6428b4702 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:16.705964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26312bc5-b1b4-4055-8740-f0f6428b4702 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:16.706433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26312bc5-b1b4-4055-8740-f0f6428b4702 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:16.707173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26312bc5-b1b4-4055-8740-f0f6428b4702 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:16.707597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26312bc5-b1b4-4055-8740-f0f6428b4702 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:16.735673 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-26312bc5-b1b4-4055-8740-f0f6428b4702 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041259 Jul 14 09:46:16.736212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 498/1048] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:16.771024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-542e787f-af24-4e31-bbc1-09371dadaf66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:16.771551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-542e787f-af24-4e31-bbc1-09371dadaf66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:16.777807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-542e787f-af24-4e31-bbc1-09371dadaf66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:16.778270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-542e787f-af24-4e31-bbc1-09371dadaf66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:16.779022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-542e787f-af24-4e31-bbc1-09371dadaf66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:16.779447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-542e787f-af24-4e31-bbc1-09371dadaf66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:16.908841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-542e787f-af24-4e31-bbc1-09371dadaf66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:16.916295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-542e787f-af24-4e31-bbc1-09371dadaf66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149146 Jul 14 09:46:16.916849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 551/1049] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:16 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:17.672474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9ca5f904-6f30-484b-81ba-5bc8bc5b49f0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:17.673381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9ca5f904-6f30-484b-81ba-5bc8bc5b49f0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:17.679446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ca5f904-6f30-484b-81ba-5bc8bc5b49f0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:17.679881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ca5f904-6f30-484b-81ba-5bc8bc5b49f0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:17.680626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ca5f904-6f30-484b-81ba-5bc8bc5b49f0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:17.681048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ca5f904-6f30-484b-81ba-5bc8bc5b49f0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:17.709285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9ca5f904-6f30-484b-81ba-5bc8bc5b49f0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040771 Jul 14 09:46:17.709918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 499/1050] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:17.747620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e0a1e373-b671-49f0-b15b-c2dd236cd428 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:17.748524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e0a1e373-b671-49f0-b15b-c2dd236cd428 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:17.754931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e0a1e373-b671-49f0-b15b-c2dd236cd428 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:17.755369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e0a1e373-b671-49f0-b15b-c2dd236cd428 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:17.756122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e0a1e373-b671-49f0-b15b-c2dd236cd428 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:17.756546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e0a1e373-b671-49f0-b15b-c2dd236cd428 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:17.785898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e0a1e373-b671-49f0-b15b-c2dd236cd428 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042237 Jul 14 09:46:17.786460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 552/1051] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:17.934266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e46d8b24-6bdb-49ef-90f6-8d3ae5984edb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:17.934865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e46d8b24-6bdb-49ef-90f6-8d3ae5984edb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:17.940875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e46d8b24-6bdb-49ef-90f6-8d3ae5984edb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:17.941310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e46d8b24-6bdb-49ef-90f6-8d3ae5984edb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:17.942052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e46d8b24-6bdb-49ef-90f6-8d3ae5984edb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:17.942503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e46d8b24-6bdb-49ef-90f6-8d3ae5984edb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:17.946580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:18.071949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e46d8b24-6bdb-49ef-90f6-8d3ae5984edb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:18.089348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e46d8b24-6bdb-49ef-90f6-8d3ae5984edb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.159044 Jul 14 09:46:18.090248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 500/1052] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:17 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:18.721087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-53e72f24-0085-48ac-8a71-ebe23323c95f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:18.721998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-53e72f24-0085-48ac-8a71-ebe23323c95f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:18.727977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-53e72f24-0085-48ac-8a71-ebe23323c95f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:18.728430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-53e72f24-0085-48ac-8a71-ebe23323c95f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:18.729185 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-53e72f24-0085-48ac-8a71-ebe23323c95f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:18.729622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-53e72f24-0085-48ac-8a71-ebe23323c95f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:18.762410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-53e72f24-0085-48ac-8a71-ebe23323c95f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Jul 14 09:46:18.763042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 553/1053] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:18 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:18.798679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-85f270fb-b021-4e54-9c75-950b7cc93dbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:18.799644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-85f270fb-b021-4e54-9c75-950b7cc93dbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:18.805801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85f270fb-b021-4e54-9c75-950b7cc93dbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:18.806274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85f270fb-b021-4e54-9c75-950b7cc93dbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:18.807045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85f270fb-b021-4e54-9c75-950b7cc93dbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:18.807478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85f270fb-b021-4e54-9c75-950b7cc93dbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:18.837259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-85f270fb-b021-4e54-9c75-950b7cc93dbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043751 Jul 14 09:46:18.837816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 501/1054] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:19.108667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f8c20582-47a6-4904-887d-46744c323512 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:19.109191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f8c20582-47a6-4904-887d-46744c323512 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:19.115272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8c20582-47a6-4904-887d-46744c323512 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:19.115722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8c20582-47a6-4904-887d-46744c323512 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:19.116486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8c20582-47a6-4904-887d-46744c323512 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:19.116919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8c20582-47a6-4904-887d-46744c323512 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:19.246969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f8c20582-47a6-4904-887d-46744c323512 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:19.254489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f8c20582-47a6-4904-887d-46744c323512 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150295 Jul 14 09:46:19.255059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 554/1055] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:19 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:19.772913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-67fa125a-1f06-4faa-acb7-e009539d7012 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:19.773928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-67fa125a-1f06-4faa-acb7-e009539d7012 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:19.780494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67fa125a-1f06-4faa-acb7-e009539d7012 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:19.780936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67fa125a-1f06-4faa-acb7-e009539d7012 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:19.781680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67fa125a-1f06-4faa-acb7-e009539d7012 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:19.782105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67fa125a-1f06-4faa-acb7-e009539d7012 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:19.809979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-67fa125a-1f06-4faa-acb7-e009539d7012 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040932 Jul 14 09:46:19.810621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 502/1056] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:19 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:19.848861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5c30461b-5af2-4158-960f-d1bffb938c1e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:19.849780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5c30461b-5af2-4158-960f-d1bffb938c1e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:19.856397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c30461b-5af2-4158-960f-d1bffb938c1e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:19.856901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c30461b-5af2-4158-960f-d1bffb938c1e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:19.857661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c30461b-5af2-4158-960f-d1bffb938c1e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:19.858094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c30461b-5af2-4158-960f-d1bffb938c1e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:19.887048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5c30461b-5af2-4158-960f-d1bffb938c1e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041580 Jul 14 09:46:19.887591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 555/1057] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:20.273970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5429966c-1f2f-4338-9b4e-72ad957bc388 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:20.275134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5429966c-1f2f-4338-9b4e-72ad957bc388 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:20.284123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5429966c-1f2f-4338-9b4e-72ad957bc388 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:20.284563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5429966c-1f2f-4338-9b4e-72ad957bc388 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:20.285310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5429966c-1f2f-4338-9b4e-72ad957bc388 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:20.285740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5429966c-1f2f-4338-9b4e-72ad957bc388 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:20.414071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5429966c-1f2f-4338-9b4e-72ad957bc388 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:20.422033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5429966c-1f2f-4338-9b4e-72ad957bc388 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154545 Jul 14 09:46:20.422616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 503/1058] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:20 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:20.821229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f80dc6fd-bf82-4bd7-9fac-78057d4661a4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:20.822070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f80dc6fd-bf82-4bd7-9fac-78057d4661a4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:20.828107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f80dc6fd-bf82-4bd7-9fac-78057d4661a4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:20.828558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f80dc6fd-bf82-4bd7-9fac-78057d4661a4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:20.829319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f80dc6fd-bf82-4bd7-9fac-78057d4661a4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:20.829758 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f80dc6fd-bf82-4bd7-9fac-78057d4661a4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:20.858373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f80dc6fd-bf82-4bd7-9fac-78057d4661a4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 Jul 14 09:46:20.858985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 556/1059] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:20.897838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6747838f-c77b-4e68-898d-aeb8029fb3dc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:20.898777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6747838f-c77b-4e68-898d-aeb8029fb3dc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:20.905614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6747838f-c77b-4e68-898d-aeb8029fb3dc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:20.906053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6747838f-c77b-4e68-898d-aeb8029fb3dc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:20.906851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6747838f-c77b-4e68-898d-aeb8029fb3dc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:20.907280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6747838f-c77b-4e68-898d-aeb8029fb3dc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:20.936873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6747838f-c77b-4e68-898d-aeb8029fb3dc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043083 Jul 14 09:46:20.937404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 504/1060] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:21.439571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-390b512f-a826-43a4-adbe-31e40832aab9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:21.440215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-390b512f-a826-43a4-adbe-31e40832aab9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:21.446566 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-390b512f-a826-43a4-adbe-31e40832aab9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:21.447020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-390b512f-a826-43a4-adbe-31e40832aab9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:21.447776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-390b512f-a826-43a4-adbe-31e40832aab9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:21.448213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-390b512f-a826-43a4-adbe-31e40832aab9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:21.580488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-390b512f-a826-43a4-adbe-31e40832aab9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:21.588056 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-390b512f-a826-43a4-adbe-31e40832aab9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152347 Jul 14 09:46:21.588623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 557/1061] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:21 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:21.870104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c661d411-11dd-46fc-8112-4c765375672e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:21.870971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c661d411-11dd-46fc-8112-4c765375672e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:21.877005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c661d411-11dd-46fc-8112-4c765375672e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:21.877444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c661d411-11dd-46fc-8112-4c765375672e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:21.878204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c661d411-11dd-46fc-8112-4c765375672e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:21.878642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c661d411-11dd-46fc-8112-4c765375672e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:21.907415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c661d411-11dd-46fc-8112-4c765375672e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041440 Jul 14 09:46:21.908037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 505/1062] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:21.949254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f17d434c-b422-4cae-ae6b-49c05cda1e51 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:21.950727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f17d434c-b422-4cae-ae6b-49c05cda1e51 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:21.957156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f17d434c-b422-4cae-ae6b-49c05cda1e51 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:21.957606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f17d434c-b422-4cae-ae6b-49c05cda1e51 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:21.958407 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f17d434c-b422-4cae-ae6b-49c05cda1e51 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:21.958850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f17d434c-b422-4cae-ae6b-49c05cda1e51 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:21.987619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f17d434c-b422-4cae-ae6b-49c05cda1e51 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042919 Jul 14 09:46:21.988167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 558/1063] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:22.605470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cfe31689-f71a-4b6b-880a-bb7b874d71ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:22.606604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cfe31689-f71a-4b6b-880a-bb7b874d71ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:22.612677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cfe31689-f71a-4b6b-880a-bb7b874d71ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:22.613118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cfe31689-f71a-4b6b-880a-bb7b874d71ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:22.613871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cfe31689-f71a-4b6b-880a-bb7b874d71ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:22.614334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cfe31689-f71a-4b6b-880a-bb7b874d71ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:22.749703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cfe31689-f71a-4b6b-880a-bb7b874d71ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:22.757345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cfe31689-f71a-4b6b-880a-bb7b874d71ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.155662 Jul 14 09:46:22.757848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 506/1064] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:22 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:22.919265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2e7c2e38-cc02-4e89-8c30-925f3f316b91 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:22.920196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2e7c2e38-cc02-4e89-8c30-925f3f316b91 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:22.926208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e7c2e38-cc02-4e89-8c30-925f3f316b91 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:22.926668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e7c2e38-cc02-4e89-8c30-925f3f316b91 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:22.927414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e7c2e38-cc02-4e89-8c30-925f3f316b91 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:22.927843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e7c2e38-cc02-4e89-8c30-925f3f316b91 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:22.951956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:22.957426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2e7c2e38-cc02-4e89-8c30-925f3f316b91 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 Jul 14 09:46:22.957968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 559/1065] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:22 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:23.000143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7edfa530-6cd7-4b1c-892a-5092892ea11a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:23.001062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7edfa530-6cd7-4b1c-892a-5092892ea11a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:23.007591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7edfa530-6cd7-4b1c-892a-5092892ea11a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:23.007976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7edfa530-6cd7-4b1c-892a-5092892ea11a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:23.008733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7edfa530-6cd7-4b1c-892a-5092892ea11a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:23.009161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7edfa530-6cd7-4b1c-892a-5092892ea11a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:23.037685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7edfa530-6cd7-4b1c-892a-5092892ea11a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042543 Jul 14 09:46:23.038236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 507/1066] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:23.774820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-38f3f7fc-8b7c-43f5-a00b-ec46138f6286 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:23.775353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-38f3f7fc-8b7c-43f5-a00b-ec46138f6286 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:23.781241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38f3f7fc-8b7c-43f5-a00b-ec46138f6286 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:23.781707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38f3f7fc-8b7c-43f5-a00b-ec46138f6286 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:23.782485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38f3f7fc-8b7c-43f5-a00b-ec46138f6286 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:23.782915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38f3f7fc-8b7c-43f5-a00b-ec46138f6286 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:23.909228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-38f3f7fc-8b7c-43f5-a00b-ec46138f6286 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:23.916598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-38f3f7fc-8b7c-43f5-a00b-ec46138f6286 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146050 Jul 14 09:46:23.917154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 560/1067] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:23 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:23.968787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0a49061c-9d73-4500-beb6-20ab453cd8ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:23.969724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0a49061c-9d73-4500-beb6-20ab453cd8ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:23.975738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a49061c-9d73-4500-beb6-20ab453cd8ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:23.976175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a49061c-9d73-4500-beb6-20ab453cd8ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:23.976919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a49061c-9d73-4500-beb6-20ab453cd8ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:23.977346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a49061c-9d73-4500-beb6-20ab453cd8ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:24.005581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0a49061c-9d73-4500-beb6-20ab453cd8ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040702 Jul 14 09:46:24.006171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 508/1068] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:24.049306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3173e2dc-d69c-46ba-89e4-83dce72e8e38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:24.050294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3173e2dc-d69c-46ba-89e4-83dce72e8e38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:24.056666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3173e2dc-d69c-46ba-89e4-83dce72e8e38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:24.057111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3173e2dc-d69c-46ba-89e4-83dce72e8e38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:24.057882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3173e2dc-d69c-46ba-89e4-83dce72e8e38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:24.058331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3173e2dc-d69c-46ba-89e4-83dce72e8e38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:24.087329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3173e2dc-d69c-46ba-89e4-83dce72e8e38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042128 Jul 14 09:46:24.087868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 561/1069] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:24.934327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4088f846-03b7-4a3a-a9c3-7e3999b11f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:24.934939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4088f846-03b7-4a3a-a9c3-7e3999b11f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:24.941067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4088f846-03b7-4a3a-a9c3-7e3999b11f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:24.941508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4088f846-03b7-4a3a-a9c3-7e3999b11f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:24.942285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4088f846-03b7-4a3a-a9c3-7e3999b11f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:24.942722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4088f846-03b7-4a3a-a9c3-7e3999b11f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:25.017500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e46cfbdc-4fe4-447b-80f0-b8c6469548c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:25.018460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e46cfbdc-4fe4-447b-80f0-b8c6469548c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:25.024437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e46cfbdc-4fe4-447b-80f0-b8c6469548c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:25.024885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e46cfbdc-4fe4-447b-80f0-b8c6469548c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:25.025641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e46cfbdc-4fe4-447b-80f0-b8c6469548c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:25.026073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e46cfbdc-4fe4-447b-80f0-b8c6469548c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:25.056080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e46cfbdc-4fe4-447b-80f0-b8c6469548c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042441 Jul 14 09:46:25.056734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 562/1070] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:25 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:25.075936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4088f846-03b7-4a3a-a9c3-7e3999b11f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:25.083434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4088f846-03b7-4a3a-a9c3-7e3999b11f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153064 Jul 14 09:46:25.084001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 509/1071] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:24 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:25.099050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-79b9630c-26ab-432d-adcc-8a06314accf7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:25.099962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-79b9630c-26ab-432d-adcc-8a06314accf7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:25.106327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-79b9630c-26ab-432d-adcc-8a06314accf7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:25.106782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-79b9630c-26ab-432d-adcc-8a06314accf7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:25.107541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-79b9630c-26ab-432d-adcc-8a06314accf7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:25.107974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-79b9630c-26ab-432d-adcc-8a06314accf7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:25.135998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-79b9630c-26ab-432d-adcc-8a06314accf7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041029 Jul 14 09:46:25.136541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 563/1072] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:26.067888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-294f0fa1-ee87-4d2a-bdc7-b7f20598cac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:26.068802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-294f0fa1-ee87-4d2a-bdc7-b7f20598cac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:26.076272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-294f0fa1-ee87-4d2a-bdc7-b7f20598cac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:26.076841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-294f0fa1-ee87-4d2a-bdc7-b7f20598cac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:26.077453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-294f0fa1-ee87-4d2a-bdc7-b7f20598cac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:26.077882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-294f0fa1-ee87-4d2a-bdc7-b7f20598cac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:26.100693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8c2eb209-2783-4eac-b004-307c5e4b677b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:26.101321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8c2eb209-2783-4eac-b004-307c5e4b677b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:26.106494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-294f0fa1-ee87-4d2a-bdc7-b7f20598cac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042596 Jul 14 09:46:26.107060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 510/1073] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:26.107918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c2eb209-2783-4eac-b004-307c5e4b677b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:26.108380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c2eb209-2783-4eac-b004-307c5e4b677b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:26.109222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c2eb209-2783-4eac-b004-307c5e4b677b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:26.109665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c2eb209-2783-4eac-b004-307c5e4b677b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:26.148071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9075fbec-d7d0-4908-a10f-00cbe223b48e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:26.149102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9075fbec-d7d0-4908-a10f-00cbe223b48e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:26.155305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9075fbec-d7d0-4908-a10f-00cbe223b48e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:26.155828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9075fbec-d7d0-4908-a10f-00cbe223b48e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:26.156665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9075fbec-d7d0-4908-a10f-00cbe223b48e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:26.157163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9075fbec-d7d0-4908-a10f-00cbe223b48e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:26.186474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9075fbec-d7d0-4908-a10f-00cbe223b48e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042226 Jul 14 09:46:26.187539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 511/1074] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:26.239247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8c2eb209-2783-4eac-b004-307c5e4b677b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:26.247255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8c2eb209-2783-4eac-b004-307c5e4b677b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149939 Jul 14 09:46:26.247818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 564/1075] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:26 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:27.118850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-24986bbe-3278-4f78-831e-27c3900886b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:27.119761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-24986bbe-3278-4f78-831e-27c3900886b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:27.126840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-24986bbe-3278-4f78-831e-27c3900886b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:27.127277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-24986bbe-3278-4f78-831e-27c3900886b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:27.128019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-24986bbe-3278-4f78-831e-27c3900886b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:27.128443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-24986bbe-3278-4f78-831e-27c3900886b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:27.155765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-24986bbe-3278-4f78-831e-27c3900886b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040876 Jul 14 09:46:27.156296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 512/1076] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:27.198154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9ce37cc3-819e-4aa5-8e74-2025a7192787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:27.199095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9ce37cc3-819e-4aa5-8e74-2025a7192787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:27.205569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9ce37cc3-819e-4aa5-8e74-2025a7192787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:27.206014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9ce37cc3-819e-4aa5-8e74-2025a7192787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:27.206801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9ce37cc3-819e-4aa5-8e74-2025a7192787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:27.207255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9ce37cc3-819e-4aa5-8e74-2025a7192787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:27.235769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9ce37cc3-819e-4aa5-8e74-2025a7192787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041827 Jul 14 09:46:27.236319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 565/1077] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:27.263858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-87537488-d75b-43ff-b1c7-30b24a7cd722 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:27.264457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-87537488-d75b-43ff-b1c7-30b24a7cd722 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:27.270436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87537488-d75b-43ff-b1c7-30b24a7cd722 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:27.270880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87537488-d75b-43ff-b1c7-30b24a7cd722 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:27.271653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87537488-d75b-43ff-b1c7-30b24a7cd722 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:27.272059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87537488-d75b-43ff-b1c7-30b24a7cd722 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:27.400676 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-87537488-d75b-43ff-b1c7-30b24a7cd722 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:27.408206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-87537488-d75b-43ff-b1c7-30b24a7cd722 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148177 Jul 14 09:46:27.408766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 513/1078] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:27 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:28.167878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9b014b9b-b0a2-4add-87bf-aa7aae062e35 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:28.168909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9b014b9b-b0a2-4add-87bf-aa7aae062e35 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:28.175214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b014b9b-b0a2-4add-87bf-aa7aae062e35 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:28.175659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b014b9b-b0a2-4add-87bf-aa7aae062e35 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:28.176410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b014b9b-b0a2-4add-87bf-aa7aae062e35 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:28.176845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b014b9b-b0a2-4add-87bf-aa7aae062e35 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:28.193593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:46:28.194086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:46:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 09:46:28.206047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9b014b9b-b0a2-4add-87bf-aa7aae062e35 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 Jul 14 09:46:28.206636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 566/1079] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:28.247614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b973d47e-4628-412c-9f76-00c9ffb0fdde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:28.248520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b973d47e-4628-412c-9f76-00c9ffb0fdde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:28.254978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b973d47e-4628-412c-9f76-00c9ffb0fdde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:28.255420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b973d47e-4628-412c-9f76-00c9ffb0fdde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:28.256178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b973d47e-4628-412c-9f76-00c9ffb0fdde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:28.256604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b973d47e-4628-412c-9f76-00c9ffb0fdde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:28.285820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b973d47e-4628-412c-9f76-00c9ffb0fdde tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042669 Jul 14 09:46:28.286391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 514/1080] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:28.425212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f8caa759-ffa5-41f4-83df-646d9708abe0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:28.425748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f8caa759-ffa5-41f4-83df-646d9708abe0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:28.429595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:46:28.432241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:46:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 (ip 10.222.0.40) !!! Jul 14 09:46:28.435256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8caa759-ffa5-41f4-83df-646d9708abe0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:28.436308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8caa759-ffa5-41f4-83df-646d9708abe0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:28.436981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8caa759-ffa5-41f4-83df-646d9708abe0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:28.437424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8caa759-ffa5-41f4-83df-646d9708abe0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:28.596587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f8caa759-ffa5-41f4-83df-646d9708abe0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:28.604160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f8caa759-ffa5-41f4-83df-646d9708abe0 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.182872 Jul 14 09:46:28.604720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 567/1081] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:28 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:29.217995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3dffc34a-5234-495e-bf0a-a32ce872944b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:29.218927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3dffc34a-5234-495e-bf0a-a32ce872944b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:29.225023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3dffc34a-5234-495e-bf0a-a32ce872944b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:29.225460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3dffc34a-5234-495e-bf0a-a32ce872944b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:29.226283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3dffc34a-5234-495e-bf0a-a32ce872944b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:29.226697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3dffc34a-5234-495e-bf0a-a32ce872944b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:29.255547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3dffc34a-5234-495e-bf0a-a32ce872944b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042020 Jul 14 09:46:29.256080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 515/1082] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:29.297880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fe28c433-d52b-49b2-8e6a-d46427400db3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:29.298861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fe28c433-d52b-49b2-8e6a-d46427400db3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:29.305457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fe28c433-d52b-49b2-8e6a-d46427400db3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:29.305912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fe28c433-d52b-49b2-8e6a-d46427400db3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:29.306731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fe28c433-d52b-49b2-8e6a-d46427400db3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:29.307171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fe28c433-d52b-49b2-8e6a-d46427400db3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:29.335296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fe28c433-d52b-49b2-8e6a-d46427400db3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041967 Jul 14 09:46:29.335846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 568/1083] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:29.621785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9730e2df-db63-4066-a8bb-0f42becf0271 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:29.622406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9730e2df-db63-4066-a8bb-0f42becf0271 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:29.628361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9730e2df-db63-4066-a8bb-0f42becf0271 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:29.628798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9730e2df-db63-4066-a8bb-0f42becf0271 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:29.629539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9730e2df-db63-4066-a8bb-0f42becf0271 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:29.629969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9730e2df-db63-4066-a8bb-0f42becf0271 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:29.758045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9730e2df-db63-4066-a8bb-0f42becf0271 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:29.761366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:29.767277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9730e2df-db63-4066-a8bb-0f42becf0271 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149690 Jul 14 09:46:29.767841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 516/1084] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:29 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:30.267089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-35564a34-5f3d-429d-82b3-6d6e7d9aa25d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:30.268000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-35564a34-5f3d-429d-82b3-6d6e7d9aa25d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:30.273959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35564a34-5f3d-429d-82b3-6d6e7d9aa25d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:30.274441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35564a34-5f3d-429d-82b3-6d6e7d9aa25d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:30.275193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35564a34-5f3d-429d-82b3-6d6e7d9aa25d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:30.275627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35564a34-5f3d-429d-82b3-6d6e7d9aa25d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:30.304475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-35564a34-5f3d-429d-82b3-6d6e7d9aa25d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041333 Jul 14 09:46:30.305101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 569/1085] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:30 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:30.349700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-490eafea-8ae6-4c0d-8fb3-f1b0b3c71c34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:30.349700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-490eafea-8ae6-4c0d-8fb3-f1b0b3c71c34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:30.354708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-490eafea-8ae6-4c0d-8fb3-f1b0b3c71c34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:30.355145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-490eafea-8ae6-4c0d-8fb3-f1b0b3c71c34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:30.356581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-490eafea-8ae6-4c0d-8fb3-f1b0b3c71c34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:30.357007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-490eafea-8ae6-4c0d-8fb3-f1b0b3c71c34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:30.385757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-490eafea-8ae6-4c0d-8fb3-f1b0b3c71c34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042758 Jul 14 09:46:30.386319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 517/1086] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:30.784614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6906c32e-c2d9-4608-b387-9b77f56939f8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:30.785225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6906c32e-c2d9-4608-b387-9b77f56939f8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:30.791307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6906c32e-c2d9-4608-b387-9b77f56939f8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:30.791755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6906c32e-c2d9-4608-b387-9b77f56939f8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:30.792511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6906c32e-c2d9-4608-b387-9b77f56939f8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:30.793670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6906c32e-c2d9-4608-b387-9b77f56939f8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:30.924719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6906c32e-c2d9-4608-b387-9b77f56939f8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:30.932165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6906c32e-c2d9-4608-b387-9b77f56939f8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151548 Jul 14 09:46:30.932719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 570/1087] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:30 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:31.316213 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a48c082c-e50f-4ff3-8c3e-1fa3fd8ad63b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:31.317122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a48c082c-e50f-4ff3-8c3e-1fa3fd8ad63b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:31.323718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a48c082c-e50f-4ff3-8c3e-1fa3fd8ad63b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:31.324167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a48c082c-e50f-4ff3-8c3e-1fa3fd8ad63b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:31.325501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a48c082c-e50f-4ff3-8c3e-1fa3fd8ad63b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:31.325929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a48c082c-e50f-4ff3-8c3e-1fa3fd8ad63b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:31.353509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a48c082c-e50f-4ff3-8c3e-1fa3fd8ad63b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Jul 14 09:46:31.354098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 518/1088] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:31.396666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8f0791a4-7055-4a21-a057-23131c586a9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:31.397580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8f0791a4-7055-4a21-a057-23131c586a9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:31.404156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f0791a4-7055-4a21-a057-23131c586a9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:31.404602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f0791a4-7055-4a21-a057-23131c586a9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:31.405357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f0791a4-7055-4a21-a057-23131c586a9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:31.405792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f0791a4-7055-4a21-a057-23131c586a9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:31.434930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8f0791a4-7055-4a21-a057-23131c586a9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042164 Jul 14 09:46:31.435470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 571/1089] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:31.949876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6292dbda-9c65-4e11-8d52-8a2373aba76b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:31.950495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6292dbda-9c65-4e11-8d52-8a2373aba76b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:31.956470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6292dbda-9c65-4e11-8d52-8a2373aba76b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:31.956908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6292dbda-9c65-4e11-8d52-8a2373aba76b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:31.957646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6292dbda-9c65-4e11-8d52-8a2373aba76b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:31.958067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6292dbda-9c65-4e11-8d52-8a2373aba76b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:32.085559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6292dbda-9c65-4e11-8d52-8a2373aba76b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:32.093140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6292dbda-9c65-4e11-8d52-8a2373aba76b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147681 Jul 14 09:46:32.093692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 519/1090] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:31 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:32.365750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c26025e4-98d8-4fdf-b961-ddeebde1a21e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:32.366616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c26025e4-98d8-4fdf-b961-ddeebde1a21e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:32.373754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c26025e4-98d8-4fdf-b961-ddeebde1a21e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:32.374221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c26025e4-98d8-4fdf-b961-ddeebde1a21e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:32.374980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c26025e4-98d8-4fdf-b961-ddeebde1a21e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:32.376039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c26025e4-98d8-4fdf-b961-ddeebde1a21e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:32.404711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c26025e4-98d8-4fdf-b961-ddeebde1a21e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Jul 14 09:46:32.405345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 572/1091] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:32.447246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bc70de3f-6577-4a5b-a976-fe7843a62c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:32.448164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bc70de3f-6577-4a5b-a976-fe7843a62c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:32.454610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc70de3f-6577-4a5b-a976-fe7843a62c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:32.455048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc70de3f-6577-4a5b-a976-fe7843a62c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:32.455799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc70de3f-6577-4a5b-a976-fe7843a62c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:32.456227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc70de3f-6577-4a5b-a976-fe7843a62c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:32.484914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bc70de3f-6577-4a5b-a976-fe7843a62c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041890 Jul 14 09:46:32.485494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 520/1092] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:33.110390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b5a8a845-f244-4486-b72e-b6f077cc4817 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:33.110993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b5a8a845-f244-4486-b72e-b6f077cc4817 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:33.116941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5a8a845-f244-4486-b72e-b6f077cc4817 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:33.117377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5a8a845-f244-4486-b72e-b6f077cc4817 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:33.118122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5a8a845-f244-4486-b72e-b6f077cc4817 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:33.118574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5a8a845-f244-4486-b72e-b6f077cc4817 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:33.247964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b5a8a845-f244-4486-b72e-b6f077cc4817 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:33.255381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b5a8a845-f244-4486-b72e-b6f077cc4817 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148925 Jul 14 09:46:33.255934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 573/1093] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:33 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:33.416511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-55036a9b-f56a-4130-ae80-1fb2360c1b58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:33.417351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-55036a9b-f56a-4130-ae80-1fb2360c1b58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:33.423914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55036a9b-f56a-4130-ae80-1fb2360c1b58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:33.424355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55036a9b-f56a-4130-ae80-1fb2360c1b58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:33.425106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55036a9b-f56a-4130-ae80-1fb2360c1b58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:33.425539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55036a9b-f56a-4130-ae80-1fb2360c1b58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:33.461925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-55036a9b-f56a-4130-ae80-1fb2360c1b58 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 Jul 14 09:46:33.462595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 521/1094] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:33.497245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0dbb97e3-bf62-4cc9-872b-e633a70b5bb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:33.498154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0dbb97e3-bf62-4cc9-872b-e633a70b5bb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:33.504620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dbb97e3-bf62-4cc9-872b-e633a70b5bb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:33.505056 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dbb97e3-bf62-4cc9-872b-e633a70b5bb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:33.505800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dbb97e3-bf62-4cc9-872b-e633a70b5bb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:33.506249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dbb97e3-bf62-4cc9-872b-e633a70b5bb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:33.536916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0dbb97e3-bf62-4cc9-872b-e633a70b5bb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044356 Jul 14 09:46:33.537470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 574/1095] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:34.272252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e7e2477b-76ae-4e33-876a-f7d1e99df38b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:34.272857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e7e2477b-76ae-4e33-876a-f7d1e99df38b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:34.278905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e7e2477b-76ae-4e33-876a-f7d1e99df38b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:34.279348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e7e2477b-76ae-4e33-876a-f7d1e99df38b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:34.280094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e7e2477b-76ae-4e33-876a-f7d1e99df38b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:34.280522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e7e2477b-76ae-4e33-876a-f7d1e99df38b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:34.411551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e7e2477b-76ae-4e33-876a-f7d1e99df38b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:34.419037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e7e2477b-76ae-4e33-876a-f7d1e99df38b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150653 Jul 14 09:46:34.419590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 522/1096] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:34 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:34.475872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-354f2265-898f-45f6-8ac8-fb5da93607f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:34.476789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-354f2265-898f-45f6-8ac8-fb5da93607f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:34.482922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-354f2265-898f-45f6-8ac8-fb5da93607f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:34.483365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-354f2265-898f-45f6-8ac8-fb5da93607f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:34.484121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-354f2265-898f-45f6-8ac8-fb5da93607f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:34.484549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-354f2265-898f-45f6-8ac8-fb5da93607f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:34.513284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-354f2265-898f-45f6-8ac8-fb5da93607f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Jul 14 09:46:34.513834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 575/1097] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:34.548639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f029ad4-cc2d-41ce-b37e-dd22e4f162e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:34.549481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f029ad4-cc2d-41ce-b37e-dd22e4f162e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:34.556008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f029ad4-cc2d-41ce-b37e-dd22e4f162e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:34.556457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f029ad4-cc2d-41ce-b37e-dd22e4f162e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:34.557204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f029ad4-cc2d-41ce-b37e-dd22e4f162e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:34.557636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f029ad4-cc2d-41ce-b37e-dd22e4f162e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:34.587333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f029ad4-cc2d-41ce-b37e-dd22e4f162e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042782 Jul 14 09:46:34.587875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 523/1098] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:35.435587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-41ea5daf-a08d-4041-bc6b-cae2f9bb314c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:35.436193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-41ea5daf-a08d-4041-bc6b-cae2f9bb314c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:35.442243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41ea5daf-a08d-4041-bc6b-cae2f9bb314c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:35.442695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41ea5daf-a08d-4041-bc6b-cae2f9bb314c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:35.443450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41ea5daf-a08d-4041-bc6b-cae2f9bb314c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:35.443882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41ea5daf-a08d-4041-bc6b-cae2f9bb314c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:35.462238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:35.524079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-358e091f-c1c8-4ec5-8543-1692ad374da0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:35.525008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-358e091f-c1c8-4ec5-8543-1692ad374da0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:35.531913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-358e091f-c1c8-4ec5-8543-1692ad374da0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:35.532438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-358e091f-c1c8-4ec5-8543-1692ad374da0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:35.533152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-358e091f-c1c8-4ec5-8543-1692ad374da0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:35.533582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-358e091f-c1c8-4ec5-8543-1692ad374da0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:35.562773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-358e091f-c1c8-4ec5-8543-1692ad374da0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042537 Jul 14 09:46:35.566480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 524/1099] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:35 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:35.573933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-41ea5daf-a08d-4041-bc6b-cae2f9bb314c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:35.581936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-41ea5daf-a08d-4041-bc6b-cae2f9bb314c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150312 Jul 14 09:46:35.582516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 576/1100] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:35 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:35.598866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-35d8d240-f16a-415c-8f9a-9119b54e6102 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:35.599781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-35d8d240-f16a-415c-8f9a-9119b54e6102 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:35.605743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-35d8d240-f16a-415c-8f9a-9119b54e6102 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:35.606209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-35d8d240-f16a-415c-8f9a-9119b54e6102 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:35.606977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-35d8d240-f16a-415c-8f9a-9119b54e6102 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:35.607411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-35d8d240-f16a-415c-8f9a-9119b54e6102 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:35.635338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-35d8d240-f16a-415c-8f9a-9119b54e6102 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040401 Jul 14 09:46:35.635873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 525/1101] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:36.575027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b775a01-277b-49a9-b2c4-c8518bf9ba8a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:36.575901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b775a01-277b-49a9-b2c4-c8518bf9ba8a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:36.582529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b775a01-277b-49a9-b2c4-c8518bf9ba8a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:36.582972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b775a01-277b-49a9-b2c4-c8518bf9ba8a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:36.583720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b775a01-277b-49a9-b2c4-c8518bf9ba8a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:36.584150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b775a01-277b-49a9-b2c4-c8518bf9ba8a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:36.599551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-41bb921f-d52e-43bd-8636-cfe5a3f2d763 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:36.600245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-41bb921f-d52e-43bd-8636-cfe5a3f2d763 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:36.607388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41bb921f-d52e-43bd-8636-cfe5a3f2d763 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:36.607858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41bb921f-d52e-43bd-8636-cfe5a3f2d763 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:36.608622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41bb921f-d52e-43bd-8636-cfe5a3f2d763 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:36.609048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41bb921f-d52e-43bd-8636-cfe5a3f2d763 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:36.613753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b775a01-277b-49a9-b2c4-c8518bf9ba8a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Jul 14 09:46:36.614344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 577/1102] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:36.647224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-828bb4c8-71c6-4084-980a-a1c076567741 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:36.648127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-828bb4c8-71c6-4084-980a-a1c076567741 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:36.654712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-828bb4c8-71c6-4084-980a-a1c076567741 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:36.655156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-828bb4c8-71c6-4084-980a-a1c076567741 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:36.655912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-828bb4c8-71c6-4084-980a-a1c076567741 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:36.656342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-828bb4c8-71c6-4084-980a-a1c076567741 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:36.685123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-828bb4c8-71c6-4084-980a-a1c076567741 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041659 Jul 14 09:46:36.685689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 578/1103] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:36.742437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-41bb921f-d52e-43bd-8636-cfe5a3f2d763 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:36.750004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-41bb921f-d52e-43bd-8636-cfe5a3f2d763 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154258 Jul 14 09:46:36.750583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 526/1104] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:36 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:37.625438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-02630bdb-1d98-4e06-afbc-621de6e97f41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:37.626380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-02630bdb-1d98-4e06-afbc-621de6e97f41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:37.633017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02630bdb-1d98-4e06-afbc-621de6e97f41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:37.633460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02630bdb-1d98-4e06-afbc-621de6e97f41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:37.634224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02630bdb-1d98-4e06-afbc-621de6e97f41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:37.634659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02630bdb-1d98-4e06-afbc-621de6e97f41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:37.662026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-02630bdb-1d98-4e06-afbc-621de6e97f41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Jul 14 09:46:37.662587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 579/1105] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:37.696904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-06d7f7a8-72ff-427b-a3d8-287d5ec96d63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:37.697846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-06d7f7a8-72ff-427b-a3d8-287d5ec96d63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:37.704439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06d7f7a8-72ff-427b-a3d8-287d5ec96d63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:37.704883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06d7f7a8-72ff-427b-a3d8-287d5ec96d63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:37.705635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06d7f7a8-72ff-427b-a3d8-287d5ec96d63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:37.706063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06d7f7a8-72ff-427b-a3d8-287d5ec96d63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:37.735617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-06d7f7a8-72ff-427b-a3d8-287d5ec96d63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042956 Jul 14 09:46:37.736147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 527/1106] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:37.766812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cd2f9a7a-1eb7-4ad3-a440-489b69719fc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:37.767425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cd2f9a7a-1eb7-4ad3-a440-489b69719fc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:37.773364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cd2f9a7a-1eb7-4ad3-a440-489b69719fc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:37.773809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cd2f9a7a-1eb7-4ad3-a440-489b69719fc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:37.774594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cd2f9a7a-1eb7-4ad3-a440-489b69719fc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:37.775029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cd2f9a7a-1eb7-4ad3-a440-489b69719fc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:37.906152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cd2f9a7a-1eb7-4ad3-a440-489b69719fc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:37.913708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cd2f9a7a-1eb7-4ad3-a440-489b69719fc9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150759 Jul 14 09:46:37.914286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 580/1107] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:37 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:38.673066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a5fd4c22-ecb8-494f-a604-2576aae3ed9c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:38.673978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a5fd4c22-ecb8-494f-a604-2576aae3ed9c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:38.680165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5fd4c22-ecb8-494f-a604-2576aae3ed9c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:38.680600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5fd4c22-ecb8-494f-a604-2576aae3ed9c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:38.681349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5fd4c22-ecb8-494f-a604-2576aae3ed9c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:38.681771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5fd4c22-ecb8-494f-a604-2576aae3ed9c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:38.712000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a5fd4c22-ecb8-494f-a604-2576aae3ed9c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 Jul 14 09:46:38.712743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 528/1108] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:38.748034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ecc7e8d6-d781-4d64-8fdb-9218da7d2f41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:38.748951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ecc7e8d6-d781-4d64-8fdb-9218da7d2f41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:38.755429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecc7e8d6-d781-4d64-8fdb-9218da7d2f41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:38.755876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecc7e8d6-d781-4d64-8fdb-9218da7d2f41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:38.756635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecc7e8d6-d781-4d64-8fdb-9218da7d2f41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:38.757075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecc7e8d6-d781-4d64-8fdb-9218da7d2f41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:38.786987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ecc7e8d6-d781-4d64-8fdb-9218da7d2f41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043284 Jul 14 09:46:38.787462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 581/1109] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:38.931236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7129e627-02f7-4b3e-bd9a-d328d9e81d4f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:38.931822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7129e627-02f7-4b3e-bd9a-d328d9e81d4f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:38.938370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7129e627-02f7-4b3e-bd9a-d328d9e81d4f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:38.938810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7129e627-02f7-4b3e-bd9a-d328d9e81d4f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:38.939562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7129e627-02f7-4b3e-bd9a-d328d9e81d4f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:38.939991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7129e627-02f7-4b3e-bd9a-d328d9e81d4f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:39.090130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7129e627-02f7-4b3e-bd9a-d328d9e81d4f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:39.098089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7129e627-02f7-4b3e-bd9a-d328d9e81d4f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.170809 Jul 14 09:46:39.098682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 529/1110] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:38 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:39.723855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c2431212-952a-4c12-a935-dfaa8c227a51 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:39.724755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c2431212-952a-4c12-a935-dfaa8c227a51 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:39.730812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2431212-952a-4c12-a935-dfaa8c227a51 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:39.731256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2431212-952a-4c12-a935-dfaa8c227a51 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:39.732648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2431212-952a-4c12-a935-dfaa8c227a51 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:39.733075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2431212-952a-4c12-a935-dfaa8c227a51 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:39.760522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c2431212-952a-4c12-a935-dfaa8c227a51 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040628 Jul 14 09:46:39.761105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 582/1111] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:39.799623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1b269c6d-d676-4405-bfb8-1dd8eb23dcb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:39.800535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1b269c6d-d676-4405-bfb8-1dd8eb23dcb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:39.806996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b269c6d-d676-4405-bfb8-1dd8eb23dcb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:39.807432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b269c6d-d676-4405-bfb8-1dd8eb23dcb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:39.808177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b269c6d-d676-4405-bfb8-1dd8eb23dcb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:39.808603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b269c6d-d676-4405-bfb8-1dd8eb23dcb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:39.837190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1b269c6d-d676-4405-bfb8-1dd8eb23dcb3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041425 Jul 14 09:46:39.837653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 530/1112] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:40.046206 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bec7ab0b-32ae-4276-a5dc-b7c904aed273 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:40.046696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bec7ab0b-32ae-4276-a5dc-b7c904aed273 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:40.053208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bec7ab0b-32ae-4276-a5dc-b7c904aed273 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:40.053735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bec7ab0b-32ae-4276-a5dc-b7c904aed273 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:40.054669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bec7ab0b-32ae-4276-a5dc-b7c904aed273 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:40.055122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bec7ab0b-32ae-4276-a5dc-b7c904aed273 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:40.115493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3d679b20-a107-444e-a983-72f86c8fc392 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:40.116021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3d679b20-a107-444e-a983-72f86c8fc392 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:40.122000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d679b20-a107-444e-a983-72f86c8fc392 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:40.122505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d679b20-a107-444e-a983-72f86c8fc392 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:40.123272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d679b20-a107-444e-a983-72f86c8fc392 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:40.123708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d679b20-a107-444e-a983-72f86c8fc392 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:40.249955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3d679b20-a107-444e-a983-72f86c8fc392 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:40.257436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3d679b20-a107-444e-a983-72f86c8fc392 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.145891 Jul 14 09:46:40.258031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 531/1113] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:40 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:40.771836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a69fdcf4-0b81-426c-8ed2-26fbb17d2b69 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:40.772679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a69fdcf4-0b81-426c-8ed2-26fbb17d2b69 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:40.778726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a69fdcf4-0b81-426c-8ed2-26fbb17d2b69 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:40.779169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a69fdcf4-0b81-426c-8ed2-26fbb17d2b69 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:40.779921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a69fdcf4-0b81-426c-8ed2-26fbb17d2b69 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:40.780349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a69fdcf4-0b81-426c-8ed2-26fbb17d2b69 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:40.808914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a69fdcf4-0b81-426c-8ed2-26fbb17d2b69 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 Jul 14 09:46:40.809570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 532/1114] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:40.848311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f3ee7b28-f7e6-43e1-928e-180cc6bee5e8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:40.849184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f3ee7b28-f7e6-43e1-928e-180cc6bee5e8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:40.854825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3ee7b28-f7e6-43e1-928e-180cc6bee5e8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:40.855263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3ee7b28-f7e6-43e1-928e-180cc6bee5e8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:40.856004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3ee7b28-f7e6-43e1-928e-180cc6bee5e8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:40.858285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3ee7b28-f7e6-43e1-928e-180cc6bee5e8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:40.874576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:40.887401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f3ee7b28-f7e6-43e1-928e-180cc6bee5e8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042650 Jul 14 09:46:40.888449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 533/1115] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:41.274529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ce73d814-76be-4870-9427-2e5c85c929de tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:41.275127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ce73d814-76be-4870-9427-2e5c85c929de tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:41.281029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce73d814-76be-4870-9427-2e5c85c929de tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:41.281465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce73d814-76be-4870-9427-2e5c85c929de tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:41.282229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce73d814-76be-4870-9427-2e5c85c929de tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:41.282657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce73d814-76be-4870-9427-2e5c85c929de tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:41.413599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ce73d814-76be-4870-9427-2e5c85c929de tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:41.421540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ce73d814-76be-4870-9427-2e5c85c929de tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150789 Jul 14 09:46:41.422093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 534/1116] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:41 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:41.821418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a94e6b54-7fda-4c64-a8c3-47380c87cdf7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:41.822286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a94e6b54-7fda-4c64-a8c3-47380c87cdf7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:41.828810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a94e6b54-7fda-4c64-a8c3-47380c87cdf7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:41.829250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a94e6b54-7fda-4c64-a8c3-47380c87cdf7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:41.830004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a94e6b54-7fda-4c64-a8c3-47380c87cdf7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:41.830454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a94e6b54-7fda-4c64-a8c3-47380c87cdf7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:41.859472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a94e6b54-7fda-4c64-a8c3-47380c87cdf7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042362 Jul 14 09:46:41.860015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 535/1117] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:41.899245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3b9d76f6-016b-4fda-ad41-cb261aa05b6a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:41.900147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3b9d76f6-016b-4fda-ad41-cb261aa05b6a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:41.906576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b9d76f6-016b-4fda-ad41-cb261aa05b6a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:41.907022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b9d76f6-016b-4fda-ad41-cb261aa05b6a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:41.907772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b9d76f6-016b-4fda-ad41-cb261aa05b6a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:41.908201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b9d76f6-016b-4fda-ad41-cb261aa05b6a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:41.936555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3b9d76f6-016b-4fda-ad41-cb261aa05b6a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041115 Jul 14 09:46:41.937091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 536/1118] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:42.439492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9a95d849-9be1-4307-87f1-00bee7d47546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:42.440098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9a95d849-9be1-4307-87f1-00bee7d47546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:42.441938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=90 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:42.448068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a95d849-9be1-4307-87f1-00bee7d47546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:42.448510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a95d849-9be1-4307-87f1-00bee7d47546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:42.449291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a95d849-9be1-4307-87f1-00bee7d47546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:42.449719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a95d849-9be1-4307-87f1-00bee7d47546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:42.576691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9a95d849-9be1-4307-87f1-00bee7d47546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:42.584129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9a95d849-9be1-4307-87f1-00bee7d47546 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148492 Jul 14 09:46:42.584686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 537/1119] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:42 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:42.870752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b578e6b1-2fe4-4862-95fd-94cb586902ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:42.871583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b578e6b1-2fe4-4862-95fd-94cb586902ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:42.877973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b578e6b1-2fe4-4862-95fd-94cb586902ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:42.878495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b578e6b1-2fe4-4862-95fd-94cb586902ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:42.879243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b578e6b1-2fe4-4862-95fd-94cb586902ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:42.879668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b578e6b1-2fe4-4862-95fd-94cb586902ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:42.909709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b578e6b1-2fe4-4862-95fd-94cb586902ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Jul 14 09:46:42.910267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 538/1120] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:42 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:42.948323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4cbf8858-19e3-44dd-9b05-ce8405bbca41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:42.949227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4cbf8858-19e3-44dd-9b05-ce8405bbca41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:42.955772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4cbf8858-19e3-44dd-9b05-ce8405bbca41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:42.956210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4cbf8858-19e3-44dd-9b05-ce8405bbca41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:42.956959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4cbf8858-19e3-44dd-9b05-ce8405bbca41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:42.957389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4cbf8858-19e3-44dd-9b05-ce8405bbca41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:42.985920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4cbf8858-19e3-44dd-9b05-ce8405bbca41 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041789 Jul 14 09:46:42.986613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 539/1121] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:43.600936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cf0bf14a-6a29-4895-9e8e-f9cd2e62f248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:43.601534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cf0bf14a-6a29-4895-9e8e-f9cd2e62f248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:43.608051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf0bf14a-6a29-4895-9e8e-f9cd2e62f248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:43.608493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf0bf14a-6a29-4895-9e8e-f9cd2e62f248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:43.609239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf0bf14a-6a29-4895-9e8e-f9cd2e62f248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:43.609670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf0bf14a-6a29-4895-9e8e-f9cd2e62f248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:43.736400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cf0bf14a-6a29-4895-9e8e-f9cd2e62f248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:43.743899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cf0bf14a-6a29-4895-9e8e-f9cd2e62f248 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146793 Jul 14 09:46:43.744455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 540/1122] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:43 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:43.921690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fc358031-0ab4-4032-8b0b-990562ad6840 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:43.922615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fc358031-0ab4-4032-8b0b-990562ad6840 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:43.929271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc358031-0ab4-4032-8b0b-990562ad6840 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:43.929720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc358031-0ab4-4032-8b0b-990562ad6840 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:43.930487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc358031-0ab4-4032-8b0b-990562ad6840 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:43.930915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc358031-0ab4-4032-8b0b-990562ad6840 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:43.959655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fc358031-0ab4-4032-8b0b-990562ad6840 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 Jul 14 09:46:43.960208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 541/1123] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:43.997073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7d0fa830-803d-4d20-ac2c-62e4b5e41311 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:43.997973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7d0fa830-803d-4d20-ac2c-62e4b5e41311 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:44.003773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d0fa830-803d-4d20-ac2c-62e4b5e41311 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:44.004219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d0fa830-803d-4d20-ac2c-62e4b5e41311 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:44.004971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d0fa830-803d-4d20-ac2c-62e4b5e41311 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:44.005403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d0fa830-803d-4d20-ac2c-62e4b5e41311 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:44.033476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7d0fa830-803d-4d20-ac2c-62e4b5e41311 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040170 Jul 14 09:46:44.034007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 542/1124] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:44.761108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-19e6f20d-cb8a-405c-94ff-b7e84114c276 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:44.761702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-19e6f20d-cb8a-405c-94ff-b7e84114c276 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:44.768403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-19e6f20d-cb8a-405c-94ff-b7e84114c276 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:44.768780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-19e6f20d-cb8a-405c-94ff-b7e84114c276 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:44.769523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-19e6f20d-cb8a-405c-94ff-b7e84114c276 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:44.769948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-19e6f20d-cb8a-405c-94ff-b7e84114c276 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:44.902068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-19e6f20d-cb8a-405c-94ff-b7e84114c276 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:44.909701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-19e6f20d-cb8a-405c-94ff-b7e84114c276 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152605 Jul 14 09:46:44.910281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 543/1125] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:44 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:46:44.971207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a6510338-3987-42ad-b9a9-d2bbb155df6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:44.972128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a6510338-3987-42ad-b9a9-d2bbb155df6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:44.978618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6510338-3987-42ad-b9a9-d2bbb155df6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:44.979062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6510338-3987-42ad-b9a9-d2bbb155df6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:44.979818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6510338-3987-42ad-b9a9-d2bbb155df6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:44.980257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6510338-3987-42ad-b9a9-d2bbb155df6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:45.008849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a6510338-3987-42ad-b9a9-d2bbb155df6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041534 Jul 14 09:46:45.009393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 544/1126] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:46:45.044194 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-73d52897-2b04-4136-828c-e656cc10bc38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:45.045041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-73d52897-2b04-4136-828c-e656cc10bc38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:45.050653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73d52897-2b04-4136-828c-e656cc10bc38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:45.051099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73d52897-2b04-4136-828c-e656cc10bc38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:45.051877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73d52897-2b04-4136-828c-e656cc10bc38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:45.052302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73d52897-2b04-4136-828c-e656cc10bc38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:45.081270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-73d52897-2b04-4136-828c-e656cc10bc38 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040659 Jul 14 09:46:45.081800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 545/1127] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:46:45.926728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c06c8f12-778f-41cf-b6bf-68db990c7233 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:45.927328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c06c8f12-778f-41cf-b6bf-68db990c7233 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:45.933331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c06c8f12-778f-41cf-b6bf-68db990c7233 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:45.933764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c06c8f12-778f-41cf-b6bf-68db990c7233 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:45.934820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c06c8f12-778f-41cf-b6bf-68db990c7233 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:45.935501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c06c8f12-778f-41cf-b6bf-68db990c7233 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:46.064129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c06c8f12-778f-41cf-b6bf-68db990c7233 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:46.072066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c06c8f12-778f-41cf-b6bf-68db990c7233 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149207 Jul 14 09:46:46.072622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 546/1128] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:45 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:46.077595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6bb74cf4-7e97-4126-aaa3-db9fadbb535e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:46.078516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6bb74cf4-7e97-4126-aaa3-db9fadbb535e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:46.084259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bb74cf4-7e97-4126-aaa3-db9fadbb535e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:46.084700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bb74cf4-7e97-4126-aaa3-db9fadbb535e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:46.085476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bb74cf4-7e97-4126-aaa3-db9fadbb535e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:46.085929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bb74cf4-7e97-4126-aaa3-db9fadbb535e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:46.114967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6bb74cf4-7e97-4126-aaa3-db9fadbb535e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041315 Jul 14 09:46:46.115519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 547/1129] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:46.120111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1526f84a-c3c1-4609-9435-9062cf9c3c84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:46.121011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1526f84a-c3c1-4609-9435-9062cf9c3c84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:46.126820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1526f84a-c3c1-4609-9435-9062cf9c3c84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:46.127267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1526f84a-c3c1-4609-9435-9062cf9c3c84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:46.128015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1526f84a-c3c1-4609-9435-9062cf9c3c84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:46.128448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1526f84a-c3c1-4609-9435-9062cf9c3c84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:46.157063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1526f84a-c3c1-4609-9435-9062cf9c3c84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040584 Jul 14 09:46:46.157606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 548/1130] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:47.088818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-56a2788b-3f61-41e8-a2fc-fdf51c40c677 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:47.089522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-56a2788b-3f61-41e8-a2fc-fdf51c40c677 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:47.096209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56a2788b-3f61-41e8-a2fc-fdf51c40c677 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:47.096647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56a2788b-3f61-41e8-a2fc-fdf51c40c677 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:47.097392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56a2788b-3f61-41e8-a2fc-fdf51c40c677 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:47.097818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56a2788b-3f61-41e8-a2fc-fdf51c40c677 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:47.228431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-56a2788b-3f61-41e8-a2fc-fdf51c40c677 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:47.235889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-56a2788b-3f61-41e8-a2fc-fdf51c40c677 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150956 Jul 14 09:46:47.236937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 549/1131] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:47 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:47.242128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fabbc65b-507a-4f19-a1ef-e1761c001976 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:47.243051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fabbc65b-507a-4f19-a1ef-e1761c001976 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:47.249180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fabbc65b-507a-4f19-a1ef-e1761c001976 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:47.249620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fabbc65b-507a-4f19-a1ef-e1761c001976 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:47.250402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fabbc65b-507a-4f19-a1ef-e1761c001976 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:47.250835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fabbc65b-507a-4f19-a1ef-e1761c001976 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:47.254387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:47.279301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fabbc65b-507a-4f19-a1ef-e1761c001976 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041379 Jul 14 09:46:47.279846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 550/1132] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:47.284580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43308c46-9bb4-4973-a4fb-67e36bcf7415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:47.285833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-43308c46-9bb4-4973-a4fb-67e36bcf7415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:47.291472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43308c46-9bb4-4973-a4fb-67e36bcf7415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:47.291913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43308c46-9bb4-4973-a4fb-67e36bcf7415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:47.292659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43308c46-9bb4-4973-a4fb-67e36bcf7415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:47.293091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43308c46-9bb4-4973-a4fb-67e36bcf7415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:47.321283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-43308c46-9bb4-4973-a4fb-67e36bcf7415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040495 Jul 14 09:46:47.321817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 551/1133] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:48.253883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0881f969-7811-4081-b7b9-642cbbbce4d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:48.254659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0881f969-7811-4081-b7b9-642cbbbce4d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:48.261042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0881f969-7811-4081-b7b9-642cbbbce4d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:48.261477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0881f969-7811-4081-b7b9-642cbbbce4d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:48.262257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0881f969-7811-4081-b7b9-642cbbbce4d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:48.262695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0881f969-7811-4081-b7b9-642cbbbce4d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:48.391043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0881f969-7811-4081-b7b9-642cbbbce4d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:48.398504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0881f969-7811-4081-b7b9-642cbbbce4d9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148534 Jul 14 09:46:48.399065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 552/1134] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:48 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:48.403554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-52420794-4d42-4c00-be45-8f9483a1c850 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:48.404452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-52420794-4d42-4c00-be45-8f9483a1c850 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:48.409958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52420794-4d42-4c00-be45-8f9483a1c850 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:48.410428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52420794-4d42-4c00-be45-8f9483a1c850 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:48.411177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52420794-4d42-4c00-be45-8f9483a1c850 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:48.411606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52420794-4d42-4c00-be45-8f9483a1c850 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:48.443078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-52420794-4d42-4c00-be45-8f9483a1c850 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Jul 14 09:46:48.443628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 553/1135] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:48.448348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4954314a-4572-4306-b6f5-84a0535b8749 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:48.449238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4954314a-4572-4306-b6f5-84a0535b8749 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:48.454799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4954314a-4572-4306-b6f5-84a0535b8749 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:48.455240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4954314a-4572-4306-b6f5-84a0535b8749 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:48.455982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4954314a-4572-4306-b6f5-84a0535b8749 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:48.456404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4954314a-4572-4306-b6f5-84a0535b8749 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:48.485147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4954314a-4572-4306-b6f5-84a0535b8749 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040282 Jul 14 09:46:48.485691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 554/1136] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:49.415661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a169242f-cafb-4cd6-b218-ddf358cd53e6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:49.416345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a169242f-cafb-4cd6-b218-ddf358cd53e6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:49.423319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a169242f-cafb-4cd6-b218-ddf358cd53e6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:49.423755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a169242f-cafb-4cd6-b218-ddf358cd53e6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:49.424495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a169242f-cafb-4cd6-b218-ddf358cd53e6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:49.424914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a169242f-cafb-4cd6-b218-ddf358cd53e6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:49.552801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a169242f-cafb-4cd6-b218-ddf358cd53e6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:49.560450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a169242f-cafb-4cd6-b218-ddf358cd53e6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148826 Jul 14 09:46:49.561015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 555/1137] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:49 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:49.565541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-23be974c-b4bf-40ab-ab88-00d479e27206 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:49.566461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-23be974c-b4bf-40ab-ab88-00d479e27206 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:49.572380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23be974c-b4bf-40ab-ab88-00d479e27206 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:49.572818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23be974c-b4bf-40ab-ab88-00d479e27206 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:49.573573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23be974c-b4bf-40ab-ab88-00d479e27206 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:49.574000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23be974c-b4bf-40ab-ab88-00d479e27206 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:49.602524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-23be974c-b4bf-40ab-ab88-00d479e27206 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040513 Jul 14 09:46:49.603059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 556/1138] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:49.607417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dcc31b3c-a8f9-427f-91ca-4238dea31101 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:49.608281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dcc31b3c-a8f9-427f-91ca-4238dea31101 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:49.613649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dcc31b3c-a8f9-427f-91ca-4238dea31101 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:49.614087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dcc31b3c-a8f9-427f-91ca-4238dea31101 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:49.614860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dcc31b3c-a8f9-427f-91ca-4238dea31101 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:49.615289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dcc31b3c-a8f9-427f-91ca-4238dea31101 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:49.652756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dcc31b3c-a8f9-427f-91ca-4238dea31101 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048671 Jul 14 09:46:49.653847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 557/1139] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:50.050325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=71 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:50.074513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=42 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:50.578106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c835059f-8d64-4766-8bd2-4a4817a33f66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:50.578740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c835059f-8d64-4766-8bd2-4a4817a33f66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:50.585316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c835059f-8d64-4766-8bd2-4a4817a33f66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:50.585748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c835059f-8d64-4766-8bd2-4a4817a33f66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:50.586524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c835059f-8d64-4766-8bd2-4a4817a33f66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:50.586949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c835059f-8d64-4766-8bd2-4a4817a33f66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:50.720561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c835059f-8d64-4766-8bd2-4a4817a33f66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:50.728061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c835059f-8d64-4766-8bd2-4a4817a33f66 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154314 Jul 14 09:46:50.728622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 558/1140] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:50 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:50.733132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d7148054-968d-41b9-8e39-ce70cdcb7d9f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:50.734025 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d7148054-968d-41b9-8e39-ce70cdcb7d9f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:50.739740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7148054-968d-41b9-8e39-ce70cdcb7d9f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:50.740191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7148054-968d-41b9-8e39-ce70cdcb7d9f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:50.741116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7148054-968d-41b9-8e39-ce70cdcb7d9f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:50.741543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7148054-968d-41b9-8e39-ce70cdcb7d9f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:50.770337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d7148054-968d-41b9-8e39-ce70cdcb7d9f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040653 Jul 14 09:46:50.770813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 559/1141] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:50.775268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a48751c3-f5ec-4184-a8ae-9e8a4a217350 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:50.776147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a48751c3-f5ec-4184-a8ae-9e8a4a217350 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:50.781646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a48751c3-f5ec-4184-a8ae-9e8a4a217350 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:50.782082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a48751c3-f5ec-4184-a8ae-9e8a4a217350 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:50.782867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a48751c3-f5ec-4184-a8ae-9e8a4a217350 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:50.783289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a48751c3-f5ec-4184-a8ae-9e8a4a217350 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:50.811436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a48751c3-f5ec-4184-a8ae-9e8a4a217350 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039664 Jul 14 09:46:50.811977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 560/1142] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:51.745090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0f20ee81-b195-402a-b974-0f065d552964 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:51.745721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0f20ee81-b195-402a-b974-0f065d552964 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:51.752207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0f20ee81-b195-402a-b974-0f065d552964 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:51.752646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0f20ee81-b195-402a-b974-0f065d552964 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:51.753395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0f20ee81-b195-402a-b974-0f065d552964 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:51.753824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0f20ee81-b195-402a-b974-0f065d552964 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:51.882017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0f20ee81-b195-402a-b974-0f065d552964 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:51.890045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0f20ee81-b195-402a-b974-0f065d552964 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148840 Jul 14 09:46:51.890632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 561/1143] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:51 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:51.895071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-af9aa783-f600-446b-ae87-ab0d67baf9af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:51.895974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af9aa783-f600-446b-ae87-ab0d67baf9af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:51.901418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af9aa783-f600-446b-ae87-ab0d67baf9af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:51.901861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af9aa783-f600-446b-ae87-ab0d67baf9af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:51.903338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af9aa783-f600-446b-ae87-ab0d67baf9af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:51.903825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af9aa783-f600-446b-ae87-ab0d67baf9af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:51.931183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-af9aa783-f600-446b-ae87-ab0d67baf9af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039566 Jul 14 09:46:51.931730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 562/1144] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:51.936284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9c545f49-2c1a-432a-b994-3728a53f82f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:51.937174 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9c545f49-2c1a-432a-b994-3728a53f82f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:51.942857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c545f49-2c1a-432a-b994-3728a53f82f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:51.943294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c545f49-2c1a-432a-b994-3728a53f82f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:51.944311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c545f49-2c1a-432a-b994-3728a53f82f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:51.944739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c545f49-2c1a-432a-b994-3728a53f82f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:51.974485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9c545f49-2c1a-432a-b994-3728a53f82f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041676 Jul 14 09:46:51.975034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 563/1145] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:52.907670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cd3491f9-eb7c-40f2-a937-31a05983deec tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:52.908308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cd3491f9-eb7c-40f2-a937-31a05983deec tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:52.914810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd3491f9-eb7c-40f2-a937-31a05983deec tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:52.915253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd3491f9-eb7c-40f2-a937-31a05983deec tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:52.916013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd3491f9-eb7c-40f2-a937-31a05983deec tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:52.916444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd3491f9-eb7c-40f2-a937-31a05983deec tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:53.050764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cd3491f9-eb7c-40f2-a937-31a05983deec tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:53.058105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cd3491f9-eb7c-40f2-a937-31a05983deec tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154391 Jul 14 09:46:53.058681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 564/1146] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:52 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:53.063745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f7b1cb6-426b-41b5-b3a0-5d136015cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:53.064639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f7b1cb6-426b-41b5-b3a0-5d136015cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:53.070477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7b1cb6-426b-41b5-b3a0-5d136015cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:53.070914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7b1cb6-426b-41b5-b3a0-5d136015cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:53.071657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7b1cb6-426b-41b5-b3a0-5d136015cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:53.072078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7b1cb6-426b-41b5-b3a0-5d136015cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:53.100084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f7b1cb6-426b-41b5-b3a0-5d136015cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039809 Jul 14 09:46:53.100547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 565/1147] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:53 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:53.105065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0fd79b6d-eb49-4521-8aa1-db8e3862f193 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:53.105954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0fd79b6d-eb49-4521-8aa1-db8e3862f193 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:53.111372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0fd79b6d-eb49-4521-8aa1-db8e3862f193 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:53.111810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0fd79b6d-eb49-4521-8aa1-db8e3862f193 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:53.112544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0fd79b6d-eb49-4521-8aa1-db8e3862f193 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:53.112963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0fd79b6d-eb49-4521-8aa1-db8e3862f193 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:53.136829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:46:53.142220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0fd79b6d-eb49-4521-8aa1-db8e3862f193 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040704 Jul 14 09:46:53.142759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 566/1148] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:54.076280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4efb337a-bae8-44ca-8764-f05be43483cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:54.076990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4efb337a-bae8-44ca-8764-f05be43483cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:54.083529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4efb337a-bae8-44ca-8764-f05be43483cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:54.083968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4efb337a-bae8-44ca-8764-f05be43483cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:54.084714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4efb337a-bae8-44ca-8764-f05be43483cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:54.085140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4efb337a-bae8-44ca-8764-f05be43483cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:54.213878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4efb337a-bae8-44ca-8764-f05be43483cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:54.221975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4efb337a-bae8-44ca-8764-f05be43483cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150093 Jul 14 09:46:54.222561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 567/1149] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:54 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:54.227106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8c2b0eff-c036-431d-912d-809de20b15bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:54.228010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8c2b0eff-c036-431d-912d-809de20b15bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:54.233564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c2b0eff-c036-431d-912d-809de20b15bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:54.234000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c2b0eff-c036-431d-912d-809de20b15bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:54.234785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c2b0eff-c036-431d-912d-809de20b15bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:54.235214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c2b0eff-c036-431d-912d-809de20b15bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:54.263046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8c2b0eff-c036-431d-912d-809de20b15bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039464 Jul 14 09:46:54.263578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 568/1150] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:54.267916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c1bd8075-4d61-4b03-8867-aba8b513356c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:54.268772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c1bd8075-4d61-4b03-8867-aba8b513356c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:54.274202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1bd8075-4d61-4b03-8867-aba8b513356c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:54.274654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1bd8075-4d61-4b03-8867-aba8b513356c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:54.275391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1bd8075-4d61-4b03-8867-aba8b513356c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:54.275820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1bd8075-4d61-4b03-8867-aba8b513356c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:54.304644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c1bd8075-4d61-4b03-8867-aba8b513356c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040101 Jul 14 09:46:54.305175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 569/1151] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:55.238700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0ca976e0-7b7d-4a24-8ecd-03b3c1002b41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:55.239352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0ca976e0-7b7d-4a24-8ecd-03b3c1002b41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:55.245784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ca976e0-7b7d-4a24-8ecd-03b3c1002b41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:55.246250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ca976e0-7b7d-4a24-8ecd-03b3c1002b41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:55.247048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ca976e0-7b7d-4a24-8ecd-03b3c1002b41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:55.247480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ca976e0-7b7d-4a24-8ecd-03b3c1002b41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:55.381047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0ca976e0-7b7d-4a24-8ecd-03b3c1002b41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:55.388540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0ca976e0-7b7d-4a24-8ecd-03b3c1002b41 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153685 Jul 14 09:46:55.389085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 570/1152] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:55 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:55.393537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-843bc579-581e-4434-ad65-e768874bcc9d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:55.394455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-843bc579-581e-4434-ad65-e768874bcc9d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:55.400382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-843bc579-581e-4434-ad65-e768874bcc9d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:55.400828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-843bc579-581e-4434-ad65-e768874bcc9d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:55.401584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-843bc579-581e-4434-ad65-e768874bcc9d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:55.402009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-843bc579-581e-4434-ad65-e768874bcc9d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:55.431761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-843bc579-581e-4434-ad65-e768874bcc9d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 Jul 14 09:46:55.432312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 571/1153] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:55.436787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c30f6ed5-9ac7-4e28-a915-f094353c3309 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:55.437679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c30f6ed5-9ac7-4e28-a915-f094353c3309 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:55.443295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c30f6ed5-9ac7-4e28-a915-f094353c3309 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:55.443989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c30f6ed5-9ac7-4e28-a915-f094353c3309 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:55.444738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c30f6ed5-9ac7-4e28-a915-f094353c3309 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:55.445166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c30f6ed5-9ac7-4e28-a915-f094353c3309 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:55.473789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c30f6ed5-9ac7-4e28-a915-f094353c3309 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040496 Jul 14 09:46:55.474361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 572/1154] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:56.406331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-79d53239-89bb-42e7-b74f-6e97f2725809 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:56.407001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-79d53239-89bb-42e7-b74f-6e97f2725809 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:56.413416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79d53239-89bb-42e7-b74f-6e97f2725809 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:56.413860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79d53239-89bb-42e7-b74f-6e97f2725809 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:56.414645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79d53239-89bb-42e7-b74f-6e97f2725809 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:56.415080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-79d53239-89bb-42e7-b74f-6e97f2725809 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:56.544218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-79d53239-89bb-42e7-b74f-6e97f2725809 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:56.551685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-79d53239-89bb-42e7-b74f-6e97f2725809 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149769 Jul 14 09:46:56.552248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 573/1155] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:56 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:56.556787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9a8eb564-5607-4914-8cf0-a5f7d61b4240 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:56.557703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9a8eb564-5607-4914-8cf0-a5f7d61b4240 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:56.563560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a8eb564-5607-4914-8cf0-a5f7d61b4240 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:56.563999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a8eb564-5607-4914-8cf0-a5f7d61b4240 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:56.564752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a8eb564-5607-4914-8cf0-a5f7d61b4240 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:56.565179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a8eb564-5607-4914-8cf0-a5f7d61b4240 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:56.593762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9a8eb564-5607-4914-8cf0-a5f7d61b4240 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040551 Jul 14 09:46:56.594331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 574/1156] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:56.598761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-efe63c67-d991-4796-ba68-0a3205b2ecf9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:56.599630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-efe63c67-d991-4796-ba68-0a3205b2ecf9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:56.605058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efe63c67-d991-4796-ba68-0a3205b2ecf9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:56.605499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efe63c67-d991-4796-ba68-0a3205b2ecf9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:56.606301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efe63c67-d991-4796-ba68-0a3205b2ecf9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:56.606729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efe63c67-d991-4796-ba68-0a3205b2ecf9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:56.633916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-efe63c67-d991-4796-ba68-0a3205b2ecf9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038644 Jul 14 09:46:56.634479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 575/1157] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:57.568842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-632ec3d3-dc28-488d-8789-aabecdacbc8e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:57.569454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-632ec3d3-dc28-488d-8789-aabecdacbc8e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:57.576054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-632ec3d3-dc28-488d-8789-aabecdacbc8e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:57.576498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-632ec3d3-dc28-488d-8789-aabecdacbc8e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:57.577277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-632ec3d3-dc28-488d-8789-aabecdacbc8e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:57.577707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-632ec3d3-dc28-488d-8789-aabecdacbc8e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:57.706390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-632ec3d3-dc28-488d-8789-aabecdacbc8e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:57.713876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-632ec3d3-dc28-488d-8789-aabecdacbc8e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149155 Jul 14 09:46:57.714461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 576/1158] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:57 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:57.719447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e4e20e15-f570-4ef2-acfa-3a30d57afa49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:57.720346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e4e20e15-f570-4ef2-acfa-3a30d57afa49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:57.725964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e20e15-f570-4ef2-acfa-3a30d57afa49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:57.726467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e20e15-f570-4ef2-acfa-3a30d57afa49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:57.727217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e20e15-f570-4ef2-acfa-3a30d57afa49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:57.727645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e20e15-f570-4ef2-acfa-3a30d57afa49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:57.756486 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e4e20e15-f570-4ef2-acfa-3a30d57afa49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040553 Jul 14 09:46:57.757030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 577/1159] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:57.761406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-73a3611f-cee6-459b-b41f-6bb267a48f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:57.762305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-73a3611f-cee6-459b-b41f-6bb267a48f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:57.767749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73a3611f-cee6-459b-b41f-6bb267a48f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:57.768220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73a3611f-cee6-459b-b41f-6bb267a48f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:57.768964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73a3611f-cee6-459b-b41f-6bb267a48f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:57.769395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73a3611f-cee6-459b-b41f-6bb267a48f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:57.797893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-73a3611f-cee6-459b-b41f-6bb267a48f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039901 Jul 14 09:46:57.798467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 578/1160] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:58.731870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-85c3bc45-b6d8-4bc0-948f-0167a34e557c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:58.732539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-85c3bc45-b6d8-4bc0-948f-0167a34e557c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:58.739277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85c3bc45-b6d8-4bc0-948f-0167a34e557c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:58.739728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85c3bc45-b6d8-4bc0-948f-0167a34e557c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:58.740496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85c3bc45-b6d8-4bc0-948f-0167a34e557c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:58.740946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85c3bc45-b6d8-4bc0-948f-0167a34e557c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:58.873708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-85c3bc45-b6d8-4bc0-948f-0167a34e557c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:46:58.881151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-85c3bc45-b6d8-4bc0-948f-0167a34e557c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153711 Jul 14 09:46:58.881709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 579/1161] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:58 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:46:58.886138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6d81133d-659d-4945-b701-9b65b4f76c94 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:58.887060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6d81133d-659d-4945-b701-9b65b4f76c94 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:58.892561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6d81133d-659d-4945-b701-9b65b4f76c94 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:58.893010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6d81133d-659d-4945-b701-9b65b4f76c94 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:58.893764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6d81133d-659d-4945-b701-9b65b4f76c94 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:58.894240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6d81133d-659d-4945-b701-9b65b4f76c94 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:58.922440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6d81133d-659d-4945-b701-9b65b4f76c94 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039662 Jul 14 09:46:58.922983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 580/1162] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:46:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:46:58.927382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e5b3b2ac-8d98-42bb-810a-4548bb801232 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:58.928257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e5b3b2ac-8d98-42bb-810a-4548bb801232 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:58.934347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5b3b2ac-8d98-42bb-810a-4548bb801232 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:58.934798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5b3b2ac-8d98-42bb-810a-4548bb801232 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:58.935580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5b3b2ac-8d98-42bb-810a-4548bb801232 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:58.936007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5b3b2ac-8d98-42bb-810a-4548bb801232 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:58.963564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e5b3b2ac-8d98-42bb-810a-4548bb801232 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039608 Jul 14 09:46:58.964092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 581/1163] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:46:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:46:59.898178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ba9b385f-23e3-4192-ba1d-81fc3b43da77 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:46:59.899481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ba9b385f-23e3-4192-ba1d-81fc3b43da77 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:46:59.906984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba9b385f-23e3-4192-ba1d-81fc3b43da77 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:59.907430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba9b385f-23e3-4192-ba1d-81fc3b43da77 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:46:59.908196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba9b385f-23e3-4192-ba1d-81fc3b43da77 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:46:59.908629 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba9b385f-23e3-4192-ba1d-81fc3b43da77 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:00.042087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ba9b385f-23e3-4192-ba1d-81fc3b43da77 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:00.051309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ba9b385f-23e3-4192-ba1d-81fc3b43da77 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.157017 Jul 14 09:47:00.051884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 582/1164] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:46:59 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:00.056821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fe1287de-cd29-47a5-82df-79df185009d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:00.057744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fe1287de-cd29-47a5-82df-79df185009d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:00.063758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe1287de-cd29-47a5-82df-79df185009d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:00.064201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe1287de-cd29-47a5-82df-79df185009d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:00.064995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe1287de-cd29-47a5-82df-79df185009d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:00.065430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe1287de-cd29-47a5-82df-79df185009d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:00.083813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:00.097199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fe1287de-cd29-47a5-82df-79df185009d3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Jul 14 09:47:00.097754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 583/1165] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:00 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:00.102287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-85376631-5cf3-4a43-8565-be492cf90243 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:00.103185 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-85376631-5cf3-4a43-8565-be492cf90243 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:00.108978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85376631-5cf3-4a43-8565-be492cf90243 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:00.109428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85376631-5cf3-4a43-8565-be492cf90243 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:00.110243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85376631-5cf3-4a43-8565-be492cf90243 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:00.110692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-85376631-5cf3-4a43-8565-be492cf90243 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:00.139275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-85376631-5cf3-4a43-8565-be492cf90243 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040494 Jul 14 09:47:00.139824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 584/1166] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:01.068790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-56bf83db-14ea-4d23-a24e-e2fbcde8713c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:01.069429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-56bf83db-14ea-4d23-a24e-e2fbcde8713c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:01.075990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56bf83db-14ea-4d23-a24e-e2fbcde8713c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:01.076425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56bf83db-14ea-4d23-a24e-e2fbcde8713c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:01.077170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56bf83db-14ea-4d23-a24e-e2fbcde8713c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:01.077594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56bf83db-14ea-4d23-a24e-e2fbcde8713c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:01.208188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-56bf83db-14ea-4d23-a24e-e2fbcde8713c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:01.216109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-56bf83db-14ea-4d23-a24e-e2fbcde8713c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151445 Jul 14 09:47:01.216665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 585/1167] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:01 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:01.221127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ce1bb12d-bd65-441c-9ff5-7481bafa0149 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:01.222010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ce1bb12d-bd65-441c-9ff5-7481bafa0149 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:01.227565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce1bb12d-bd65-441c-9ff5-7481bafa0149 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:01.227999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce1bb12d-bd65-441c-9ff5-7481bafa0149 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:01.228739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce1bb12d-bd65-441c-9ff5-7481bafa0149 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:01.229170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce1bb12d-bd65-441c-9ff5-7481bafa0149 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:01.256846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ce1bb12d-bd65-441c-9ff5-7481bafa0149 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039230 Jul 14 09:47:01.257379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 586/1168] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:01.261841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-186cf2e3-d17b-4909-8568-626eb2c40690 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:01.262720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-186cf2e3-d17b-4909-8568-626eb2c40690 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:01.264227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:01.269250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-186cf2e3-d17b-4909-8568-626eb2c40690 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:01.269682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-186cf2e3-d17b-4909-8568-626eb2c40690 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:01.270448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-186cf2e3-d17b-4909-8568-626eb2c40690 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:01.270872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-186cf2e3-d17b-4909-8568-626eb2c40690 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:01.299951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-186cf2e3-d17b-4909-8568-626eb2c40690 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041558 Jul 14 09:47:01.300662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 587/1169] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:02.233906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d59151c4-36a9-4b27-b4bb-720ea905b154 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:02.234636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d59151c4-36a9-4b27-b4bb-720ea905b154 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:02.240717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d59151c4-36a9-4b27-b4bb-720ea905b154 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:02.241159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d59151c4-36a9-4b27-b4bb-720ea905b154 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:02.241908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d59151c4-36a9-4b27-b4bb-720ea905b154 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:02.242376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d59151c4-36a9-4b27-b4bb-720ea905b154 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:02.374827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d59151c4-36a9-4b27-b4bb-720ea905b154 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:02.383706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d59151c4-36a9-4b27-b4bb-720ea905b154 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154502 Jul 14 09:47:02.384270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 588/1170] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:02 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:02.390429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7310f732-e316-4190-9db8-ef370b9c2924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:02.391334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7310f732-e316-4190-9db8-ef370b9c2924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:02.397173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7310f732-e316-4190-9db8-ef370b9c2924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:02.397611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7310f732-e316-4190-9db8-ef370b9c2924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:02.398380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7310f732-e316-4190-9db8-ef370b9c2924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:02.398802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7310f732-e316-4190-9db8-ef370b9c2924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:02.427203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7310f732-e316-4190-9db8-ef370b9c2924 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041053 Jul 14 09:47:02.427750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 589/1171] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:02 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:02.432155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-519b9c86-e746-4a44-a11d-4bafc223a746 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:02.433028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-519b9c86-e746-4a44-a11d-4bafc223a746 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:02.439292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-519b9c86-e746-4a44-a11d-4bafc223a746 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:02.439736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-519b9c86-e746-4a44-a11d-4bafc223a746 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:02.440473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-519b9c86-e746-4a44-a11d-4bafc223a746 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:02.440896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-519b9c86-e746-4a44-a11d-4bafc223a746 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:02.468616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-519b9c86-e746-4a44-a11d-4bafc223a746 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039924 Jul 14 09:47:02.469145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 590/1172] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:03.400602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5a91917c-18ff-418e-af0c-cc1e58602bbb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:03.401298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5a91917c-18ff-418e-af0c-cc1e58602bbb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:03.408340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a91917c-18ff-418e-af0c-cc1e58602bbb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:03.408784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a91917c-18ff-418e-af0c-cc1e58602bbb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:03.409537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a91917c-18ff-418e-af0c-cc1e58602bbb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:03.409974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a91917c-18ff-418e-af0c-cc1e58602bbb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:03.535744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5a91917c-18ff-418e-af0c-cc1e58602bbb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:03.543209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5a91917c-18ff-418e-af0c-cc1e58602bbb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146468 Jul 14 09:47:03.543762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 591/1173] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:03 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:03.548154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dd961b70-7c9b-49c3-81ef-2e92bbf6d58b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:03.549051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dd961b70-7c9b-49c3-81ef-2e92bbf6d58b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:03.554489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd961b70-7c9b-49c3-81ef-2e92bbf6d58b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:03.554927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd961b70-7c9b-49c3-81ef-2e92bbf6d58b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:03.555677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd961b70-7c9b-49c3-81ef-2e92bbf6d58b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:03.556100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd961b70-7c9b-49c3-81ef-2e92bbf6d58b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:03.585167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dd961b70-7c9b-49c3-81ef-2e92bbf6d58b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040435 Jul 14 09:47:03.585727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 592/1174] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:03 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:03.590154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f9b74bf-d03d-4258-aef4-dbfc201d12d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:03.591051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f9b74bf-d03d-4258-aef4-dbfc201d12d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:03.596583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f9b74bf-d03d-4258-aef4-dbfc201d12d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:03.597021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f9b74bf-d03d-4258-aef4-dbfc201d12d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:03.597760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f9b74bf-d03d-4258-aef4-dbfc201d12d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:03.598181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f9b74bf-d03d-4258-aef4-dbfc201d12d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:03.625656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f9b74bf-d03d-4258-aef4-dbfc201d12d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038939 Jul 14 09:47:03.626207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 593/1175] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:04.560572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-da6c649e-2aa2-4811-9190-17c565ecbebf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:04.561171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-da6c649e-2aa2-4811-9190-17c565ecbebf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:04.567677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da6c649e-2aa2-4811-9190-17c565ecbebf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:04.568114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da6c649e-2aa2-4811-9190-17c565ecbebf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:04.569129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da6c649e-2aa2-4811-9190-17c565ecbebf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:04.569553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da6c649e-2aa2-4811-9190-17c565ecbebf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:04.700110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-da6c649e-2aa2-4811-9190-17c565ecbebf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:04.708007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-da6c649e-2aa2-4811-9190-17c565ecbebf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151615 Jul 14 09:47:04.708560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 594/1176] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:04 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:04.713018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-52f2c5a8-6709-41c7-a40a-bea371747c41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:04.713912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-52f2c5a8-6709-41c7-a40a-bea371747c41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:04.720072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52f2c5a8-6709-41c7-a40a-bea371747c41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:04.720513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52f2c5a8-6709-41c7-a40a-bea371747c41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:04.721268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52f2c5a8-6709-41c7-a40a-bea371747c41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:04.721694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52f2c5a8-6709-41c7-a40a-bea371747c41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:04.749230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-52f2c5a8-6709-41c7-a40a-bea371747c41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039698 Jul 14 09:47:04.749770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 595/1177] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:04.754161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e9d09ad2-bdcb-4802-8361-93d133444ae4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:04.755069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e9d09ad2-bdcb-4802-8361-93d133444ae4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:04.760512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9d09ad2-bdcb-4802-8361-93d133444ae4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:04.760960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9d09ad2-bdcb-4802-8361-93d133444ae4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:04.761704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9d09ad2-bdcb-4802-8361-93d133444ae4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:04.762130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9d09ad2-bdcb-4802-8361-93d133444ae4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:04.790541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e9d09ad2-bdcb-4802-8361-93d133444ae4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039685 Jul 14 09:47:04.791011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 596/1178] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:05.725563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7d2a2e95-5691-4def-b391-e132b5bc333f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:05.726220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7d2a2e95-5691-4def-b391-e132b5bc333f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:05.733424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d2a2e95-5691-4def-b391-e132b5bc333f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:05.733868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d2a2e95-5691-4def-b391-e132b5bc333f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:05.734649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d2a2e95-5691-4def-b391-e132b5bc333f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:05.735088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d2a2e95-5691-4def-b391-e132b5bc333f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:05.862786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7d2a2e95-5691-4def-b391-e132b5bc333f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:05.870545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7d2a2e95-5691-4def-b391-e132b5bc333f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148834 Jul 14 09:47:05.871113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 597/1179] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:05 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:05.875629 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-72d4b61e-3af9-4675-b8e5-46e4f6bdf449 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:05.876526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-72d4b61e-3af9-4675-b8e5-46e4f6bdf449 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:05.882110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72d4b61e-3af9-4675-b8e5-46e4f6bdf449 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:05.882582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72d4b61e-3af9-4675-b8e5-46e4f6bdf449 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:05.883334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72d4b61e-3af9-4675-b8e5-46e4f6bdf449 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:05.883770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72d4b61e-3af9-4675-b8e5-46e4f6bdf449 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:05.912404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-72d4b61e-3af9-4675-b8e5-46e4f6bdf449 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040326 Jul 14 09:47:05.912933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 598/1180] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:05.917275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4b38892f-0bd0-47e3-af62-42e30e263fd3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:05.918136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4b38892f-0bd0-47e3-af62-42e30e263fd3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:05.924396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b38892f-0bd0-47e3-af62-42e30e263fd3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:05.924837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b38892f-0bd0-47e3-af62-42e30e263fd3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:05.925592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b38892f-0bd0-47e3-af62-42e30e263fd3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:05.926018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b38892f-0bd0-47e3-af62-42e30e263fd3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:05.954011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4b38892f-0bd0-47e3-af62-42e30e263fd3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040137 Jul 14 09:47:05.954580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 599/1181] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:06.887281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bcdfe241-8e47-4ce1-8f39-d77dff642120 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:06.887939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bcdfe241-8e47-4ce1-8f39-d77dff642120 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:06.894245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcdfe241-8e47-4ce1-8f39-d77dff642120 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:06.894686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcdfe241-8e47-4ce1-8f39-d77dff642120 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:06.895432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcdfe241-8e47-4ce1-8f39-d77dff642120 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:06.895856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcdfe241-8e47-4ce1-8f39-d77dff642120 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:06.899647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:07.026324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bcdfe241-8e47-4ce1-8f39-d77dff642120 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:07.033786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bcdfe241-8e47-4ce1-8f39-d77dff642120 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150480 Jul 14 09:47:07.034395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 600/1182] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:06 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:07.038888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ada863a1-bdac-438a-8604-19af2cda045e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:07.039796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ada863a1-bdac-438a-8604-19af2cda045e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:07.045352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada863a1-bdac-438a-8604-19af2cda045e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:07.046339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada863a1-bdac-438a-8604-19af2cda045e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:07.047098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada863a1-bdac-438a-8604-19af2cda045e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:07.047533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada863a1-bdac-438a-8604-19af2cda045e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:07.076198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ada863a1-bdac-438a-8604-19af2cda045e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040829 Jul 14 09:47:07.076745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 601/1183] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:07.081180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c81682b1-86da-4fc3-b8e1-ff5b3dd178a8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:07.082058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c81682b1-86da-4fc3-b8e1-ff5b3dd178a8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:07.087620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c81682b1-86da-4fc3-b8e1-ff5b3dd178a8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:07.088065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c81682b1-86da-4fc3-b8e1-ff5b3dd178a8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:07.088818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c81682b1-86da-4fc3-b8e1-ff5b3dd178a8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:07.089250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c81682b1-86da-4fc3-b8e1-ff5b3dd178a8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:07.117496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c81682b1-86da-4fc3-b8e1-ff5b3dd178a8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039788 Jul 14 09:47:07.118047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 602/1184] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:08.050967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-42c55e5b-5df4-43c0-8161-c07489f2c247 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:08.051632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-42c55e5b-5df4-43c0-8161-c07489f2c247 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:08.058165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42c55e5b-5df4-43c0-8161-c07489f2c247 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:08.058642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42c55e5b-5df4-43c0-8161-c07489f2c247 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:08.059392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42c55e5b-5df4-43c0-8161-c07489f2c247 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:08.059824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42c55e5b-5df4-43c0-8161-c07489f2c247 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:08.187423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-42c55e5b-5df4-43c0-8161-c07489f2c247 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:08.195092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-42c55e5b-5df4-43c0-8161-c07489f2c247 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148020 Jul 14 09:47:08.195647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 603/1185] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:08 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:08.200112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e334f3b2-f4fb-4928-bf15-0266cddb881a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:08.201010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e334f3b2-f4fb-4928-bf15-0266cddb881a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:08.207193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e334f3b2-f4fb-4928-bf15-0266cddb881a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:08.207661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e334f3b2-f4fb-4928-bf15-0266cddb881a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:08.208414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e334f3b2-f4fb-4928-bf15-0266cddb881a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:08.208839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e334f3b2-f4fb-4928-bf15-0266cddb881a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:08.236683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e334f3b2-f4fb-4928-bf15-0266cddb881a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040078 Jul 14 09:47:08.237217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 604/1186] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:08.241692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a1af685d-f9dc-4448-ad89-ad266edfa603 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:08.242594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a1af685d-f9dc-4448-ad89-ad266edfa603 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:08.248138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a1af685d-f9dc-4448-ad89-ad266edfa603 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:08.248581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a1af685d-f9dc-4448-ad89-ad266edfa603 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:08.249921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a1af685d-f9dc-4448-ad89-ad266edfa603 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:08.250385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a1af685d-f9dc-4448-ad89-ad266edfa603 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:08.278112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a1af685d-f9dc-4448-ad89-ad266edfa603 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039941 Jul 14 09:47:08.278683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 605/1187] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:09.213031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c3c03b8a-8d73-470f-af48-cb58f1145f5f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:09.213754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c3c03b8a-8d73-470f-af48-cb58f1145f5f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:09.220156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3c03b8a-8d73-470f-af48-cb58f1145f5f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:09.220597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3c03b8a-8d73-470f-af48-cb58f1145f5f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:09.221345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3c03b8a-8d73-470f-af48-cb58f1145f5f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:09.221771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3c03b8a-8d73-470f-af48-cb58f1145f5f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:09.352483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c3c03b8a-8d73-470f-af48-cb58f1145f5f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:09.360473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c3c03b8a-8d73-470f-af48-cb58f1145f5f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151398 Jul 14 09:47:09.361030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 606/1188] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:09 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:09.365475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c0df4376-5b07-4d87-9882-f18f795f50f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:09.366405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c0df4376-5b07-4d87-9882-f18f795f50f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:09.371998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0df4376-5b07-4d87-9882-f18f795f50f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:09.372439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0df4376-5b07-4d87-9882-f18f795f50f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:09.373189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0df4376-5b07-4d87-9882-f18f795f50f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:09.374273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0df4376-5b07-4d87-9882-f18f795f50f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:09.401777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c0df4376-5b07-4d87-9882-f18f795f50f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039773 Jul 14 09:47:09.402347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 607/1189] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:09.407223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-754e7109-ff3c-4b56-9571-2965a5f47a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:09.408094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-754e7109-ff3c-4b56-9571-2965a5f47a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:09.413490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-754e7109-ff3c-4b56-9571-2965a5f47a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:09.413931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-754e7109-ff3c-4b56-9571-2965a5f47a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:09.414721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-754e7109-ff3c-4b56-9571-2965a5f47a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:09.415155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-754e7109-ff3c-4b56-9571-2965a5f47a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:09.450048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-754e7109-ff3c-4b56-9571-2965a5f47a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046684 Jul 14 09:47:09.450625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 608/1190] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:09 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:10.378217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef439492-cbcb-447a-b469-8ebca13953be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:10.378882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ef439492-cbcb-447a-b469-8ebca13953be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:10.385252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef439492-cbcb-447a-b469-8ebca13953be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:10.385717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef439492-cbcb-447a-b469-8ebca13953be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:10.386493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef439492-cbcb-447a-b469-8ebca13953be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:10.386913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef439492-cbcb-447a-b469-8ebca13953be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:10.520764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ef439492-cbcb-447a-b469-8ebca13953be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:10.529564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ef439492-cbcb-447a-b469-8ebca13953be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154834 Jul 14 09:47:10.529564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 609/1191] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:10 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:10.533699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1361855b-d820-4b45-aaf5-5b6553d43a40 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:10.535013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1361855b-d820-4b45-aaf5-5b6553d43a40 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:10.541255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1361855b-d820-4b45-aaf5-5b6553d43a40 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:10.541691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1361855b-d820-4b45-aaf5-5b6553d43a40 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:10.542461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1361855b-d820-4b45-aaf5-5b6553d43a40 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:10.542883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1361855b-d820-4b45-aaf5-5b6553d43a40 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:10.572129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1361855b-d820-4b45-aaf5-5b6553d43a40 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Jul 14 09:47:10.572672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 610/1192] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:10.577105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-533ad892-242d-4158-9a30-d36bf31b8157 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:10.577985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-533ad892-242d-4158-9a30-d36bf31b8157 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:10.583539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-533ad892-242d-4158-9a30-d36bf31b8157 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:10.583973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-533ad892-242d-4158-9a30-d36bf31b8157 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:10.584708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-533ad892-242d-4158-9a30-d36bf31b8157 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:10.585137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-533ad892-242d-4158-9a30-d36bf31b8157 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:10.613843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-533ad892-242d-4158-9a30-d36bf31b8157 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040219 Jul 14 09:47:10.614411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 611/1193] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:11.544798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-be422c4a-b96c-4c92-b8b2-bd565661c922 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:11.545998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-be422c4a-b96c-4c92-b8b2-bd565661c922 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:11.552495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be422c4a-b96c-4c92-b8b2-bd565661c922 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:11.552932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be422c4a-b96c-4c92-b8b2-bd565661c922 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:11.553675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be422c4a-b96c-4c92-b8b2-bd565661c922 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:11.554099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be422c4a-b96c-4c92-b8b2-bd565661c922 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:11.683152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be422c4a-b96c-4c92-b8b2-bd565661c922 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:11.690690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-be422c4a-b96c-4c92-b8b2-bd565661c922 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149555 Jul 14 09:47:11.691250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 612/1194] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:11 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:11.695950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-223ba0ab-6050-4a12-8e8a-1e772389ab03 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:11.696839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-223ba0ab-6050-4a12-8e8a-1e772389ab03 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:11.702617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-223ba0ab-6050-4a12-8e8a-1e772389ab03 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:11.703061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-223ba0ab-6050-4a12-8e8a-1e772389ab03 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:11.703846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-223ba0ab-6050-4a12-8e8a-1e772389ab03 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:11.704273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-223ba0ab-6050-4a12-8e8a-1e772389ab03 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:11.732234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-223ba0ab-6050-4a12-8e8a-1e772389ab03 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040009 Jul 14 09:47:11.733337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 613/1195] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:11 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:11.737746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-db8dfe36-b271-44e1-a196-13de0138940d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:11.738642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-db8dfe36-b271-44e1-a196-13de0138940d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:11.744152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-db8dfe36-b271-44e1-a196-13de0138940d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:11.744595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-db8dfe36-b271-44e1-a196-13de0138940d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:11.745338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-db8dfe36-b271-44e1-a196-13de0138940d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:11.745796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-db8dfe36-b271-44e1-a196-13de0138940d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:11.773029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-db8dfe36-b271-44e1-a196-13de0138940d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038732 Jul 14 09:47:11.773563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 614/1196] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:12.708583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-129a8105-a57b-4ad8-904c-e2bc353a2d05 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:12.709194 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-129a8105-a57b-4ad8-904c-e2bc353a2d05 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:12.715825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-129a8105-a57b-4ad8-904c-e2bc353a2d05 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:12.716269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-129a8105-a57b-4ad8-904c-e2bc353a2d05 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:12.717021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-129a8105-a57b-4ad8-904c-e2bc353a2d05 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:12.717453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-129a8105-a57b-4ad8-904c-e2bc353a2d05 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:12.849058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-129a8105-a57b-4ad8-904c-e2bc353a2d05 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:12.856392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-129a8105-a57b-4ad8-904c-e2bc353a2d05 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151627 Jul 14 09:47:12.856970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 615/1197] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:12 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:12.861372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d99fa354-9b31-4db6-a08e-ee4a3e7c8e06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:12.862289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d99fa354-9b31-4db6-a08e-ee4a3e7c8e06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:12.867819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d99fa354-9b31-4db6-a08e-ee4a3e7c8e06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:12.868252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d99fa354-9b31-4db6-a08e-ee4a3e7c8e06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:12.868997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d99fa354-9b31-4db6-a08e-ee4a3e7c8e06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:12.869424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d99fa354-9b31-4db6-a08e-ee4a3e7c8e06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:12.893624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:12.898521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d99fa354-9b31-4db6-a08e-ee4a3e7c8e06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040592 Jul 14 09:47:12.899067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 616/1198] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:12.903655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-435a8008-6d64-4c1f-8e36-e012b1a2908f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:12.904525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-435a8008-6d64-4c1f-8e36-e012b1a2908f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:12.910728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-435a8008-6d64-4c1f-8e36-e012b1a2908f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:12.911171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-435a8008-6d64-4c1f-8e36-e012b1a2908f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:12.911978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-435a8008-6d64-4c1f-8e36-e012b1a2908f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:12.912400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-435a8008-6d64-4c1f-8e36-e012b1a2908f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:12.940662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-435a8008-6d64-4c1f-8e36-e012b1a2908f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040564 Jul 14 09:47:12.941193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 617/1199] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:13.872631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d2b5f3f3-d8a8-45ec-93b0-3195defd29b9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:13.873247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d2b5f3f3-d8a8-45ec-93b0-3195defd29b9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:13.880311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2b5f3f3-d8a8-45ec-93b0-3195defd29b9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:13.880749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2b5f3f3-d8a8-45ec-93b0-3195defd29b9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:13.881489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2b5f3f3-d8a8-45ec-93b0-3195defd29b9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:13.881910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2b5f3f3-d8a8-45ec-93b0-3195defd29b9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:14.009292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d2b5f3f3-d8a8-45ec-93b0-3195defd29b9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:14.018077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d2b5f3f3-d8a8-45ec-93b0-3195defd29b9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149282 Jul 14 09:47:14.018678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 618/1200] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:13 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:14.023180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-baac1b5c-33ff-4b74-9936-34b8304d984d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:14.024089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-baac1b5c-33ff-4b74-9936-34b8304d984d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:14.029702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baac1b5c-33ff-4b74-9936-34b8304d984d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:14.030149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baac1b5c-33ff-4b74-9936-34b8304d984d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:14.030940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baac1b5c-33ff-4b74-9936-34b8304d984d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:14.031375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baac1b5c-33ff-4b74-9936-34b8304d984d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:14.059054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-baac1b5c-33ff-4b74-9936-34b8304d984d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039409 Jul 14 09:47:14.059597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 619/1201] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:14.064535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7ea5947a-b15c-40aa-ab88-e2abceea42c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:14.065353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7ea5947a-b15c-40aa-ab88-e2abceea42c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:14.071119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ea5947a-b15c-40aa-ab88-e2abceea42c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:14.071563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ea5947a-b15c-40aa-ab88-e2abceea42c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:14.072311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ea5947a-b15c-40aa-ab88-e2abceea42c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:14.072743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ea5947a-b15c-40aa-ab88-e2abceea42c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:14.100955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7ea5947a-b15c-40aa-ab88-e2abceea42c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040402 Jul 14 09:47:14.101523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 620/1202] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:15.035057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f57b52d9-f4f0-4df6-af65-4082d6ef1fcf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:15.035689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f57b52d9-f4f0-4df6-af65-4082d6ef1fcf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:15.042114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f57b52d9-f4f0-4df6-af65-4082d6ef1fcf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:15.042577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f57b52d9-f4f0-4df6-af65-4082d6ef1fcf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:15.043322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f57b52d9-f4f0-4df6-af65-4082d6ef1fcf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:15.043742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f57b52d9-f4f0-4df6-af65-4082d6ef1fcf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:15.174270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f57b52d9-f4f0-4df6-af65-4082d6ef1fcf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:15.181705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f57b52d9-f4f0-4df6-af65-4082d6ef1fcf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150468 Jul 14 09:47:15.182274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 621/1203] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:15 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:15.186690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48682311-ed63-43c3-a3d7-de0143d1586b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:15.188186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-48682311-ed63-43c3-a3d7-de0143d1586b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:15.193913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48682311-ed63-43c3-a3d7-de0143d1586b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:15.194397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48682311-ed63-43c3-a3d7-de0143d1586b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:15.195147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48682311-ed63-43c3-a3d7-de0143d1586b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:15.195573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48682311-ed63-43c3-a3d7-de0143d1586b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:15.223358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-48682311-ed63-43c3-a3d7-de0143d1586b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040107 Jul 14 09:47:15.223897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 622/1204] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:15.228297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-131d79b9-45b4-4725-b35f-177a2bb61435 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:15.229166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-131d79b9-45b4-4725-b35f-177a2bb61435 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:15.235119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-131d79b9-45b4-4725-b35f-177a2bb61435 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:15.235556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-131d79b9-45b4-4725-b35f-177a2bb61435 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:15.236288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-131d79b9-45b4-4725-b35f-177a2bb61435 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:15.236713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-131d79b9-45b4-4725-b35f-177a2bb61435 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:15.265400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-131d79b9-45b4-4725-b35f-177a2bb61435 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040512 Jul 14 09:47:15.265939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 623/1205] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:16.198988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7732fc5a-0dbc-42fc-b960-39fbf445a447 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:16.199670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7732fc5a-0dbc-42fc-b960-39fbf445a447 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:16.206633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7732fc5a-0dbc-42fc-b960-39fbf445a447 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:16.207065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7732fc5a-0dbc-42fc-b960-39fbf445a447 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:16.207806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7732fc5a-0dbc-42fc-b960-39fbf445a447 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:16.208228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7732fc5a-0dbc-42fc-b960-39fbf445a447 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:16.335535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7732fc5a-0dbc-42fc-b960-39fbf445a447 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:16.342984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7732fc5a-0dbc-42fc-b960-39fbf445a447 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147864 Jul 14 09:47:16.343537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 624/1206] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:16 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:16.348118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a0f27a50-beab-4a4f-baf0-8087c2d9af6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:16.349002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a0f27a50-beab-4a4f-baf0-8087c2d9af6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:16.354512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0f27a50-beab-4a4f-baf0-8087c2d9af6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:16.354962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0f27a50-beab-4a4f-baf0-8087c2d9af6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:16.355696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0f27a50-beab-4a4f-baf0-8087c2d9af6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:16.356116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0f27a50-beab-4a4f-baf0-8087c2d9af6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:16.384470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a0f27a50-beab-4a4f-baf0-8087c2d9af6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039967 Jul 14 09:47:16.385003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 625/1207] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:16 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:16.389355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ac69881e-2367-4482-8c96-ed042697c184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:16.390840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ac69881e-2367-4482-8c96-ed042697c184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:16.396286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac69881e-2367-4482-8c96-ed042697c184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:16.396720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac69881e-2367-4482-8c96-ed042697c184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:16.397461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac69881e-2367-4482-8c96-ed042697c184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:16.397886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac69881e-2367-4482-8c96-ed042697c184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:16.426489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ac69881e-2367-4482-8c96-ed042697c184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040468 Jul 14 09:47:16.427029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 626/1208] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:17.360913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f305c0c5-ab1f-45a2-9b1c-40e296838583 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:17.361859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f305c0c5-ab1f-45a2-9b1c-40e296838583 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:17.367995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f305c0c5-ab1f-45a2-9b1c-40e296838583 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:17.368441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f305c0c5-ab1f-45a2-9b1c-40e296838583 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:17.369175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f305c0c5-ab1f-45a2-9b1c-40e296838583 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:17.369600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f305c0c5-ab1f-45a2-9b1c-40e296838583 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:17.497088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f305c0c5-ab1f-45a2-9b1c-40e296838583 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:17.505177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f305c0c5-ab1f-45a2-9b1c-40e296838583 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148464 Jul 14 09:47:17.505730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 627/1209] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:17 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:17.510312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c05f885c-7ceb-4340-a735-4b66c166733a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:17.511204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c05f885c-7ceb-4340-a735-4b66c166733a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:17.516757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c05f885c-7ceb-4340-a735-4b66c166733a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:17.517193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c05f885c-7ceb-4340-a735-4b66c166733a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:17.517942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c05f885c-7ceb-4340-a735-4b66c166733a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:17.518522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c05f885c-7ceb-4340-a735-4b66c166733a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:17.547263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c05f885c-7ceb-4340-a735-4b66c166733a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039907 Jul 14 09:47:17.547815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 628/1210] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:17.552261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1c150f11-0d15-46d6-af3d-e873597d911a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:17.553318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1c150f11-0d15-46d6-af3d-e873597d911a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:17.559041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c150f11-0d15-46d6-af3d-e873597d911a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:17.559871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c150f11-0d15-46d6-af3d-e873597d911a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:17.560224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c150f11-0d15-46d6-af3d-e873597d911a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:17.560652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c150f11-0d15-46d6-af3d-e873597d911a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:17.589495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1c150f11-0d15-46d6-af3d-e873597d911a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040695 Jul 14 09:47:17.590048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 629/1211] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:18.523939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-559f162d-7436-4435-8f77-9bd78fab9cb9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:18.524579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-559f162d-7436-4435-8f77-9bd78fab9cb9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:18.531493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-559f162d-7436-4435-8f77-9bd78fab9cb9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:18.531937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-559f162d-7436-4435-8f77-9bd78fab9cb9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:18.532701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-559f162d-7436-4435-8f77-9bd78fab9cb9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:18.533129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-559f162d-7436-4435-8f77-9bd78fab9cb9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:18.664451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-559f162d-7436-4435-8f77-9bd78fab9cb9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:18.672043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-559f162d-7436-4435-8f77-9bd78fab9cb9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.153489 Jul 14 09:47:18.672601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 630/1212] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:18 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:18.677628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-03406557-21a4-440c-8c45-9ce60d579a65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:18.678653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-03406557-21a4-440c-8c45-9ce60d579a65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:18.685067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03406557-21a4-440c-8c45-9ce60d579a65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:18.685528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03406557-21a4-440c-8c45-9ce60d579a65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:18.686306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03406557-21a4-440c-8c45-9ce60d579a65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:18.687248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03406557-21a4-440c-8c45-9ce60d579a65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:18.715511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-03406557-21a4-440c-8c45-9ce60d579a65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041876 Jul 14 09:47:18.716069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 631/1213] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:18 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:18.720543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e3999a08-2a8e-4da4-bd9e-f47e70584899 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:18.721497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e3999a08-2a8e-4da4-bd9e-f47e70584899 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:18.726915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3999a08-2a8e-4da4-bd9e-f47e70584899 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:18.727350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3999a08-2a8e-4da4-bd9e-f47e70584899 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:18.728098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3999a08-2a8e-4da4-bd9e-f47e70584899 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:18.728502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3999a08-2a8e-4da4-bd9e-f47e70584899 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:18.760104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e3999a08-2a8e-4da4-bd9e-f47e70584899 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043041 Jul 14 09:47:18.760662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 632/1214] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:19.689237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a3ea547f-0b12-47de-9e7d-c3117cf042ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:19.689840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a3ea547f-0b12-47de-9e7d-c3117cf042ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:19.696592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3ea547f-0b12-47de-9e7d-c3117cf042ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:19.697033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3ea547f-0b12-47de-9e7d-c3117cf042ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:19.697783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3ea547f-0b12-47de-9e7d-c3117cf042ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:19.698238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3ea547f-0b12-47de-9e7d-c3117cf042ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:19.716204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:19.828607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3ea547f-0b12-47de-9e7d-c3117cf042ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:19.836089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a3ea547f-0b12-47de-9e7d-c3117cf042ea tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150787 Jul 14 09:47:19.836654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 633/1215] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:19 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:19.841224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c8d4b875-96af-4b31-b2a2-b8fe3882ecda tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:19.842111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c8d4b875-96af-4b31-b2a2-b8fe3882ecda tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:19.848351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8d4b875-96af-4b31-b2a2-b8fe3882ecda tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:19.848808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8d4b875-96af-4b31-b2a2-b8fe3882ecda tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:19.849544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8d4b875-96af-4b31-b2a2-b8fe3882ecda tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:19.849975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8d4b875-96af-4b31-b2a2-b8fe3882ecda tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:19.877826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c8d4b875-96af-4b31-b2a2-b8fe3882ecda tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040193 Jul 14 09:47:19.878406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 634/1216] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:19 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:19.882843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b7f21bd2-3514-4c35-a637-c44000f20f34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:19.883718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b7f21bd2-3514-4c35-a637-c44000f20f34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:19.889179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7f21bd2-3514-4c35-a637-c44000f20f34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:19.889627 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7f21bd2-3514-4c35-a637-c44000f20f34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:19.891373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7f21bd2-3514-4c35-a637-c44000f20f34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:19.891799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b7f21bd2-3514-4c35-a637-c44000f20f34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:19.919559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b7f21bd2-3514-4c35-a637-c44000f20f34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040148 Jul 14 09:47:19.920314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 635/1217] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:20.853522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-37d443c9-981a-431e-a99f-6964fd6d1b22 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:20.854170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-37d443c9-981a-431e-a99f-6964fd6d1b22 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:20.860599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-37d443c9-981a-431e-a99f-6964fd6d1b22 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:20.861040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-37d443c9-981a-431e-a99f-6964fd6d1b22 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:20.861793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-37d443c9-981a-431e-a99f-6964fd6d1b22 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:20.862240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-37d443c9-981a-431e-a99f-6964fd6d1b22 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:20.993953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-37d443c9-981a-431e-a99f-6964fd6d1b22 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:21.002117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-37d443c9-981a-431e-a99f-6964fd6d1b22 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152496 Jul 14 09:47:21.002779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 636/1218] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:20 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:21.007197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6a3b1d8b-1fef-45b5-b593-8579b449d018 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:21.008093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6a3b1d8b-1fef-45b5-b593-8579b449d018 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:21.009649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:21.018323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a3b1d8b-1fef-45b5-b593-8579b449d018 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:21.018765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a3b1d8b-1fef-45b5-b593-8579b449d018 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:21.019515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a3b1d8b-1fef-45b5-b593-8579b449d018 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:21.019938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a3b1d8b-1fef-45b5-b593-8579b449d018 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:21.048141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6a3b1d8b-1fef-45b5-b593-8579b449d018 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Jul 14 09:47:21.048683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 637/1219] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:21.053141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e0adfcb5-c1cc-40ba-938b-4019cf8318b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:21.054012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e0adfcb5-c1cc-40ba-938b-4019cf8318b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:21.059678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e0adfcb5-c1cc-40ba-938b-4019cf8318b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:21.060109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e0adfcb5-c1cc-40ba-938b-4019cf8318b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:21.060852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e0adfcb5-c1cc-40ba-938b-4019cf8318b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:21.061273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e0adfcb5-c1cc-40ba-938b-4019cf8318b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:21.090646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e0adfcb5-c1cc-40ba-938b-4019cf8318b5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040934 Jul 14 09:47:21.091188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 638/1220] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:22.018945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-77e6543a-a735-43a9-a98f-419a63742f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:22.019555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-77e6543a-a735-43a9-a98f-419a63742f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:22.026058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77e6543a-a735-43a9-a98f-419a63742f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:22.026534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77e6543a-a735-43a9-a98f-419a63742f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:22.027314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77e6543a-a735-43a9-a98f-419a63742f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:22.027742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77e6543a-a735-43a9-a98f-419a63742f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:22.157408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-77e6543a-a735-43a9-a98f-419a63742f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:22.164906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-77e6543a-a735-43a9-a98f-419a63742f2f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150418 Jul 14 09:47:22.165470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 639/1221] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:22 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:22.169951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-59baf0dc-9f97-4e5d-b489-638496d05392 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:22.170876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-59baf0dc-9f97-4e5d-b489-638496d05392 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:22.176384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59baf0dc-9f97-4e5d-b489-638496d05392 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:22.176828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59baf0dc-9f97-4e5d-b489-638496d05392 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:22.177583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59baf0dc-9f97-4e5d-b489-638496d05392 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:22.178010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59baf0dc-9f97-4e5d-b489-638496d05392 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:22.206083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-59baf0dc-9f97-4e5d-b489-638496d05392 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039578 Jul 14 09:47:22.206578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 640/1222] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:22 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:22.210946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-841647d6-890d-4e2d-862f-6c9206175878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:22.211816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-841647d6-890d-4e2d-862f-6c9206175878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:22.217234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-841647d6-890d-4e2d-862f-6c9206175878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:22.217683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-841647d6-890d-4e2d-862f-6c9206175878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:22.218969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-841647d6-890d-4e2d-862f-6c9206175878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:22.219397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-841647d6-890d-4e2d-862f-6c9206175878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:22.248431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-841647d6-890d-4e2d-862f-6c9206175878 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040919 Jul 14 09:47:22.248971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 641/1223] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:23.181931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7e9fbdd1-092e-46b0-a1c3-2172bf068cd3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:23.182628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7e9fbdd1-092e-46b0-a1c3-2172bf068cd3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:23.189520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e9fbdd1-092e-46b0-a1c3-2172bf068cd3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:23.189956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e9fbdd1-092e-46b0-a1c3-2172bf068cd3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:23.190732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e9fbdd1-092e-46b0-a1c3-2172bf068cd3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:23.191154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e9fbdd1-092e-46b0-a1c3-2172bf068cd3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:23.321865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7e9fbdd1-092e-46b0-a1c3-2172bf068cd3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:23.329294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7e9fbdd1-092e-46b0-a1c3-2172bf068cd3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151186 Jul 14 09:47:23.329845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 642/1224] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:23 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:23.334431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b6e37a26-9d85-45a0-8837-b58425817509 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:23.335326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b6e37a26-9d85-45a0-8837-b58425817509 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:23.340808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6e37a26-9d85-45a0-8837-b58425817509 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:23.341242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6e37a26-9d85-45a0-8837-b58425817509 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:23.341984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6e37a26-9d85-45a0-8837-b58425817509 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:23.342430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6e37a26-9d85-45a0-8837-b58425817509 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:23.370148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b6e37a26-9d85-45a0-8837-b58425817509 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039224 Jul 14 09:47:23.370721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 643/1225] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:23.375675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ecaf692a-07ce-4a5d-8467-49d3167e583f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:23.376531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ecaf692a-07ce-4a5d-8467-49d3167e583f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:23.381993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ecaf692a-07ce-4a5d-8467-49d3167e583f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:23.382475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ecaf692a-07ce-4a5d-8467-49d3167e583f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:23.383212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ecaf692a-07ce-4a5d-8467-49d3167e583f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:23.383653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ecaf692a-07ce-4a5d-8467-49d3167e583f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:23.411151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ecaf692a-07ce-4a5d-8467-49d3167e583f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039475 Jul 14 09:47:23.411707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 644/1226] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:24.345654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bd344cd6-e653-445b-9c24-97206ebd57bd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:24.346430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bd344cd6-e653-445b-9c24-97206ebd57bd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:24.352852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bd344cd6-e653-445b-9c24-97206ebd57bd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:24.353294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bd344cd6-e653-445b-9c24-97206ebd57bd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:24.354053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bd344cd6-e653-445b-9c24-97206ebd57bd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:24.354518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bd344cd6-e653-445b-9c24-97206ebd57bd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:24.486070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bd344cd6-e653-445b-9c24-97206ebd57bd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:24.493420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bd344cd6-e653-445b-9c24-97206ebd57bd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151674 Jul 14 09:47:24.493977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 645/1227] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:24 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:24.498397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c932e085-2858-445c-acb7-feea79099e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:24.499287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c932e085-2858-445c-acb7-feea79099e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:24.505970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c932e085-2858-445c-acb7-feea79099e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:24.506137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c932e085-2858-445c-acb7-feea79099e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:24.506910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c932e085-2858-445c-acb7-feea79099e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:24.507320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c932e085-2858-445c-acb7-feea79099e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:24.538983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c932e085-2858-445c-acb7-feea79099e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Jul 14 09:47:24.539565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 646/1228] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:24 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:24.544260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8e190572-858f-45d1-8b81-5c2c65dcd556 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:24.545155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8e190572-858f-45d1-8b81-5c2c65dcd556 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:24.551455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e190572-858f-45d1-8b81-5c2c65dcd556 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:24.551894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e190572-858f-45d1-8b81-5c2c65dcd556 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:24.552639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e190572-858f-45d1-8b81-5c2c65dcd556 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:24.553062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e190572-858f-45d1-8b81-5c2c65dcd556 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:24.583438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8e190572-858f-45d1-8b81-5c2c65dcd556 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042661 Jul 14 09:47:24.583992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 647/1229] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:25.511186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7de611f2-4504-43c9-9db2-de967d695f21 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:25.511862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7de611f2-4504-43c9-9db2-de967d695f21 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:25.518719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7de611f2-4504-43c9-9db2-de967d695f21 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:25.519154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7de611f2-4504-43c9-9db2-de967d695f21 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:25.519941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7de611f2-4504-43c9-9db2-de967d695f21 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:25.520422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7de611f2-4504-43c9-9db2-de967d695f21 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:25.650081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7de611f2-4504-43c9-9db2-de967d695f21 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:25.658044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7de611f2-4504-43c9-9db2-de967d695f21 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150675 Jul 14 09:47:25.658795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 648/1230] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:25 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:25.663379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eef9f177-5041-4dcc-a3fd-5ac35c9a7d04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:25.664266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eef9f177-5041-4dcc-a3fd-5ac35c9a7d04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:25.669763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eef9f177-5041-4dcc-a3fd-5ac35c9a7d04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:25.670206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eef9f177-5041-4dcc-a3fd-5ac35c9a7d04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:25.670978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eef9f177-5041-4dcc-a3fd-5ac35c9a7d04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:25.671432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eef9f177-5041-4dcc-a3fd-5ac35c9a7d04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:25.698805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eef9f177-5041-4dcc-a3fd-5ac35c9a7d04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038910 Jul 14 09:47:25.699334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 649/1231] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:25 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:25.704286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ab1111c4-28a1-4d71-a1e0-c03401d6632f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:25.705139 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ab1111c4-28a1-4d71-a1e0-c03401d6632f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:25.710458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab1111c4-28a1-4d71-a1e0-c03401d6632f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:25.710893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab1111c4-28a1-4d71-a1e0-c03401d6632f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:25.711623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab1111c4-28a1-4d71-a1e0-c03401d6632f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:25.712041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab1111c4-28a1-4d71-a1e0-c03401d6632f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:25.715484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:25.740193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ab1111c4-28a1-4d71-a1e0-c03401d6632f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039913 Jul 14 09:47:25.740728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 650/1232] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:26.675579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dfc5ba9a-71fa-4e27-b452-a175215b382c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:26.676228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dfc5ba9a-71fa-4e27-b452-a175215b382c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:26.682696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfc5ba9a-71fa-4e27-b452-a175215b382c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:26.683138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfc5ba9a-71fa-4e27-b452-a175215b382c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:26.683887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfc5ba9a-71fa-4e27-b452-a175215b382c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:26.684331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfc5ba9a-71fa-4e27-b452-a175215b382c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:26.815154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dfc5ba9a-71fa-4e27-b452-a175215b382c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:26.822895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dfc5ba9a-71fa-4e27-b452-a175215b382c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151853 Jul 14 09:47:26.823453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 651/1233] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:26 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:26.827874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4b0ac228-8a36-47c9-95f3-59834480d6a7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:26.828773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4b0ac228-8a36-47c9-95f3-59834480d6a7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:26.834509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b0ac228-8a36-47c9-95f3-59834480d6a7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:26.834956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b0ac228-8a36-47c9-95f3-59834480d6a7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:26.835720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b0ac228-8a36-47c9-95f3-59834480d6a7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:26.836172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b0ac228-8a36-47c9-95f3-59834480d6a7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:26.865443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4b0ac228-8a36-47c9-95f3-59834480d6a7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041027 Jul 14 09:47:26.865984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 652/1234] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:26.870450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1c20ec11-1150-4cf3-8a80-5eff4fdc4b4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:26.871326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1c20ec11-1150-4cf3-8a80-5eff4fdc4b4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:26.877105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c20ec11-1150-4cf3-8a80-5eff4fdc4b4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:26.877552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c20ec11-1150-4cf3-8a80-5eff4fdc4b4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:26.878332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c20ec11-1150-4cf3-8a80-5eff4fdc4b4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:26.878760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c20ec11-1150-4cf3-8a80-5eff4fdc4b4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:26.906537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1c20ec11-1150-4cf3-8a80-5eff4fdc4b4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039566 Jul 14 09:47:26.907072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 653/1235] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:27.839162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cc593edc-26a9-4f38-9bd7-b8d2b6ab62ca tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:27.839798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cc593edc-26a9-4f38-9bd7-b8d2b6ab62ca tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:27.846756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc593edc-26a9-4f38-9bd7-b8d2b6ab62ca tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:27.847195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc593edc-26a9-4f38-9bd7-b8d2b6ab62ca tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:27.847942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc593edc-26a9-4f38-9bd7-b8d2b6ab62ca tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:27.848372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc593edc-26a9-4f38-9bd7-b8d2b6ab62ca tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:27.974362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cc593edc-26a9-4f38-9bd7-b8d2b6ab62ca tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:27.982066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cc593edc-26a9-4f38-9bd7-b8d2b6ab62ca tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146902 Jul 14 09:47:27.982648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 654/1236] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:27 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:27.987624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bf60789f-1451-4f16-b58c-c6787619828f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:27.988571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bf60789f-1451-4f16-b58c-c6787619828f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:27.994141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf60789f-1451-4f16-b58c-c6787619828f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:27.994605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf60789f-1451-4f16-b58c-c6787619828f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:27.995348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf60789f-1451-4f16-b58c-c6787619828f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:27.995767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf60789f-1451-4f16-b58c-c6787619828f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:28.024378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bf60789f-1451-4f16-b58c-c6787619828f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040498 Jul 14 09:47:28.024917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 655/1237] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:28.029278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-90fc2db4-0f80-4c4a-9070-61718ac33939 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:28.030153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-90fc2db4-0f80-4c4a-9070-61718ac33939 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:28.036869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90fc2db4-0f80-4c4a-9070-61718ac33939 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:28.037304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90fc2db4-0f80-4c4a-9070-61718ac33939 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:28.038046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90fc2db4-0f80-4c4a-9070-61718ac33939 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:28.038508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90fc2db4-0f80-4c4a-9070-61718ac33939 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:28.067380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-90fc2db4-0f80-4c4a-9070-61718ac33939 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041510 Jul 14 09:47:28.068171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 656/1238] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:28.999311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f99651b4-aee2-4612-abe2-c5a05df9766f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:28.999982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f99651b4-aee2-4612-abe2-c5a05df9766f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:29.006907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f99651b4-aee2-4612-abe2-c5a05df9766f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:29.007433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f99651b4-aee2-4612-abe2-c5a05df9766f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:29.008223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f99651b4-aee2-4612-abe2-c5a05df9766f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:29.008706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f99651b4-aee2-4612-abe2-c5a05df9766f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:29.144418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f99651b4-aee2-4612-abe2-c5a05df9766f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:29.151861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f99651b4-aee2-4612-abe2-c5a05df9766f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.156394 Jul 14 09:47:29.152413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 657/1239] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:28 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:29.157480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6e59cc5e-9429-4baf-8be7-ec08cdb56ba1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:29.158405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6e59cc5e-9429-4baf-8be7-ec08cdb56ba1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:29.163919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e59cc5e-9429-4baf-8be7-ec08cdb56ba1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:29.164356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e59cc5e-9429-4baf-8be7-ec08cdb56ba1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:29.165097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e59cc5e-9429-4baf-8be7-ec08cdb56ba1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:29.165520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e59cc5e-9429-4baf-8be7-ec08cdb56ba1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:29.193373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6e59cc5e-9429-4baf-8be7-ec08cdb56ba1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040009 Jul 14 09:47:29.193901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 658/1240] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:29.198507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fca1d460-8ef6-4d53-b1bb-c2201452f67e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:29.199359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fca1d460-8ef6-4d53-b1bb-c2201452f67e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:29.205197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fca1d460-8ef6-4d53-b1bb-c2201452f67e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:29.205638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fca1d460-8ef6-4d53-b1bb-c2201452f67e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:29.206406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fca1d460-8ef6-4d53-b1bb-c2201452f67e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:29.206831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fca1d460-8ef6-4d53-b1bb-c2201452f67e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:29.234379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fca1d460-8ef6-4d53-b1bb-c2201452f67e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039489 Jul 14 09:47:29.234911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 659/1241] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:30.169512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-07481e80-7c87-4d03-a9c8-58192db1f9bb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:30.170149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-07481e80-7c87-4d03-a9c8-58192db1f9bb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:30.177156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07481e80-7c87-4d03-a9c8-58192db1f9bb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:30.177597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07481e80-7c87-4d03-a9c8-58192db1f9bb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:30.178379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07481e80-7c87-4d03-a9c8-58192db1f9bb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:30.178808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07481e80-7c87-4d03-a9c8-58192db1f9bb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:30.305343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-07481e80-7c87-4d03-a9c8-58192db1f9bb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:30.313327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-07481e80-7c87-4d03-a9c8-58192db1f9bb tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147723 Jul 14 09:47:30.313884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 660/1242] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:30 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:30.318757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-22ca503f-a3f7-4ab9-bcb8-dfb8776b7cc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:30.319654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-22ca503f-a3f7-4ab9-bcb8-dfb8776b7cc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:30.325217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22ca503f-a3f7-4ab9-bcb8-dfb8776b7cc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:30.325658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22ca503f-a3f7-4ab9-bcb8-dfb8776b7cc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:30.326427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22ca503f-a3f7-4ab9-bcb8-dfb8776b7cc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:30.326854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22ca503f-a3f7-4ab9-bcb8-dfb8776b7cc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:30.354877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-22ca503f-a3f7-4ab9-bcb8-dfb8776b7cc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039986 Jul 14 09:47:30.355421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 661/1243] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:30 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:30.360603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-36d8f63a-5a44-4108-9e35-361d01d17e14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:30.361472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-36d8f63a-5a44-4108-9e35-361d01d17e14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:30.366919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36d8f63a-5a44-4108-9e35-361d01d17e14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:30.367362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36d8f63a-5a44-4108-9e35-361d01d17e14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:30.368104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36d8f63a-5a44-4108-9e35-361d01d17e14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:30.368531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36d8f63a-5a44-4108-9e35-361d01d17e14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:30.397102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-36d8f63a-5a44-4108-9e35-361d01d17e14 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040627 Jul 14 09:47:30.397648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 662/1244] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:31.330604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c763d644-66eb-4717-acfb-4a4512c14206 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:31.331274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c763d644-66eb-4717-acfb-4a4512c14206 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:31.337213 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c763d644-66eb-4717-acfb-4a4512c14206 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:31.337648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c763d644-66eb-4717-acfb-4a4512c14206 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:31.338423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c763d644-66eb-4717-acfb-4a4512c14206 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:31.338869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c763d644-66eb-4717-acfb-4a4512c14206 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:31.473145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c763d644-66eb-4717-acfb-4a4512c14206 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:31.480638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c763d644-66eb-4717-acfb-4a4512c14206 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154071 Jul 14 09:47:31.481195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 663/1245] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:31 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:31.485735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-15bdf881-5402-4502-9551-4fc4cc018552 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:31.486654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-15bdf881-5402-4502-9551-4fc4cc018552 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:31.492376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15bdf881-5402-4502-9551-4fc4cc018552 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:31.492827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15bdf881-5402-4502-9551-4fc4cc018552 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:31.493583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15bdf881-5402-4502-9551-4fc4cc018552 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:31.494015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15bdf881-5402-4502-9551-4fc4cc018552 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:31.522395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-15bdf881-5402-4502-9551-4fc4cc018552 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040196 Jul 14 09:47:31.522936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 664/1246] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:31.527514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d7989be2-f731-4740-b897-5a5a2b83c09c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:31.528405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d7989be2-f731-4740-b897-5a5a2b83c09c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:31.534855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7989be2-f731-4740-b897-5a5a2b83c09c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:31.535298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7989be2-f731-4740-b897-5a5a2b83c09c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:31.536057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7989be2-f731-4740-b897-5a5a2b83c09c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:31.536489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7989be2-f731-4740-b897-5a5a2b83c09c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:31.564515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d7989be2-f731-4740-b897-5a5a2b83c09c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040597 Jul 14 09:47:31.565068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 665/1247] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:32.497217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-46c451a9-188d-4585-9cab-a19d0cc84ddc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:32.497894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-46c451a9-188d-4585-9cab-a19d0cc84ddc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:32.504897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-46c451a9-188d-4585-9cab-a19d0cc84ddc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:32.505334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-46c451a9-188d-4585-9cab-a19d0cc84ddc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:32.506077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-46c451a9-188d-4585-9cab-a19d0cc84ddc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:32.506529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-46c451a9-188d-4585-9cab-a19d0cc84ddc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:32.640357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-46c451a9-188d-4585-9cab-a19d0cc84ddc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:32.643711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:32.648879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-46c451a9-188d-4585-9cab-a19d0cc84ddc tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.155661 Jul 14 09:47:32.649437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 666/1248] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:32 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:32.654034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2e60719c-8525-4fb3-82b6-c0cf821f06f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:32.654950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2e60719c-8525-4fb3-82b6-c0cf821f06f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:32.663318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e60719c-8525-4fb3-82b6-c0cf821f06f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:32.663757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e60719c-8525-4fb3-82b6-c0cf821f06f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:32.664513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e60719c-8525-4fb3-82b6-c0cf821f06f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:32.664944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e60719c-8525-4fb3-82b6-c0cf821f06f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:32.693373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2e60719c-8525-4fb3-82b6-c0cf821f06f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042973 Jul 14 09:47:32.693914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 667/1249] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:32.698464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-462cfc63-9829-4711-bd13-58eb47828720 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:32.699330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-462cfc63-9829-4711-bd13-58eb47828720 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:32.704677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-462cfc63-9829-4711-bd13-58eb47828720 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:32.705112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-462cfc63-9829-4711-bd13-58eb47828720 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:32.705845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-462cfc63-9829-4711-bd13-58eb47828720 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:32.706291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-462cfc63-9829-4711-bd13-58eb47828720 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:32.737295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-462cfc63-9829-4711-bd13-58eb47828720 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042342 Jul 14 09:47:32.737864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 668/1250] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:33.666172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7e247421-9c70-45e2-b4fe-2b45e13d8f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:33.666801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7e247421-9c70-45e2-b4fe-2b45e13d8f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:33.673554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e247421-9c70-45e2-b4fe-2b45e13d8f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:33.674123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e247421-9c70-45e2-b4fe-2b45e13d8f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:33.674941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e247421-9c70-45e2-b4fe-2b45e13d8f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:33.675373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7e247421-9c70-45e2-b4fe-2b45e13d8f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:33.802569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7e247421-9c70-45e2-b4fe-2b45e13d8f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:33.810034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7e247421-9c70-45e2-b4fe-2b45e13d8f01 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147631 Jul 14 09:47:33.810568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 669/1251] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:33 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:33.815578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eaaaff22-c106-4507-849e-40f24cb8ae6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:33.816487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eaaaff22-c106-4507-849e-40f24cb8ae6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:33.823314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eaaaff22-c106-4507-849e-40f24cb8ae6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:33.823761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eaaaff22-c106-4507-849e-40f24cb8ae6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:33.824526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eaaaff22-c106-4507-849e-40f24cb8ae6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:33.824955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eaaaff22-c106-4507-849e-40f24cb8ae6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:33.852567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eaaaff22-c106-4507-849e-40f24cb8ae6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041030 Jul 14 09:47:33.853107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 670/1252] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:33.857491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f02adcf9-7037-4f95-b44f-0bdf663f84c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:33.858963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f02adcf9-7037-4f95-b44f-0bdf663f84c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:33.864492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f02adcf9-7037-4f95-b44f-0bdf663f84c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:33.864965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f02adcf9-7037-4f95-b44f-0bdf663f84c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:33.865710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f02adcf9-7037-4f95-b44f-0bdf663f84c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:33.866138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f02adcf9-7037-4f95-b44f-0bdf663f84c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:33.894075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f02adcf9-7037-4f95-b44f-0bdf663f84c0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040016 Jul 14 09:47:33.894648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 671/1253] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:34.828744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0a7e29e2-5b83-4b73-a708-9bd001961aef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:34.829399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0a7e29e2-5b83-4b73-a708-9bd001961aef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:34.835828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a7e29e2-5b83-4b73-a708-9bd001961aef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:34.836270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a7e29e2-5b83-4b73-a708-9bd001961aef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:34.837023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a7e29e2-5b83-4b73-a708-9bd001961aef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:34.837454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a7e29e2-5b83-4b73-a708-9bd001961aef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:34.966789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0a7e29e2-5b83-4b73-a708-9bd001961aef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:34.974370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0a7e29e2-5b83-4b73-a708-9bd001961aef tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150206 Jul 14 09:47:34.974925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 672/1254] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:34 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:34.979395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3e59d2e7-6d6f-49a8-94c2-40fc1be0cb47 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:34.980294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3e59d2e7-6d6f-49a8-94c2-40fc1be0cb47 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:34.985824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e59d2e7-6d6f-49a8-94c2-40fc1be0cb47 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:34.986364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e59d2e7-6d6f-49a8-94c2-40fc1be0cb47 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:34.987120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e59d2e7-6d6f-49a8-94c2-40fc1be0cb47 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:34.987550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e59d2e7-6d6f-49a8-94c2-40fc1be0cb47 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:35.016179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3e59d2e7-6d6f-49a8-94c2-40fc1be0cb47 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040285 Jul 14 09:47:35.016719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 673/1255] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:35.021182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c8ebf7a3-9c93-4dc4-af21-89dff7d0fc34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:35.022081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c8ebf7a3-9c93-4dc4-af21-89dff7d0fc34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:35.027538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8ebf7a3-9c93-4dc4-af21-89dff7d0fc34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:35.027978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8ebf7a3-9c93-4dc4-af21-89dff7d0fc34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:35.028715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8ebf7a3-9c93-4dc4-af21-89dff7d0fc34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:35.029142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8ebf7a3-9c93-4dc4-af21-89dff7d0fc34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:35.056920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c8ebf7a3-9c93-4dc4-af21-89dff7d0fc34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039135 Jul 14 09:47:35.057477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 674/1256] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:35.990937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-437e551e-1c0d-4c55-8559-e2410ecbd111 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:35.991586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-437e551e-1c0d-4c55-8559-e2410ecbd111 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:35.998022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-437e551e-1c0d-4c55-8559-e2410ecbd111 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:35.998493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-437e551e-1c0d-4c55-8559-e2410ecbd111 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:35.999245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-437e551e-1c0d-4c55-8559-e2410ecbd111 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:35.999678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-437e551e-1c0d-4c55-8559-e2410ecbd111 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:36.129343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-437e551e-1c0d-4c55-8559-e2410ecbd111 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:36.136875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-437e551e-1c0d-4c55-8559-e2410ecbd111 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149766 Jul 14 09:47:36.137438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 675/1257] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:35 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:36.142487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-11c1ee26-ccb6-415e-8391-a356e2d9e817 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:36.143384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-11c1ee26-ccb6-415e-8391-a356e2d9e817 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:36.148963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11c1ee26-ccb6-415e-8391-a356e2d9e817 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:36.149403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11c1ee26-ccb6-415e-8391-a356e2d9e817 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:36.150158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11c1ee26-ccb6-415e-8391-a356e2d9e817 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:36.150627 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11c1ee26-ccb6-415e-8391-a356e2d9e817 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:36.180648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-11c1ee26-ccb6-415e-8391-a356e2d9e817 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042248 Jul 14 09:47:36.181205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 676/1258] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:36.185570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-02000c93-21dd-4c51-bbc5-99b187e9af10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:36.186463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-02000c93-21dd-4c51-bbc5-99b187e9af10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:36.191897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02000c93-21dd-4c51-bbc5-99b187e9af10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:36.192592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02000c93-21dd-4c51-bbc5-99b187e9af10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:36.193333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02000c93-21dd-4c51-bbc5-99b187e9af10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:36.193763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02000c93-21dd-4c51-bbc5-99b187e9af10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:36.222020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-02000c93-21dd-4c51-bbc5-99b187e9af10 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039884 Jul 14 09:47:36.222582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 677/1259] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:37.154455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-34f70f0d-f1f3-435c-ab96-314a3e96cd16 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:37.155621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-34f70f0d-f1f3-435c-ab96-314a3e96cd16 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:37.162081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-34f70f0d-f1f3-435c-ab96-314a3e96cd16 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:37.162549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-34f70f0d-f1f3-435c-ab96-314a3e96cd16 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:37.163293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-34f70f0d-f1f3-435c-ab96-314a3e96cd16 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:37.163719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-34f70f0d-f1f3-435c-ab96-314a3e96cd16 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:37.294325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-34f70f0d-f1f3-435c-ab96-314a3e96cd16 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:37.302522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-34f70f0d-f1f3-435c-ab96-314a3e96cd16 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151929 Jul 14 09:47:37.303085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 678/1260] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:37 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:37.307711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-03161e8f-a5dc-415a-94d3-fc1f2c1dbb6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:37.308612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-03161e8f-a5dc-415a-94d3-fc1f2c1dbb6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:37.314147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03161e8f-a5dc-415a-94d3-fc1f2c1dbb6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:37.314617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03161e8f-a5dc-415a-94d3-fc1f2c1dbb6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:37.315369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03161e8f-a5dc-415a-94d3-fc1f2c1dbb6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:37.315795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03161e8f-a5dc-415a-94d3-fc1f2c1dbb6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:37.343913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-03161e8f-a5dc-415a-94d3-fc1f2c1dbb6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039869 Jul 14 09:47:37.344460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 679/1261] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:37.348981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-530dd887-62b1-4cca-afb0-d14ef9c6c583 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:37.349844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-530dd887-62b1-4cca-afb0-d14ef9c6c583 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:37.355313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-530dd887-62b1-4cca-afb0-d14ef9c6c583 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:37.355755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-530dd887-62b1-4cca-afb0-d14ef9c6c583 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:37.356498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-530dd887-62b1-4cca-afb0-d14ef9c6c583 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:37.356927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-530dd887-62b1-4cca-afb0-d14ef9c6c583 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:37.384852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-530dd887-62b1-4cca-afb0-d14ef9c6c583 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039337 Jul 14 09:47:37.385395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 680/1262] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:38.319479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb7c8318-5d8a-4ac1-8ce5-2e6a51111c1d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:38.320152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eb7c8318-5d8a-4ac1-8ce5-2e6a51111c1d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:38.326499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb7c8318-5d8a-4ac1-8ce5-2e6a51111c1d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:38.326965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb7c8318-5d8a-4ac1-8ce5-2e6a51111c1d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:38.327707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb7c8318-5d8a-4ac1-8ce5-2e6a51111c1d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:38.328131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb7c8318-5d8a-4ac1-8ce5-2e6a51111c1d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:38.455286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-eb7c8318-5d8a-4ac1-8ce5-2e6a51111c1d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:38.462783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eb7c8318-5d8a-4ac1-8ce5-2e6a51111c1d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147381 Jul 14 09:47:38.463360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 681/1263] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:38 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:38.468397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-279ea60f-c614-4e29-810b-d82a158cf5cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:38.469295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-279ea60f-c614-4e29-810b-d82a158cf5cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:38.474858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-279ea60f-c614-4e29-810b-d82a158cf5cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:38.475300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-279ea60f-c614-4e29-810b-d82a158cf5cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:38.476049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-279ea60f-c614-4e29-810b-d82a158cf5cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:38.476479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-279ea60f-c614-4e29-810b-d82a158cf5cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:38.505102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-279ea60f-c614-4e29-810b-d82a158cf5cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040774 Jul 14 09:47:38.505634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 682/1264] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:38.510047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-42b05c72-532c-494d-8fd1-ee4d6a76e303 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:38.510942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-42b05c72-532c-494d-8fd1-ee4d6a76e303 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:38.516373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42b05c72-532c-494d-8fd1-ee4d6a76e303 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:38.516817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42b05c72-532c-494d-8fd1-ee4d6a76e303 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:38.517556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42b05c72-532c-494d-8fd1-ee4d6a76e303 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:38.517982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42b05c72-532c-494d-8fd1-ee4d6a76e303 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:38.533987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:38.547608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-42b05c72-532c-494d-8fd1-ee4d6a76e303 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041013 Jul 14 09:47:38.548153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 683/1265] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:39.480694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7d7de614-f27a-42e8-b8a7-12abe6cc84ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:39.481369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7d7de614-f27a-42e8-b8a7-12abe6cc84ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:39.488525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d7de614-f27a-42e8-b8a7-12abe6cc84ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:39.488965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d7de614-f27a-42e8-b8a7-12abe6cc84ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:39.489716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d7de614-f27a-42e8-b8a7-12abe6cc84ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:39.490142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d7de614-f27a-42e8-b8a7-12abe6cc84ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:39.631667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7d7de614-f27a-42e8-b8a7-12abe6cc84ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:47:39.640674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7d7de614-f27a-42e8-b8a7-12abe6cc84ab tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.163934 Jul 14 09:47:39.641247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 684/1266] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:47:39 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:47:39.645824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5be8c439-abed-46fa-bb3c-33a9247f8975 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:39.646754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5be8c439-abed-46fa-bb3c-33a9247f8975 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:39.652619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5be8c439-abed-46fa-bb3c-33a9247f8975 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:39.653062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5be8c439-abed-46fa-bb3c-33a9247f8975 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:39.653812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5be8c439-abed-46fa-bb3c-33a9247f8975 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:39.654269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5be8c439-abed-46fa-bb3c-33a9247f8975 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:39.686545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5be8c439-abed-46fa-bb3c-33a9247f8975 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Jul 14 09:47:39.687109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 685/1267] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:47:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:47:39.691677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d7f4ad18-0e1d-4d82-bcd7-003c1e934bac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:39.692832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d7f4ad18-0e1d-4d82-bcd7-003c1e934bac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:39.698647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7f4ad18-0e1d-4d82-bcd7-003c1e934bac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:39.699088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7f4ad18-0e1d-4d82-bcd7-003c1e934bac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:39.699835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7f4ad18-0e1d-4d82-bcd7-003c1e934bac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:39.700262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7f4ad18-0e1d-4d82-bcd7-003c1e934bac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:39.736502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d7f4ad18-0e1d-4d82-bcd7-003c1e934bac tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044334 Jul 14 09:47:39.737015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 686/1268] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:47:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:47:40.108142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:47:40.109097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:47:40.111145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:40.116634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:40.117071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:40.117908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:47:40.118379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:47:45.610722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-bec7ab0b-32ae-4276-a5dc-b7c904aed273 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:47:45.783688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:47:50.120469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:55.614794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:55.787517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=28 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:47:58.272999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:47:58.273665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:48:01.903589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:48:01.904135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:48:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:48:30.570000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:48:30.570714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:48:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:48:36.007574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:48:36.008126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:48:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:48:40.112555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bec7ab0b-32ae-4276-a5dc-b7c904aed273 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 202 len: 0 microversion: 2.1 time: 120.070089 Jul 14 09:48:40.113155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 583/1269] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:46:40 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 0 bytes in 120071 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:48:40.118942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1fe30354-42e3-4fba-8b76-5447662da5c7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:40.119641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1fe30354-42e3-4fba-8b76-5447662da5c7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:40.126718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1fe30354-42e3-4fba-8b76-5447662da5c7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:40.127181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1fe30354-42e3-4fba-8b76-5447662da5c7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:40.127951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1fe30354-42e3-4fba-8b76-5447662da5c7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:40.128557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1fe30354-42e3-4fba-8b76-5447662da5c7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:40.186417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2453f508-9210-4775-bb60-2781e726ea6e) Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:48:40.189306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:48:40.190957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2453f508-9210-4775-bb60-2781e726ea6e) Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:48:40.191852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2453f508-9210-4775-bb60-2781e726ea6e) Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:48:40.192980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2453f508-9210-4775-bb60-2781e726ea6e) Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:48:40.194829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2453f508-9210-4775-bb60-2781e726ea6e) Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:48:40.196237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2453f508-9210-4775-bb60-2781e726ea6e) Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2453f508-9210-4775-bb60-2781e726ea6e) Jul 14 09:48:40.197607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:48:40.198934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2453f508-9210-4775-bb60-2781e726ea6e) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:48:40.198934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2939778d-5a01-4f79-9378-a772d7a4b48d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 60.087191 Jul 14 09:48:40.198934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 687/1270] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:47:40 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 60088 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 09:48:40.201273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21c46dd4-28be-48bb-a2b3-9fb03f8cb923 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:40.202312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-21c46dd4-28be-48bb-a2b3-9fb03f8cb923 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:40.212506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c46dd4-28be-48bb-a2b3-9fb03f8cb923 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:40.212962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c46dd4-28be-48bb-a2b3-9fb03f8cb923 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:40.213920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c46dd4-28be-48bb-a2b3-9fb03f8cb923 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:40.214154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c46dd4-28be-48bb-a2b3-9fb03f8cb923 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:40.244498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-21c46dd4-28be-48bb-a2b3-9fb03f8cb923 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051673 Jul 14 09:48:40.245074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 688/1271] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:40.252817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-77ecefe3-c317-4b78-a1f3-a4b21b6e56f0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:40.253756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-77ecefe3-c317-4b78-a1f3-a4b21b6e56f0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:40.259989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77ecefe3-c317-4b78-a1f3-a4b21b6e56f0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:40.260430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77ecefe3-c317-4b78-a1f3-a4b21b6e56f0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:40.261570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77ecefe3-c317-4b78-a1f3-a4b21b6e56f0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:40.262006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77ecefe3-c317-4b78-a1f3-a4b21b6e56f0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:40.280708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1fe30354-42e3-4fba-8b76-5447662da5c7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:40.290231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1fe30354-42e3-4fba-8b76-5447662da5c7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.175832 Jul 14 09:48:40.291025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 584/1272] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:40 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:48:40.292537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-77ecefe3-c317-4b78-a1f3-a4b21b6e56f0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045938 Jul 14 09:48:40.294309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 689/1273] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:40.300007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:40.300498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:40.306393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:40.306837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:40.307595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:40.308028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:41.255958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8ed957b3-f7f1-4255-81d8-21e81d162c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:41.257033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8ed957b3-f7f1-4255-81d8-21e81d162c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:41.263544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ed957b3-f7f1-4255-81d8-21e81d162c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:41.263984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ed957b3-f7f1-4255-81d8-21e81d162c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:41.264733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ed957b3-f7f1-4255-81d8-21e81d162c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:41.265159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ed957b3-f7f1-4255-81d8-21e81d162c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:41.294407 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8ed957b3-f7f1-4255-81d8-21e81d162c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 Jul 14 09:48:41.294948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 585/1274] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:41.303224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-21d7470a-a19e-40c1-b6d6-7b6c19d089f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:41.304202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-21d7470a-a19e-40c1-b6d6-7b6c19d089f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:41.310663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21d7470a-a19e-40c1-b6d6-7b6c19d089f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:41.311113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21d7470a-a19e-40c1-b6d6-7b6c19d089f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:41.311867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21d7470a-a19e-40c1-b6d6-7b6c19d089f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:41.312305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21d7470a-a19e-40c1-b6d6-7b6c19d089f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:41.343742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-21d7470a-a19e-40c1-b6d6-7b6c19d089f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044247 Jul 14 09:48:41.344887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 586/1275] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:48:41.349750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7aba3203-f277-4e2b-bbfa-3f7e05024304 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:41.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7aba3203-f277-4e2b-bbfa-3f7e05024304 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:41.355941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7aba3203-f277-4e2b-bbfa-3f7e05024304 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:41.356383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7aba3203-f277-4e2b-bbfa-3f7e05024304 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:41.357128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7aba3203-f277-4e2b-bbfa-3f7e05024304 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:41.357557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7aba3203-f277-4e2b-bbfa-3f7e05024304 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:41.643138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7aba3203-f277-4e2b-bbfa-3f7e05024304 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:41.650745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7aba3203-f277-4e2b-bbfa-3f7e05024304 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.304928 Jul 14 09:48:41.651464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 587/1276] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:41 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:48:42.306109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e9419d66-0466-4050-9d43-dc0d71b41e57 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:42.306974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e9419d66-0466-4050-9d43-dc0d71b41e57 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:42.313807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e9419d66-0466-4050-9d43-dc0d71b41e57 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:42.314274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e9419d66-0466-4050-9d43-dc0d71b41e57 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:42.315292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e9419d66-0466-4050-9d43-dc0d71b41e57 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:42.315721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e9419d66-0466-4050-9d43-dc0d71b41e57 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:42.343957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e9419d66-0466-4050-9d43-dc0d71b41e57 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Jul 14 09:48:42.344483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 588/1277] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:42 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:48:42.355523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7740e1c3-f068-447c-bcd0-2d7bc7528e86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:42.356431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7740e1c3-f068-447c-bcd0-2d7bc7528e86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:42.362083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7740e1c3-f068-447c-bcd0-2d7bc7528e86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:42.362579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7740e1c3-f068-447c-bcd0-2d7bc7528e86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:42.363334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7740e1c3-f068-447c-bcd0-2d7bc7528e86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:42.363765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7740e1c3-f068-447c-bcd0-2d7bc7528e86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:42.392583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7740e1c3-f068-447c-bcd0-2d7bc7528e86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040685 Jul 14 09:48:42.393106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 589/1278] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:48:42.667692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5f9521b3-6fb2-437e-8e69-38fabc0f4d40 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:42.668317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5f9521b3-6fb2-437e-8e69-38fabc0f4d40 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:42.674927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f9521b3-6fb2-437e-8e69-38fabc0f4d40 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:42.675376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f9521b3-6fb2-437e-8e69-38fabc0f4d40 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:42.676133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f9521b3-6fb2-437e-8e69-38fabc0f4d40 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:42.676565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f9521b3-6fb2-437e-8e69-38fabc0f4d40 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:42.816818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5f9521b3-6fb2-437e-8e69-38fabc0f4d40 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:42.824282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5f9521b3-6fb2-437e-8e69-38fabc0f4d40 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.160445 Jul 14 09:48:42.824829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 590/1279] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:42 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:43.355611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dd8f26fb-3e4a-4260-b886-50ca2603d769 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:43.356529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dd8f26fb-3e4a-4260-b886-50ca2603d769 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:43.362985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd8f26fb-3e4a-4260-b886-50ca2603d769 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:43.363435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd8f26fb-3e4a-4260-b886-50ca2603d769 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:43.364192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd8f26fb-3e4a-4260-b886-50ca2603d769 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:43.364627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd8f26fb-3e4a-4260-b886-50ca2603d769 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:43.392928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dd8f26fb-3e4a-4260-b886-50ca2603d769 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041214 Jul 14 09:48:43.393462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 591/1280] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:48:43.403472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1212e5d9-1b8d-4683-b0bc-c231d5b076b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:43.404351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1212e5d9-1b8d-4683-b0bc-c231d5b076b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:43.410644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1212e5d9-1b8d-4683-b0bc-c231d5b076b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:43.411090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1212e5d9-1b8d-4683-b0bc-c231d5b076b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:43.411847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1212e5d9-1b8d-4683-b0bc-c231d5b076b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:43.412277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1212e5d9-1b8d-4683-b0bc-c231d5b076b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:43.439801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1212e5d9-1b8d-4683-b0bc-c231d5b076b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039638 Jul 14 09:48:43.440339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 592/1281] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:48:43.841152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-798adf22-7927-471a-9362-2c9e330bb68d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:43.841784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-798adf22-7927-471a-9362-2c9e330bb68d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:43.847654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-798adf22-7927-471a-9362-2c9e330bb68d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:43.848098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-798adf22-7927-471a-9362-2c9e330bb68d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:43.848848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-798adf22-7927-471a-9362-2c9e330bb68d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:43.849280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-798adf22-7927-471a-9362-2c9e330bb68d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:43.977527 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-798adf22-7927-471a-9362-2c9e330bb68d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:43.984988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-798adf22-7927-471a-9362-2c9e330bb68d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147722 Jul 14 09:48:43.985536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 593/1282] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:43 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:44.403493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f08108cc-6e5b-4814-8951-416926a3aa73 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:44.404398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f08108cc-6e5b-4814-8951-416926a3aa73 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:44.411436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f08108cc-6e5b-4814-8951-416926a3aa73 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:44.411881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f08108cc-6e5b-4814-8951-416926a3aa73 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:44.412630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f08108cc-6e5b-4814-8951-416926a3aa73 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:44.413058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f08108cc-6e5b-4814-8951-416926a3aa73 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:44.441726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f08108cc-6e5b-4814-8951-416926a3aa73 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042109 Jul 14 09:48:44.442283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 594/1283] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:48:44.450849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-315e2bbc-28fc-4954-8698-4a2b53ae1515 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:44.451730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-315e2bbc-28fc-4954-8698-4a2b53ae1515 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:44.457664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-315e2bbc-28fc-4954-8698-4a2b53ae1515 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:44.458101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-315e2bbc-28fc-4954-8698-4a2b53ae1515 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:44.458928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-315e2bbc-28fc-4954-8698-4a2b53ae1515 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:44.459367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-315e2bbc-28fc-4954-8698-4a2b53ae1515 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:44.488285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-315e2bbc-28fc-4954-8698-4a2b53ae1515 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041068 Jul 14 09:48:44.488820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 595/1284] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:48:45.001583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-af5c11d5-8258-4639-a74b-c747dd344404 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:45.002182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-af5c11d5-8258-4639-a74b-c747dd344404 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:45.008277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af5c11d5-8258-4639-a74b-c747dd344404 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:45.008715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af5c11d5-8258-4639-a74b-c747dd344404 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:45.009464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af5c11d5-8258-4639-a74b-c747dd344404 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:45.009893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af5c11d5-8258-4639-a74b-c747dd344404 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:45.135815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-af5c11d5-8258-4639-a74b-c747dd344404 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:45.143869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-af5c11d5-8258-4639-a74b-c747dd344404 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146308 Jul 14 09:48:45.144416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 596/1285] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:44 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:45.453164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-85089e93-7f5a-451b-9c79-44a2cd4495f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:45.454752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-85089e93-7f5a-451b-9c79-44a2cd4495f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:45.461126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85089e93-7f5a-451b-9c79-44a2cd4495f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:45.461568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85089e93-7f5a-451b-9c79-44a2cd4495f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:45.462357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85089e93-7f5a-451b-9c79-44a2cd4495f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:45.462791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85089e93-7f5a-451b-9c79-44a2cd4495f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:45.490523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-85089e93-7f5a-451b-9c79-44a2cd4495f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041276 Jul 14 09:48:45.491051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 597/1286] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:45 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:48:45.498665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c9e99054-5602-4e5c-966d-7bd15f33f29e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:45.499546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c9e99054-5602-4e5c-966d-7bd15f33f29e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:45.505690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9e99054-5602-4e5c-966d-7bd15f33f29e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:45.506134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9e99054-5602-4e5c-966d-7bd15f33f29e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:45.506925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9e99054-5602-4e5c-966d-7bd15f33f29e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:45.507355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9e99054-5602-4e5c-966d-7bd15f33f29e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:45.535840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c9e99054-5602-4e5c-966d-7bd15f33f29e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040765 Jul 14 09:48:45.536384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 598/1287] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 09:48:46.160921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b7c607c7-fee1-4326-b181-82fa62fddfd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:46.161543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b7c607c7-fee1-4326-b181-82fa62fddfd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:46.167726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7c607c7-fee1-4326-b181-82fa62fddfd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:46.168170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7c607c7-fee1-4326-b181-82fa62fddfd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:46.168927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7c607c7-fee1-4326-b181-82fa62fddfd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:46.169382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7c607c7-fee1-4326-b181-82fa62fddfd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:46.298756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b7c607c7-fee1-4326-b181-82fa62fddfd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:46.306112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b7c607c7-fee1-4326-b181-82fa62fddfd4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149148 Jul 14 09:48:46.306695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 599/1288] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:46 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:46.502312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8c6ffc1f-47b5-4b88-84dd-464989c793bf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:46.503235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8c6ffc1f-47b5-4b88-84dd-464989c793bf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:46.509651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c6ffc1f-47b5-4b88-84dd-464989c793bf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:46.510103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c6ffc1f-47b5-4b88-84dd-464989c793bf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:46.510892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c6ffc1f-47b5-4b88-84dd-464989c793bf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:46.511325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c6ffc1f-47b5-4b88-84dd-464989c793bf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:46.515083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:46.541552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8c6ffc1f-47b5-4b88-84dd-464989c793bf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 Jul 14 09:48:46.542209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 600/1289] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:48:46.546793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3eaaa751-8e62-4acc-be58-6b31b90fc70d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:46.547683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3eaaa751-8e62-4acc-be58-6b31b90fc70d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:46.556750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eaaa751-8e62-4acc-be58-6b31b90fc70d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:46.556750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eaaa751-8e62-4acc-be58-6b31b90fc70d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:46.556750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eaaa751-8e62-4acc-be58-6b31b90fc70d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:46.556750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eaaa751-8e62-4acc-be58-6b31b90fc70d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:46.583917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3eaaa751-8e62-4acc-be58-6b31b90fc70d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040651 Jul 14 09:48:46.584472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 601/1290] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:47.323808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c965b90-79c8-4b7f-abc1-50de985194ee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:47.324412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c965b90-79c8-4b7f-abc1-50de985194ee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:47.330588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c965b90-79c8-4b7f-abc1-50de985194ee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:47.331030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c965b90-79c8-4b7f-abc1-50de985194ee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:47.331780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c965b90-79c8-4b7f-abc1-50de985194ee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:47.332212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c965b90-79c8-4b7f-abc1-50de985194ee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:47.458342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1c965b90-79c8-4b7f-abc1-50de985194ee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:47.465900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c965b90-79c8-4b7f-abc1-50de985194ee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.145915 Jul 14 09:48:47.466492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 602/1291] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:47 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:47.553451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ab530b43-3bef-4a33-a149-aee139664fdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:47.554411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ab530b43-3bef-4a33-a149-aee139664fdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:47.560966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab530b43-3bef-4a33-a149-aee139664fdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:47.561416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab530b43-3bef-4a33-a149-aee139664fdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:47.562174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab530b43-3bef-4a33-a149-aee139664fdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:47.562632 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ab530b43-3bef-4a33-a149-aee139664fdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:47.591052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ab530b43-3bef-4a33-a149-aee139664fdf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041393 Jul 14 09:48:47.591533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 603/1292] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 09:48:47.596821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d63cdc3f-8901-4adf-a960-87e7e255843f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:47.597703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d63cdc3f-8901-4adf-a960-87e7e255843f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:47.603239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d63cdc3f-8901-4adf-a960-87e7e255843f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:47.603675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d63cdc3f-8901-4adf-a960-87e7e255843f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:47.604416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d63cdc3f-8901-4adf-a960-87e7e255843f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:47.604843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d63cdc3f-8901-4adf-a960-87e7e255843f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:47.632902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d63cdc3f-8901-4adf-a960-87e7e255843f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040431 Jul 14 09:48:47.633426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 604/1293] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:48.483286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-945502fe-8001-4b32-b75a-2f91f1d81df9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:48.483892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-945502fe-8001-4b32-b75a-2f91f1d81df9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:48.490028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-945502fe-8001-4b32-b75a-2f91f1d81df9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:48.490591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-945502fe-8001-4b32-b75a-2f91f1d81df9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:48.491337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-945502fe-8001-4b32-b75a-2f91f1d81df9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:48.491764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-945502fe-8001-4b32-b75a-2f91f1d81df9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:48.623025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-945502fe-8001-4b32-b75a-2f91f1d81df9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:48.630982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-945502fe-8001-4b32-b75a-2f91f1d81df9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151543 Jul 14 09:48:48.631532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 605/1294] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:48 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:48.636006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9802246d-216a-4326-886a-069b971e9a85 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:48.636998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9802246d-216a-4326-886a-069b971e9a85 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:48.642699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9802246d-216a-4326-886a-069b971e9a85 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:48.643138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9802246d-216a-4326-886a-069b971e9a85 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:48.643886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9802246d-216a-4326-886a-069b971e9a85 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:48.644315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9802246d-216a-4326-886a-069b971e9a85 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:48.671627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9802246d-216a-4326-886a-069b971e9a85 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039138 Jul 14 09:48:48.672709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 606/1295] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:48.677221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72d99dd8-01d7-4622-af1b-a1c14d7f754f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:48.678097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-72d99dd8-01d7-4622-af1b-a1c14d7f754f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:48.683510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72d99dd8-01d7-4622-af1b-a1c14d7f754f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:48.684028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72d99dd8-01d7-4622-af1b-a1c14d7f754f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:48.684765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72d99dd8-01d7-4622-af1b-a1c14d7f754f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:48.685192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72d99dd8-01d7-4622-af1b-a1c14d7f754f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:48.713851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-72d99dd8-01d7-4622-af1b-a1c14d7f754f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040203 Jul 14 09:48:48.714410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 607/1296] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:49.647986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d226bab4-9fb2-465f-9f30-4a1690d3e668 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:49.648636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d226bab4-9fb2-465f-9f30-4a1690d3e668 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:49.655031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d226bab4-9fb2-465f-9f30-4a1690d3e668 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:49.655479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d226bab4-9fb2-465f-9f30-4a1690d3e668 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:49.656750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d226bab4-9fb2-465f-9f30-4a1690d3e668 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:49.657191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d226bab4-9fb2-465f-9f30-4a1690d3e668 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:49.785756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d226bab4-9fb2-465f-9f30-4a1690d3e668 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:49.793231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d226bab4-9fb2-465f-9f30-4a1690d3e668 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149172 Jul 14 09:48:49.793781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 608/1297] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:49 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:49.798932 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5ceb27e8-0009-43c3-96d3-ac72883d59dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:49.799854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5ceb27e8-0009-43c3-96d3-ac72883d59dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:49.805441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ceb27e8-0009-43c3-96d3-ac72883d59dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:49.805888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ceb27e8-0009-43c3-96d3-ac72883d59dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:49.806676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ceb27e8-0009-43c3-96d3-ac72883d59dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:49.807112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ceb27e8-0009-43c3-96d3-ac72883d59dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:49.834851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5ceb27e8-0009-43c3-96d3-ac72883d59dc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039977 Jul 14 09:48:49.835323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 609/1298] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:49.839733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5816caf4-4dd2-4670-b50b-e6c0e02061f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:49.840616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5816caf4-4dd2-4670-b50b-e6c0e02061f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:49.846752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5816caf4-4dd2-4670-b50b-e6c0e02061f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:49.847200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5816caf4-4dd2-4670-b50b-e6c0e02061f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:49.847958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5816caf4-4dd2-4670-b50b-e6c0e02061f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:49.848397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5816caf4-4dd2-4670-b50b-e6c0e02061f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:49.876807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5816caf4-4dd2-4670-b50b-e6c0e02061f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040529 Jul 14 09:48:49.877343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 610/1299] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:50.304355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=6 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:50.326497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=16 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:50.811138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bffbca8d-4e59-4ae6-99b2-285eec32969d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:50.811677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bffbca8d-4e59-4ae6-99b2-285eec32969d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:50.819045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bffbca8d-4e59-4ae6-99b2-285eec32969d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:50.819495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bffbca8d-4e59-4ae6-99b2-285eec32969d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:50.820253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bffbca8d-4e59-4ae6-99b2-285eec32969d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:50.820687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bffbca8d-4e59-4ae6-99b2-285eec32969d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:50.952348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bffbca8d-4e59-4ae6-99b2-285eec32969d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:50.959888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bffbca8d-4e59-4ae6-99b2-285eec32969d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152670 Jul 14 09:48:50.960441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 611/1300] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:50 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:50.964885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-139bb539-628b-4990-acd6-3577fbf1e0db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:50.965781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-139bb539-628b-4990-acd6-3577fbf1e0db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:50.971318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-139bb539-628b-4990-acd6-3577fbf1e0db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:50.971767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-139bb539-628b-4990-acd6-3577fbf1e0db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:50.972519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-139bb539-628b-4990-acd6-3577fbf1e0db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:50.972955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-139bb539-628b-4990-acd6-3577fbf1e0db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:51.000462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-139bb539-628b-4990-acd6-3577fbf1e0db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039059 Jul 14 09:48:51.001568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 612/1301] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:51.005944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-91ac8a0f-4301-4a52-939f-fc0f0bcf3e0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:51.006836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-91ac8a0f-4301-4a52-939f-fc0f0bcf3e0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:51.012292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91ac8a0f-4301-4a52-939f-fc0f0bcf3e0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:51.012738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91ac8a0f-4301-4a52-939f-fc0f0bcf3e0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:51.013482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91ac8a0f-4301-4a52-939f-fc0f0bcf3e0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:51.013921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91ac8a0f-4301-4a52-939f-fc0f0bcf3e0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:51.040987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-91ac8a0f-4301-4a52-939f-fc0f0bcf3e0a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038474 Jul 14 09:48:51.041520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 613/1302] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:51.976916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d0f16fa7-96db-4bd1-85e1-2bbca86545ba tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:51.977526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d0f16fa7-96db-4bd1-85e1-2bbca86545ba tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:51.983959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d0f16fa7-96db-4bd1-85e1-2bbca86545ba tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:51.984411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d0f16fa7-96db-4bd1-85e1-2bbca86545ba tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:51.985217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d0f16fa7-96db-4bd1-85e1-2bbca86545ba tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:51.985646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d0f16fa7-96db-4bd1-85e1-2bbca86545ba tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:52.114398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d0f16fa7-96db-4bd1-85e1-2bbca86545ba tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:52.122030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d0f16fa7-96db-4bd1-85e1-2bbca86545ba tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149155 Jul 14 09:48:52.122615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 614/1303] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:51 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:52.128250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8debd2a5-fde6-4c53-8143-a2060098f670 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:52.129154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8debd2a5-fde6-4c53-8143-a2060098f670 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:52.135115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8debd2a5-fde6-4c53-8143-a2060098f670 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:52.135556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8debd2a5-fde6-4c53-8143-a2060098f670 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:52.136303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8debd2a5-fde6-4c53-8143-a2060098f670 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:52.136869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8debd2a5-fde6-4c53-8143-a2060098f670 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:52.166079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8debd2a5-fde6-4c53-8143-a2060098f670 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042450 Jul 14 09:48:52.166655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 615/1304] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:52.171379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-472c5cf8-8df7-43d3-995c-a91438c01aca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:52.172266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-472c5cf8-8df7-43d3-995c-a91438c01aca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:52.179167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-472c5cf8-8df7-43d3-995c-a91438c01aca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:52.179622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-472c5cf8-8df7-43d3-995c-a91438c01aca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:52.180373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-472c5cf8-8df7-43d3-995c-a91438c01aca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:52.180809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-472c5cf8-8df7-43d3-995c-a91438c01aca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:52.206551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:52.211893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-472c5cf8-8df7-43d3-995c-a91438c01aca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044237 Jul 14 09:48:52.212382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 616/1305] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:53.140492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e2d644e7-3970-45c2-977d-af75e4ec681d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:53.141115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e2d644e7-3970-45c2-977d-af75e4ec681d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:53.147422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2d644e7-3970-45c2-977d-af75e4ec681d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:53.147866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2d644e7-3970-45c2-977d-af75e4ec681d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:53.148614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2d644e7-3970-45c2-977d-af75e4ec681d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:53.149046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2d644e7-3970-45c2-977d-af75e4ec681d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:53.275705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e2d644e7-3970-45c2-977d-af75e4ec681d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:53.283242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e2d644e7-3970-45c2-977d-af75e4ec681d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146924 Jul 14 09:48:53.283792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 617/1306] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:53 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:53.288389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2070890f-f58e-4c27-9308-76753f0c1e46 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:53.289284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2070890f-f58e-4c27-9308-76753f0c1e46 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:53.295385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2070890f-f58e-4c27-9308-76753f0c1e46 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:53.295833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2070890f-f58e-4c27-9308-76753f0c1e46 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:53.296625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2070890f-f58e-4c27-9308-76753f0c1e46 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:53.297059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2070890f-f58e-4c27-9308-76753f0c1e46 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:53.325904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2070890f-f58e-4c27-9308-76753f0c1e46 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Jul 14 09:48:53.326471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 618/1307] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:53 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:53.330911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-db9c1a16-32f1-444f-85d1-7c4c0adf8c56 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:53.331783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-db9c1a16-32f1-444f-85d1-7c4c0adf8c56 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:53.337215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db9c1a16-32f1-444f-85d1-7c4c0adf8c56 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:53.337659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db9c1a16-32f1-444f-85d1-7c4c0adf8c56 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:53.338444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db9c1a16-32f1-444f-85d1-7c4c0adf8c56 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:53.338878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db9c1a16-32f1-444f-85d1-7c4c0adf8c56 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:53.366532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-db9c1a16-32f1-444f-85d1-7c4c0adf8c56 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039080 Jul 14 09:48:53.367275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 619/1308] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:54.300794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3cda9b2c-352a-4e36-be31-f75bb10c499d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:54.301471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3cda9b2c-352a-4e36-be31-f75bb10c499d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:54.307959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cda9b2c-352a-4e36-be31-f75bb10c499d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:54.308404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cda9b2c-352a-4e36-be31-f75bb10c499d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:54.309156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cda9b2c-352a-4e36-be31-f75bb10c499d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:54.309585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cda9b2c-352a-4e36-be31-f75bb10c499d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:54.439033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3cda9b2c-352a-4e36-be31-f75bb10c499d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:54.446792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3cda9b2c-352a-4e36-be31-f75bb10c499d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150483 Jul 14 09:48:54.447349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 620/1309] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:54 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:48:54.452027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-09fbccd0-013a-4bf0-a3d7-61f5bfea6ab0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:54.452920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-09fbccd0-013a-4bf0-a3d7-61f5bfea6ab0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:54.458491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-09fbccd0-013a-4bf0-a3d7-61f5bfea6ab0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:54.458937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-09fbccd0-013a-4bf0-a3d7-61f5bfea6ab0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:54.459687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-09fbccd0-013a-4bf0-a3d7-61f5bfea6ab0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:54.460114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-09fbccd0-013a-4bf0-a3d7-61f5bfea6ab0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:54.488670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-09fbccd0-013a-4bf0-a3d7-61f5bfea6ab0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040336 Jul 14 09:48:54.489204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 621/1310] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:54.493737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d4ba5f5c-844f-4bec-a935-2ad3c326c20a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:54.494626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d4ba5f5c-844f-4bec-a935-2ad3c326c20a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:54.500001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d4ba5f5c-844f-4bec-a935-2ad3c326c20a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:54.500443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d4ba5f5c-844f-4bec-a935-2ad3c326c20a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:54.501178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d4ba5f5c-844f-4bec-a935-2ad3c326c20a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:54.501605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d4ba5f5c-844f-4bec-a935-2ad3c326c20a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:54.529514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d4ba5f5c-844f-4bec-a935-2ad3c326c20a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039334 Jul 14 09:48:54.530065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 622/1311] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:55.463650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4cf27525-60dd-4313-a5f6-43abcbaf226d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:55.464326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4cf27525-60dd-4313-a5f6-43abcbaf226d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:55.471407 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cf27525-60dd-4313-a5f6-43abcbaf226d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:55.471846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cf27525-60dd-4313-a5f6-43abcbaf226d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:55.472594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cf27525-60dd-4313-a5f6-43abcbaf226d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:55.473023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cf27525-60dd-4313-a5f6-43abcbaf226d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:55.600456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4cf27525-60dd-4313-a5f6-43abcbaf226d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:55.607965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4cf27525-60dd-4313-a5f6-43abcbaf226d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148186 Jul 14 09:48:55.608513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 623/1312] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:55 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:55.612927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0b1960fb-2f73-4edd-a375-45b9589284f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:55.613825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0b1960fb-2f73-4edd-a375-45b9589284f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:55.619617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b1960fb-2f73-4edd-a375-45b9589284f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:55.620071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b1960fb-2f73-4edd-a375-45b9589284f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:55.620838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b1960fb-2f73-4edd-a375-45b9589284f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:55.621297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b1960fb-2f73-4edd-a375-45b9589284f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:55.649578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0b1960fb-2f73-4edd-a375-45b9589284f4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040075 Jul 14 09:48:55.650127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 624/1313] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:55.654572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f8f50cb9-663f-44b2-bbdc-e5ebfa42759c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:55.655457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f8f50cb9-663f-44b2-bbdc-e5ebfa42759c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:55.661677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8f50cb9-663f-44b2-bbdc-e5ebfa42759c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:55.662130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8f50cb9-663f-44b2-bbdc-e5ebfa42759c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:55.662916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8f50cb9-663f-44b2-bbdc-e5ebfa42759c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:55.663355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f8f50cb9-663f-44b2-bbdc-e5ebfa42759c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:55.692276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f8f50cb9-663f-44b2-bbdc-e5ebfa42759c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041157 Jul 14 09:48:55.692818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 625/1314] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:56.624749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1bcfd25a-4a34-4f43-a80b-f604bdbedce9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:56.625412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1bcfd25a-4a34-4f43-a80b-f604bdbedce9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:56.632041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bcfd25a-4a34-4f43-a80b-f604bdbedce9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:56.632489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bcfd25a-4a34-4f43-a80b-f604bdbedce9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:56.633253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bcfd25a-4a34-4f43-a80b-f604bdbedce9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:56.633692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bcfd25a-4a34-4f43-a80b-f604bdbedce9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:56.763244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1bcfd25a-4a34-4f43-a80b-f604bdbedce9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:56.771213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1bcfd25a-4a34-4f43-a80b-f604bdbedce9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150370 Jul 14 09:48:56.771773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 626/1315] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:56 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:56.776211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5ceed9fa-ec9e-46ed-ba1c-721d54baf0be tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:56.777274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5ceed9fa-ec9e-46ed-ba1c-721d54baf0be tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:56.783371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ceed9fa-ec9e-46ed-ba1c-721d54baf0be tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:56.783814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ceed9fa-ec9e-46ed-ba1c-721d54baf0be tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:56.784568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ceed9fa-ec9e-46ed-ba1c-721d54baf0be tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:56.784995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ceed9fa-ec9e-46ed-ba1c-721d54baf0be tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:56.813483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5ceed9fa-ec9e-46ed-ba1c-721d54baf0be tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 Jul 14 09:48:56.813950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 627/1316] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:56.818602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a67b24b6-5439-4b02-8b03-c670c54c2fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:56.819466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a67b24b6-5439-4b02-8b03-c670c54c2fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:56.824844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a67b24b6-5439-4b02-8b03-c670c54c2fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:56.825357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a67b24b6-5439-4b02-8b03-c670c54c2fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:56.826115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a67b24b6-5439-4b02-8b03-c670c54c2fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:56.826577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a67b24b6-5439-4b02-8b03-c670c54c2fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:56.854946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a67b24b6-5439-4b02-8b03-c670c54c2fa1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039779 Jul 14 09:48:56.855470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 628/1317] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:57.789372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-812d7e7d-0a34-4254-b0c7-43ba3aa319b5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:57.790083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-812d7e7d-0a34-4254-b0c7-43ba3aa319b5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:57.796638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-812d7e7d-0a34-4254-b0c7-43ba3aa319b5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:57.797085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-812d7e7d-0a34-4254-b0c7-43ba3aa319b5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:57.797846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-812d7e7d-0a34-4254-b0c7-43ba3aa319b5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:57.798308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-812d7e7d-0a34-4254-b0c7-43ba3aa319b5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:57.928136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-812d7e7d-0a34-4254-b0c7-43ba3aa319b5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:57.935926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-812d7e7d-0a34-4254-b0c7-43ba3aa319b5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150893 Jul 14 09:48:57.936497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 629/1318] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:57 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:57.941871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4b2aefb3-2448-4d27-b3d3-116b705b1333 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:57.942861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4b2aefb3-2448-4d27-b3d3-116b705b1333 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:57.948792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b2aefb3-2448-4d27-b3d3-116b705b1333 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:57.949244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b2aefb3-2448-4d27-b3d3-116b705b1333 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:57.950010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b2aefb3-2448-4d27-b3d3-116b705b1333 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:57.950471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b2aefb3-2448-4d27-b3d3-116b705b1333 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:57.979536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4b2aefb3-2448-4d27-b3d3-116b705b1333 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041889 Jul 14 09:48:57.980096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 630/1319] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:57.984969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bface492-2a73-410e-96d8-027df8370a4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:57.985875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bface492-2a73-410e-96d8-027df8370a4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:57.991700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bface492-2a73-410e-96d8-027df8370a4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:57.992151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bface492-2a73-410e-96d8-027df8370a4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:57.992921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bface492-2a73-410e-96d8-027df8370a4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:57.993356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bface492-2a73-410e-96d8-027df8370a4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:58.022835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bface492-2a73-410e-96d8-027df8370a4a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041630 Jul 14 09:48:58.023318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 631/1320] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:48:58.952988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9085b01d-1e4b-4acd-bc61-39acc7f823c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:58.953959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9085b01d-1e4b-4acd-bc61-39acc7f823c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:58.960359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9085b01d-1e4b-4acd-bc61-39acc7f823c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:58.960852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9085b01d-1e4b-4acd-bc61-39acc7f823c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:58.961601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9085b01d-1e4b-4acd-bc61-39acc7f823c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:58.962030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9085b01d-1e4b-4acd-bc61-39acc7f823c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:59.089937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9085b01d-1e4b-4acd-bc61-39acc7f823c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:48:59.098075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9085b01d-1e4b-4acd-bc61-39acc7f823c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148965 Jul 14 09:48:59.098659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 632/1321] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:48:58 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:48:59.103130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a9753fa5-e1fd-4718-93e0-d6a240d77a9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:59.104035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a9753fa5-e1fd-4718-93e0-d6a240d77a9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:59.106676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:59.110529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9753fa5-e1fd-4718-93e0-d6a240d77a9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:59.110978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9753fa5-e1fd-4718-93e0-d6a240d77a9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:59.111733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9753fa5-e1fd-4718-93e0-d6a240d77a9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:59.112167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9753fa5-e1fd-4718-93e0-d6a240d77a9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:59.128403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:48:59.141300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a9753fa5-e1fd-4718-93e0-d6a240d77a9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041163 Jul 14 09:48:59.141840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 633/1322] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:48:59 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:48:59.146364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c7d37e0-d975-4ea3-99f6-6f90943e0506 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:48:59.147246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3c7d37e0-d975-4ea3-99f6-6f90943e0506 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:48:59.152800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c7d37e0-d975-4ea3-99f6-6f90943e0506 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:59.153240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c7d37e0-d975-4ea3-99f6-6f90943e0506 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:59.153988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c7d37e0-d975-4ea3-99f6-6f90943e0506 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:48:59.154449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c7d37e0-d975-4ea3-99f6-6f90943e0506 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:48:59.182543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3c7d37e0-d975-4ea3-99f6-6f90943e0506 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039689 Jul 14 09:48:59.183080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 634/1323] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:48:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:00.115431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2b4f059c-1d46-41c9-9947-95030f506c98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:00.116097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2b4f059c-1d46-41c9-9947-95030f506c98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:00.122644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2b4f059c-1d46-41c9-9947-95030f506c98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:00.123087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2b4f059c-1d46-41c9-9947-95030f506c98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:00.123842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2b4f059c-1d46-41c9-9947-95030f506c98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:00.124276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2b4f059c-1d46-41c9-9947-95030f506c98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:00.256123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2b4f059c-1d46-41c9-9947-95030f506c98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:00.263467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2b4f059c-1d46-41c9-9947-95030f506c98 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151921 Jul 14 09:49:00.264021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 635/1324] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:00 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:00.268506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1132fcae-785a-428f-ae34-d0679b0e5694 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:00.269394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1132fcae-785a-428f-ae34-d0679b0e5694 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:00.274853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1132fcae-785a-428f-ae34-d0679b0e5694 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:00.275292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1132fcae-785a-428f-ae34-d0679b0e5694 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:00.276035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1132fcae-785a-428f-ae34-d0679b0e5694 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:00.276456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1132fcae-785a-428f-ae34-d0679b0e5694 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:00.304818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1132fcae-785a-428f-ae34-d0679b0e5694 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039804 Jul 14 09:49:00.305365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 636/1325] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:00 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:00.309883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b9d13ea0-cb1d-406e-959f-5ee8b5916279 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:00.310796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b9d13ea0-cb1d-406e-959f-5ee8b5916279 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:00.317011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9d13ea0-cb1d-406e-959f-5ee8b5916279 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:00.317459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9d13ea0-cb1d-406e-959f-5ee8b5916279 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:00.318233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9d13ea0-cb1d-406e-959f-5ee8b5916279 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:00.318665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9d13ea0-cb1d-406e-959f-5ee8b5916279 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:00.349063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b9d13ea0-cb1d-406e-959f-5ee8b5916279 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042676 Jul 14 09:49:00.349619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 637/1326] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:01.280719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1bec09f8-331b-44bd-bc90-79398337fef5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:01.281423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1bec09f8-331b-44bd-bc90-79398337fef5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:01.287864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bec09f8-331b-44bd-bc90-79398337fef5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:01.288310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bec09f8-331b-44bd-bc90-79398337fef5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:01.289066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bec09f8-331b-44bd-bc90-79398337fef5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:01.289499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1bec09f8-331b-44bd-bc90-79398337fef5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:01.415945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1bec09f8-331b-44bd-bc90-79398337fef5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:01.423952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1bec09f8-331b-44bd-bc90-79398337fef5 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147195 Jul 14 09:49:01.424502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 638/1327] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:01 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:01.428895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ec49b6a2-6724-489e-9a03-a29cb7b1d560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:01.429789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ec49b6a2-6724-489e-9a03-a29cb7b1d560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:01.435450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec49b6a2-6724-489e-9a03-a29cb7b1d560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:01.435895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec49b6a2-6724-489e-9a03-a29cb7b1d560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:01.436677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec49b6a2-6724-489e-9a03-a29cb7b1d560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:01.437143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec49b6a2-6724-489e-9a03-a29cb7b1d560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:01.465413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ec49b6a2-6724-489e-9a03-a29cb7b1d560 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039944 Jul 14 09:49:01.465938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 639/1328] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:01.470639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-52b56be0-e056-4683-8d73-bb41537a8d24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:01.471511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-52b56be0-e056-4683-8d73-bb41537a8d24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:01.477421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52b56be0-e056-4683-8d73-bb41537a8d24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:01.477863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52b56be0-e056-4683-8d73-bb41537a8d24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:01.478703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52b56be0-e056-4683-8d73-bb41537a8d24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:01.479180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52b56be0-e056-4683-8d73-bb41537a8d24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:01.509062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-52b56be0-e056-4683-8d73-bb41537a8d24 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042128 Jul 14 09:49:01.509599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 640/1329] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:02.441135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1393ee6e-ec1b-4fc7-9f68-80a9e72f15be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:02.441820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1393ee6e-ec1b-4fc7-9f68-80a9e72f15be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:02.448416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1393ee6e-ec1b-4fc7-9f68-80a9e72f15be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:02.448900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1393ee6e-ec1b-4fc7-9f68-80a9e72f15be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:02.449663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1393ee6e-ec1b-4fc7-9f68-80a9e72f15be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:02.450101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1393ee6e-ec1b-4fc7-9f68-80a9e72f15be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:02.835471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1393ee6e-ec1b-4fc7-9f68-80a9e72f15be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:02.844975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1393ee6e-ec1b-4fc7-9f68-80a9e72f15be tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.408065 Jul 14 09:49:02.845533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 641/1330] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:02 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:02.850127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c3dd04d-1d46-4134-afd7-51e52214c9ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:02.851175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c3dd04d-1d46-4134-afd7-51e52214c9ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:02.856773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c3dd04d-1d46-4134-afd7-51e52214c9ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:02.857221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c3dd04d-1d46-4134-afd7-51e52214c9ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:02.857978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c3dd04d-1d46-4134-afd7-51e52214c9ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:02.858544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c3dd04d-1d46-4134-afd7-51e52214c9ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:02.887004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c3dd04d-1d46-4134-afd7-51e52214c9ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040502 Jul 14 09:49:02.887544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 642/1331] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:02 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:02.892652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ed8bc123-b3af-489a-a348-86a84e92d2cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:02.893818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ed8bc123-b3af-489a-a348-86a84e92d2cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:02.901503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed8bc123-b3af-489a-a348-86a84e92d2cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:02.901947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed8bc123-b3af-489a-a348-86a84e92d2cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:02.902744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed8bc123-b3af-489a-a348-86a84e92d2cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:02.903173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed8bc123-b3af-489a-a348-86a84e92d2cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:02.932200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ed8bc123-b3af-489a-a348-86a84e92d2cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043681 Jul 14 09:49:02.932762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 643/1332] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:03.862012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7b89a246-b0c7-4a06-9895-0622209d89ce tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:03.862666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7b89a246-b0c7-4a06-9895-0622209d89ce tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:03.869089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b89a246-b0c7-4a06-9895-0622209d89ce tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:03.869531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b89a246-b0c7-4a06-9895-0622209d89ce tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:03.870303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b89a246-b0c7-4a06-9895-0622209d89ce tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:03.870733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7b89a246-b0c7-4a06-9895-0622209d89ce tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:03.995860 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7b89a246-b0c7-4a06-9895-0622209d89ce tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:04.003797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7b89a246-b0c7-4a06-9895-0622209d89ce tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.145689 Jul 14 09:49:04.004350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 644/1333] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:03 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:04.009017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-32e0b27b-3c46-4247-b068-64d9f4aa732d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:04.009911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-32e0b27b-3c46-4247-b068-64d9f4aa732d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:04.016222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32e0b27b-3c46-4247-b068-64d9f4aa732d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:04.016670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32e0b27b-3c46-4247-b068-64d9f4aa732d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:04.017416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32e0b27b-3c46-4247-b068-64d9f4aa732d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:04.017847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32e0b27b-3c46-4247-b068-64d9f4aa732d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:04.045360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-32e0b27b-3c46-4247-b068-64d9f4aa732d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040048 Jul 14 09:49:04.045896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 645/1334] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:04.050431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6a2be684-c6ca-4602-8504-107cc3701056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:04.051293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6a2be684-c6ca-4602-8504-107cc3701056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:04.056698 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a2be684-c6ca-4602-8504-107cc3701056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:04.057138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a2be684-c6ca-4602-8504-107cc3701056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:04.057880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a2be684-c6ca-4602-8504-107cc3701056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:04.058340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a2be684-c6ca-4602-8504-107cc3701056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:04.087958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6a2be684-c6ca-4602-8504-107cc3701056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040973 Jul 14 09:49:04.088426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 646/1335] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:05.021356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5ee5c552-e83e-4339-a761-62b6ced023c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:05.022012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5ee5c552-e83e-4339-a761-62b6ced023c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:05.028488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ee5c552-e83e-4339-a761-62b6ced023c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:05.028928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ee5c552-e83e-4339-a761-62b6ced023c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:05.029676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ee5c552-e83e-4339-a761-62b6ced023c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:05.030106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ee5c552-e83e-4339-a761-62b6ced023c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:05.160481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5ee5c552-e83e-4339-a761-62b6ced023c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:05.168014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5ee5c552-e83e-4339-a761-62b6ced023c1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150553 Jul 14 09:49:05.168572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 647/1336] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:05 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:05.173629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6002a8bc-521f-4682-81e3-3eebeb78e23b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:05.174623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6002a8bc-521f-4682-81e3-3eebeb78e23b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:05.180236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6002a8bc-521f-4682-81e3-3eebeb78e23b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:05.180684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6002a8bc-521f-4682-81e3-3eebeb78e23b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:05.181447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6002a8bc-521f-4682-81e3-3eebeb78e23b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:05.181881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6002a8bc-521f-4682-81e3-3eebeb78e23b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:05.210119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6002a8bc-521f-4682-81e3-3eebeb78e23b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040574 Jul 14 09:49:05.210687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 648/1337] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:05.215269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-65864171-d2cb-46d4-a224-c351a34b88ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:05.216145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-65864171-d2cb-46d4-a224-c351a34b88ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:05.221686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-65864171-d2cb-46d4-a224-c351a34b88ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:05.222137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-65864171-d2cb-46d4-a224-c351a34b88ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:05.222943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-65864171-d2cb-46d4-a224-c351a34b88ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:05.223387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-65864171-d2cb-46d4-a224-c351a34b88ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:05.251776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-65864171-d2cb-46d4-a224-c351a34b88ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040133 Jul 14 09:49:05.252318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 649/1338] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:06.185562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c35112cf-9d27-4231-b0ac-7731e19e48a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:06.186314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c35112cf-9d27-4231-b0ac-7731e19e48a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:06.195240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c35112cf-9d27-4231-b0ac-7731e19e48a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:06.195699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c35112cf-9d27-4231-b0ac-7731e19e48a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:06.196469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c35112cf-9d27-4231-b0ac-7731e19e48a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:06.196909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c35112cf-9d27-4231-b0ac-7731e19e48a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:06.201062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:06.325420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c35112cf-9d27-4231-b0ac-7731e19e48a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:06.333062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c35112cf-9d27-4231-b0ac-7731e19e48a3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151339 Jul 14 09:49:06.333567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 650/1339] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:06 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:06.338153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5c7befde-a0c3-44cc-9d4d-5fb289c4bba0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:06.339086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5c7befde-a0c3-44cc-9d4d-5fb289c4bba0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:06.345305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c7befde-a0c3-44cc-9d4d-5fb289c4bba0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:06.345756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c7befde-a0c3-44cc-9d4d-5fb289c4bba0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:06.346548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c7befde-a0c3-44cc-9d4d-5fb289c4bba0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:06.346993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c7befde-a0c3-44cc-9d4d-5fb289c4bba0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:06.375234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5c7befde-a0c3-44cc-9d4d-5fb289c4bba0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040669 Jul 14 09:49:06.375776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 651/1340] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:06 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:06.380357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cad0c4cd-68a8-4461-a906-a75a2512be88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:06.381248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cad0c4cd-68a8-4461-a906-a75a2512be88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:06.386829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cad0c4cd-68a8-4461-a906-a75a2512be88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:06.387281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cad0c4cd-68a8-4461-a906-a75a2512be88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:06.388053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cad0c4cd-68a8-4461-a906-a75a2512be88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:06.388475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cad0c4cd-68a8-4461-a906-a75a2512be88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:06.417022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cad0c4cd-68a8-4461-a906-a75a2512be88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040267 Jul 14 09:49:06.417558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 652/1341] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:07.349806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-118be012-8fdb-4e48-8a46-1b3433a2d719 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:07.350526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-118be012-8fdb-4e48-8a46-1b3433a2d719 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:07.356890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-118be012-8fdb-4e48-8a46-1b3433a2d719 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:07.357329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-118be012-8fdb-4e48-8a46-1b3433a2d719 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:07.358076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-118be012-8fdb-4e48-8a46-1b3433a2d719 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:07.358532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-118be012-8fdb-4e48-8a46-1b3433a2d719 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:07.489354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-118be012-8fdb-4e48-8a46-1b3433a2d719 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:07.496741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-118be012-8fdb-4e48-8a46-1b3433a2d719 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150792 Jul 14 09:49:07.497295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 653/1342] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:07 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:49:07.502641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5f65d4a5-fdba-47ce-a0a4-8972de0ad969 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:07.503540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5f65d4a5-fdba-47ce-a0a4-8972de0ad969 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:07.509144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f65d4a5-fdba-47ce-a0a4-8972de0ad969 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:07.509585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f65d4a5-fdba-47ce-a0a4-8972de0ad969 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:07.510368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f65d4a5-fdba-47ce-a0a4-8972de0ad969 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:07.510953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f65d4a5-fdba-47ce-a0a4-8972de0ad969 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:07.538694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5f65d4a5-fdba-47ce-a0a4-8972de0ad969 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040304 Jul 14 09:49:07.539238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 654/1343] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:07.543819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-df693493-fa47-4197-8010-3c0485fbc3a6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:07.544692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-df693493-fa47-4197-8010-3c0485fbc3a6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:07.551231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df693493-fa47-4197-8010-3c0485fbc3a6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:07.551680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df693493-fa47-4197-8010-3c0485fbc3a6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:07.552442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df693493-fa47-4197-8010-3c0485fbc3a6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:07.552870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df693493-fa47-4197-8010-3c0485fbc3a6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:07.583335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-df693493-fa47-4197-8010-3c0485fbc3a6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043086 Jul 14 09:49:07.583883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 655/1344] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:08.514294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b8aa266d-a990-4f60-86e9-de4e3c10f1cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:08.514947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b8aa266d-a990-4f60-86e9-de4e3c10f1cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:08.521515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8aa266d-a990-4f60-86e9-de4e3c10f1cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:08.521963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8aa266d-a990-4f60-86e9-de4e3c10f1cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:08.522809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8aa266d-a990-4f60-86e9-de4e3c10f1cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:08.523241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8aa266d-a990-4f60-86e9-de4e3c10f1cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:08.650923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b8aa266d-a990-4f60-86e9-de4e3c10f1cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:08.659062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b8aa266d-a990-4f60-86e9-de4e3c10f1cd tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148645 Jul 14 09:49:08.659613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 656/1345] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:08 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:08.664061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-badb1aee-98c6-4c89-b3df-df1abff64385 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:08.664947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-badb1aee-98c6-4c89-b3df-df1abff64385 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:08.670645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-badb1aee-98c6-4c89-b3df-df1abff64385 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:08.671101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-badb1aee-98c6-4c89-b3df-df1abff64385 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:08.672480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-badb1aee-98c6-4c89-b3df-df1abff64385 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:08.672916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-badb1aee-98c6-4c89-b3df-df1abff64385 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:08.701180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-badb1aee-98c6-4c89-b3df-df1abff64385 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040590 Jul 14 09:49:08.701728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 657/1346] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:08.706203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1dd0f09f-0832-475f-afeb-a3a10b0b578a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:08.707081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1dd0f09f-0832-475f-afeb-a3a10b0b578a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:08.712607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1dd0f09f-0832-475f-afeb-a3a10b0b578a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:08.713060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1dd0f09f-0832-475f-afeb-a3a10b0b578a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:08.713813 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1dd0f09f-0832-475f-afeb-a3a10b0b578a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:08.714280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1dd0f09f-0832-475f-afeb-a3a10b0b578a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:08.743336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1dd0f09f-0832-475f-afeb-a3a10b0b578a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040321 Jul 14 09:49:08.744221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 658/1347] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:09.677261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-50e8b6a1-30de-402a-933f-df7ac4da552c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:09.677910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-50e8b6a1-30de-402a-933f-df7ac4da552c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:09.684410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50e8b6a1-30de-402a-933f-df7ac4da552c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:09.684856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50e8b6a1-30de-402a-933f-df7ac4da552c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:09.685608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50e8b6a1-30de-402a-933f-df7ac4da552c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:09.686041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50e8b6a1-30de-402a-933f-df7ac4da552c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:09.813796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-50e8b6a1-30de-402a-933f-df7ac4da552c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:09.821803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-50e8b6a1-30de-402a-933f-df7ac4da552c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148444 Jul 14 09:49:09.822382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 659/1348] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:09 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:09.826867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c4c6553a-226f-47b9-baea-02a40263d6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:09.827782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c4c6553a-226f-47b9-baea-02a40263d6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:09.833377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4c6553a-226f-47b9-baea-02a40263d6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:09.833824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4c6553a-226f-47b9-baea-02a40263d6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:09.834640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4c6553a-226f-47b9-baea-02a40263d6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:09.835076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4c6553a-226f-47b9-baea-02a40263d6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:09.864220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c4c6553a-226f-47b9-baea-02a40263d6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040780 Jul 14 09:49:09.864771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 660/1349] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:09.869203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ebcfcf40-263e-4002-ba03-be650120b2a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:09.870142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ebcfcf40-263e-4002-ba03-be650120b2a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:09.876211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebcfcf40-263e-4002-ba03-be650120b2a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:09.876659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebcfcf40-263e-4002-ba03-be650120b2a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:09.877411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebcfcf40-263e-4002-ba03-be650120b2a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:09.877849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebcfcf40-263e-4002-ba03-be650120b2a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:09.907162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ebcfcf40-263e-4002-ba03-be650120b2a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041422 Jul 14 09:49:09.907707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 661/1350] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:09 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:10.838929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-705ec250-f7a3-4a8a-9c29-df48bef5cfd1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:10.839532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-705ec250-f7a3-4a8a-9c29-df48bef5cfd1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:10.846340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-705ec250-f7a3-4a8a-9c29-df48bef5cfd1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:10.846783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-705ec250-f7a3-4a8a-9c29-df48bef5cfd1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:10.847530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-705ec250-f7a3-4a8a-9c29-df48bef5cfd1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:10.847960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-705ec250-f7a3-4a8a-9c29-df48bef5cfd1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:10.978511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-705ec250-f7a3-4a8a-9c29-df48bef5cfd1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:10.986520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-705ec250-f7a3-4a8a-9c29-df48bef5cfd1 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151698 Jul 14 09:49:10.987076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 662/1351] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:10 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:10.991893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9d80e6e7-92a2-402b-86bb-3a587b38e9b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:10.992787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9d80e6e7-92a2-402b-86bb-3a587b38e9b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:10.998614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d80e6e7-92a2-402b-86bb-3a587b38e9b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:10.999060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d80e6e7-92a2-402b-86bb-3a587b38e9b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:10.999846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d80e6e7-92a2-402b-86bb-3a587b38e9b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:11.000405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d80e6e7-92a2-402b-86bb-3a587b38e9b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:11.029075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9d80e6e7-92a2-402b-86bb-3a587b38e9b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041028 Jul 14 09:49:11.029621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 663/1352] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:11.034811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a005f660-8daf-42eb-98c8-711645cc8e46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:11.035686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a005f660-8daf-42eb-98c8-711645cc8e46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:11.041082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a005f660-8daf-42eb-98c8-711645cc8e46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:11.041523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a005f660-8daf-42eb-98c8-711645cc8e46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:11.042289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a005f660-8daf-42eb-98c8-711645cc8e46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:11.042722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a005f660-8daf-42eb-98c8-711645cc8e46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:11.070146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a005f660-8daf-42eb-98c8-711645cc8e46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039581 Jul 14 09:49:11.070702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 664/1353] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:12.004176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-05c135c0-fed5-4cfd-b7ff-d08ecc374014 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:12.004831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-05c135c0-fed5-4cfd-b7ff-d08ecc374014 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:12.011289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05c135c0-fed5-4cfd-b7ff-d08ecc374014 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:12.011729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05c135c0-fed5-4cfd-b7ff-d08ecc374014 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:12.012480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05c135c0-fed5-4cfd-b7ff-d08ecc374014 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:12.012907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05c135c0-fed5-4cfd-b7ff-d08ecc374014 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:12.140239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-05c135c0-fed5-4cfd-b7ff-d08ecc374014 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:12.147734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-05c135c0-fed5-4cfd-b7ff-d08ecc374014 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148200 Jul 14 09:49:12.148298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 665/1354] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:11 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:12.152807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a50dbe22-7c2c-42a9-a1ec-f6f73f419815 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:12.153703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a50dbe22-7c2c-42a9-a1ec-f6f73f419815 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:12.160046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a50dbe22-7c2c-42a9-a1ec-f6f73f419815 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:12.160495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a50dbe22-7c2c-42a9-a1ec-f6f73f419815 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:12.161319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a50dbe22-7c2c-42a9-a1ec-f6f73f419815 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:12.161753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a50dbe22-7c2c-42a9-a1ec-f6f73f419815 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:12.185639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:12.191824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a50dbe22-7c2c-42a9-a1ec-f6f73f419815 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042536 Jul 14 09:49:12.192389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 666/1355] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:12.197057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0f4e8a0c-0220-4d46-8b8c-8a14683d40d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:12.197948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0f4e8a0c-0220-4d46-8b8c-8a14683d40d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:12.203714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f4e8a0c-0220-4d46-8b8c-8a14683d40d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:12.204157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f4e8a0c-0220-4d46-8b8c-8a14683d40d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:12.204908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f4e8a0c-0220-4d46-8b8c-8a14683d40d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:12.205381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f4e8a0c-0220-4d46-8b8c-8a14683d40d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:12.234884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0f4e8a0c-0220-4d46-8b8c-8a14683d40d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041527 Jul 14 09:49:12.235419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 667/1356] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:13.164749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-309b8040-b5cb-4a89-9e1b-bf59c2df8af7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:13.165450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-309b8040-b5cb-4a89-9e1b-bf59c2df8af7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:13.171877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-309b8040-b5cb-4a89-9e1b-bf59c2df8af7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:13.172325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-309b8040-b5cb-4a89-9e1b-bf59c2df8af7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:13.173087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-309b8040-b5cb-4a89-9e1b-bf59c2df8af7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:13.173526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-309b8040-b5cb-4a89-9e1b-bf59c2df8af7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:13.307764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-309b8040-b5cb-4a89-9e1b-bf59c2df8af7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:13.316256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-309b8040-b5cb-4a89-9e1b-bf59c2df8af7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.155367 Jul 14 09:49:13.316819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 668/1357] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:13 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:13.321380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-65ccfac3-32f8-400b-81d1-8f9af758c7e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:13.322314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-65ccfac3-32f8-400b-81d1-8f9af758c7e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:13.327872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-65ccfac3-32f8-400b-81d1-8f9af758c7e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:13.328319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-65ccfac3-32f8-400b-81d1-8f9af758c7e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:13.329082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-65ccfac3-32f8-400b-81d1-8f9af758c7e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:13.329521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-65ccfac3-32f8-400b-81d1-8f9af758c7e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:13.357233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-65ccfac3-32f8-400b-81d1-8f9af758c7e1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039443 Jul 14 09:49:13.357776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 669/1358] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:13 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:13.362749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1daab06a-93fe-438c-bd5f-4a4536413a30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:13.363624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1daab06a-93fe-438c-bd5f-4a4536413a30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:13.369110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1daab06a-93fe-438c-bd5f-4a4536413a30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:13.369543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1daab06a-93fe-438c-bd5f-4a4536413a30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:13.370319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1daab06a-93fe-438c-bd5f-4a4536413a30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:13.370787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1daab06a-93fe-438c-bd5f-4a4536413a30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:13.398739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1daab06a-93fe-438c-bd5f-4a4536413a30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039954 Jul 14 09:49:13.399281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 670/1359] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:14.333191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-05f71573-bab1-4068-b2ca-844c1562c360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:14.333799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-05f71573-bab1-4068-b2ca-844c1562c360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:14.340272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05f71573-bab1-4068-b2ca-844c1562c360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:14.340716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05f71573-bab1-4068-b2ca-844c1562c360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:14.341462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05f71573-bab1-4068-b2ca-844c1562c360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:14.341894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-05f71573-bab1-4068-b2ca-844c1562c360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:14.469088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-05f71573-bab1-4068-b2ca-844c1562c360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:14.476705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-05f71573-bab1-4068-b2ca-844c1562c360 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147269 Jul 14 09:49:14.477266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 671/1360] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:14 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:14.481913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ec67f38f-6681-498a-a4cc-14ac5e6aa9db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:14.482896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ec67f38f-6681-498a-a4cc-14ac5e6aa9db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:14.488623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec67f38f-6681-498a-a4cc-14ac5e6aa9db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:14.489062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec67f38f-6681-498a-a4cc-14ac5e6aa9db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:14.489809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec67f38f-6681-498a-a4cc-14ac5e6aa9db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:14.490265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec67f38f-6681-498a-a4cc-14ac5e6aa9db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:14.518650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ec67f38f-6681-498a-a4cc-14ac5e6aa9db tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040387 Jul 14 09:49:14.519182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 672/1361] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:14.523672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ff5f9744-6d6d-448e-a52f-5ddcd06a13d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:14.524531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ff5f9744-6d6d-448e-a52f-5ddcd06a13d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:14.530206 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ff5f9744-6d6d-448e-a52f-5ddcd06a13d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:14.530687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ff5f9744-6d6d-448e-a52f-5ddcd06a13d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:14.531439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ff5f9744-6d6d-448e-a52f-5ddcd06a13d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:14.531868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ff5f9744-6d6d-448e-a52f-5ddcd06a13d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:14.559686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ff5f9744-6d6d-448e-a52f-5ddcd06a13d4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039320 Jul 14 09:49:14.560076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 673/1362] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:15.493548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ddb2697e-66ee-4ad8-b4ee-2c50535b6ac7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:15.494212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ddb2697e-66ee-4ad8-b4ee-2c50535b6ac7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:15.500751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddb2697e-66ee-4ad8-b4ee-2c50535b6ac7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:15.501204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddb2697e-66ee-4ad8-b4ee-2c50535b6ac7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:15.501958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddb2697e-66ee-4ad8-b4ee-2c50535b6ac7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:15.502432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddb2697e-66ee-4ad8-b4ee-2c50535b6ac7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:15.629948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ddb2697e-66ee-4ad8-b4ee-2c50535b6ac7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:15.637413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ddb2697e-66ee-4ad8-b4ee-2c50535b6ac7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147702 Jul 14 09:49:15.637973 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 674/1363] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:15 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:15.643067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3aafc93e-2409-4b2a-a784-061766e09a76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:15.643959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3aafc93e-2409-4b2a-a784-061766e09a76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:15.649547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3aafc93e-2409-4b2a-a784-061766e09a76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:15.649990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3aafc93e-2409-4b2a-a784-061766e09a76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:15.650923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3aafc93e-2409-4b2a-a784-061766e09a76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:15.651357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3aafc93e-2409-4b2a-a784-061766e09a76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:15.679306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3aafc93e-2409-4b2a-a784-061766e09a76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040321 Jul 14 09:49:15.679840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 675/1364] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:15.684390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da6443c1-c380-4f7b-a737-2fc06d7dcf50 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:15.685251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da6443c1-c380-4f7b-a737-2fc06d7dcf50 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:15.690977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6443c1-c380-4f7b-a737-2fc06d7dcf50 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:15.691420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6443c1-c380-4f7b-a737-2fc06d7dcf50 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:15.692153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6443c1-c380-4f7b-a737-2fc06d7dcf50 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:15.692584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6443c1-c380-4f7b-a737-2fc06d7dcf50 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:15.721579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da6443c1-c380-4f7b-a737-2fc06d7dcf50 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040708 Jul 14 09:49:15.722143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 676/1365] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:16.654865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-33e0a1d9-bd51-4b94-9dfb-923860605957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:16.656009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-33e0a1d9-bd51-4b94-9dfb-923860605957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:16.662580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-33e0a1d9-bd51-4b94-9dfb-923860605957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:16.663023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-33e0a1d9-bd51-4b94-9dfb-923860605957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:16.663777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-33e0a1d9-bd51-4b94-9dfb-923860605957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:16.664211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-33e0a1d9-bd51-4b94-9dfb-923860605957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:16.794838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-33e0a1d9-bd51-4b94-9dfb-923860605957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:16.802934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-33e0a1d9-bd51-4b94-9dfb-923860605957 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151944 Jul 14 09:49:16.803498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 677/1366] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:16 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:16.807936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ce07543a-3af9-4ba9-ab03-65e059217567 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:16.808831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ce07543a-3af9-4ba9-ab03-65e059217567 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:16.814807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce07543a-3af9-4ba9-ab03-65e059217567 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:16.815203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce07543a-3af9-4ba9-ab03-65e059217567 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:16.815958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce07543a-3af9-4ba9-ab03-65e059217567 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:16.816395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce07543a-3af9-4ba9-ab03-65e059217567 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:16.844510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ce07543a-3af9-4ba9-ab03-65e059217567 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040051 Jul 14 09:49:16.845043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 678/1367] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:16 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:16.849406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a1c107d8-45c3-4f3f-a954-06111852ce05 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:16.850292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a1c107d8-45c3-4f3f-a954-06111852ce05 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:16.855703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1c107d8-45c3-4f3f-a954-06111852ce05 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:16.856147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1c107d8-45c3-4f3f-a954-06111852ce05 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:16.856892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1c107d8-45c3-4f3f-a954-06111852ce05 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:16.857328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1c107d8-45c3-4f3f-a954-06111852ce05 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:16.885222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a1c107d8-45c3-4f3f-a954-06111852ce05 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039235 Jul 14 09:49:16.885761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 679/1368] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:17.820201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8f28af2f-b9ea-4cba-a660-0c5b6514404b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:17.820834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8f28af2f-b9ea-4cba-a660-0c5b6514404b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:17.827261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f28af2f-b9ea-4cba-a660-0c5b6514404b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:17.827705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f28af2f-b9ea-4cba-a660-0c5b6514404b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:17.828457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f28af2f-b9ea-4cba-a660-0c5b6514404b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:17.828887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f28af2f-b9ea-4cba-a660-0c5b6514404b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:17.956835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8f28af2f-b9ea-4cba-a660-0c5b6514404b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:17.964290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8f28af2f-b9ea-4cba-a660-0c5b6514404b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148052 Jul 14 09:49:17.964848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 680/1369] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:17 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:17.969289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9edf6a8a-a748-41eb-9439-3af1a2a51a93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:17.970210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9edf6a8a-a748-41eb-9439-3af1a2a51a93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:17.975692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9edf6a8a-a748-41eb-9439-3af1a2a51a93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:17.976140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9edf6a8a-a748-41eb-9439-3af1a2a51a93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:17.976893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9edf6a8a-a748-41eb-9439-3af1a2a51a93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:17.977330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9edf6a8a-a748-41eb-9439-3af1a2a51a93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:18.006285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9edf6a8a-a748-41eb-9439-3af1a2a51a93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040429 Jul 14 09:49:18.006819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 681/1370] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:18.011214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-94c96b63-62c1-4066-b20f-eeaaa25bd231 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:18.012077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-94c96b63-62c1-4066-b20f-eeaaa25bd231 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:18.017417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-94c96b63-62c1-4066-b20f-eeaaa25bd231 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:18.017863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-94c96b63-62c1-4066-b20f-eeaaa25bd231 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:18.018659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-94c96b63-62c1-4066-b20f-eeaaa25bd231 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:18.019092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-94c96b63-62c1-4066-b20f-eeaaa25bd231 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:18.046989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-94c96b63-62c1-4066-b20f-eeaaa25bd231 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039229 Jul 14 09:49:18.047519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 682/1371] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:18.981488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-32c348d4-a292-4a99-980b-ed36df31fcd6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:18.982211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-32c348d4-a292-4a99-980b-ed36df31fcd6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:18.985791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:18.989759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32c348d4-a292-4a99-980b-ed36df31fcd6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:18.990220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32c348d4-a292-4a99-980b-ed36df31fcd6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:18.990990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32c348d4-a292-4a99-980b-ed36df31fcd6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:18.992044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32c348d4-a292-4a99-980b-ed36df31fcd6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:19.012845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:19.128078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-32c348d4-a292-4a99-980b-ed36df31fcd6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:19.135557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-32c348d4-a292-4a99-980b-ed36df31fcd6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.158197 Jul 14 09:49:19.136119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 683/1372] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:18 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:19.141310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2fabec9f-58ba-4436-b163-5626c3439c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:19.142233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2fabec9f-58ba-4436-b163-5626c3439c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:19.147895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fabec9f-58ba-4436-b163-5626c3439c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:19.148346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fabec9f-58ba-4436-b163-5626c3439c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:19.149100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fabec9f-58ba-4436-b163-5626c3439c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:19.149532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fabec9f-58ba-4436-b163-5626c3439c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:19.176787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2fabec9f-58ba-4436-b163-5626c3439c68 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039707 Jul 14 09:49:19.177329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 684/1373] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:19 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:19.181825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ee89c614-7ca5-4334-a7c9-bb7be8c428fc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:19.182717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ee89c614-7ca5-4334-a7c9-bb7be8c428fc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:19.188911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee89c614-7ca5-4334-a7c9-bb7be8c428fc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:19.189355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee89c614-7ca5-4334-a7c9-bb7be8c428fc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:19.190101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee89c614-7ca5-4334-a7c9-bb7be8c428fc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:19.190560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee89c614-7ca5-4334-a7c9-bb7be8c428fc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:19.218463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ee89c614-7ca5-4334-a7c9-bb7be8c428fc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040162 Jul 14 09:49:19.219001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 685/1374] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:20.152792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bd238ff6-2d26-4146-8dad-0097acb43b6e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:20.153451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bd238ff6-2d26-4146-8dad-0097acb43b6e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:20.159989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd238ff6-2d26-4146-8dad-0097acb43b6e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:20.160458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd238ff6-2d26-4146-8dad-0097acb43b6e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:20.161215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd238ff6-2d26-4146-8dad-0097acb43b6e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:20.161655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd238ff6-2d26-4146-8dad-0097acb43b6e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:20.291167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bd238ff6-2d26-4146-8dad-0097acb43b6e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:20.299129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bd238ff6-2d26-4146-8dad-0097acb43b6e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150238 Jul 14 09:49:20.299690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 686/1375] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:20 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:20.304187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a2380ef4-0227-474d-9617-07835fab481e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:20.305208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a2380ef4-0227-474d-9617-07835fab481e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:20.310808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a2380ef4-0227-474d-9617-07835fab481e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:20.311898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a2380ef4-0227-474d-9617-07835fab481e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:20.312715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a2380ef4-0227-474d-9617-07835fab481e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:20.313408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a2380ef4-0227-474d-9617-07835fab481e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:20.342821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a2380ef4-0227-474d-9617-07835fab481e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Jul 14 09:49:20.343375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 687/1376] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:20.347804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8271ca7e-4840-402d-9cfe-72de2b0756d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:20.348683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8271ca7e-4840-402d-9cfe-72de2b0756d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:20.354587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8271ca7e-4840-402d-9cfe-72de2b0756d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:20.355036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8271ca7e-4840-402d-9cfe-72de2b0756d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:20.355796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8271ca7e-4840-402d-9cfe-72de2b0756d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:20.356231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8271ca7e-4840-402d-9cfe-72de2b0756d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:20.389532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8271ca7e-4840-402d-9cfe-72de2b0756d3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045147 Jul 14 09:49:20.390080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 688/1377] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:21.316901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6d798bca-fd22-4680-b811-c4a112a58b48 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:21.317549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6d798bca-fd22-4680-b811-c4a112a58b48 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:21.324053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d798bca-fd22-4680-b811-c4a112a58b48 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:21.324490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d798bca-fd22-4680-b811-c4a112a58b48 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:21.325236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d798bca-fd22-4680-b811-c4a112a58b48 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:21.325668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d798bca-fd22-4680-b811-c4a112a58b48 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:21.458008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6d798bca-fd22-4680-b811-c4a112a58b48 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:21.465733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6d798bca-fd22-4680-b811-c4a112a58b48 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152876 Jul 14 09:49:21.466322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 689/1378] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:21 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:21.471015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f1b33f2d-815e-41d5-8a60-2bc5c33c219d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:21.471917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f1b33f2d-815e-41d5-8a60-2bc5c33c219d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:21.477460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1b33f2d-815e-41d5-8a60-2bc5c33c219d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:21.477907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1b33f2d-815e-41d5-8a60-2bc5c33c219d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:21.478713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1b33f2d-815e-41d5-8a60-2bc5c33c219d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:21.479147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1b33f2d-815e-41d5-8a60-2bc5c33c219d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:21.507171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f1b33f2d-815e-41d5-8a60-2bc5c33c219d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039883 Jul 14 09:49:21.507724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 690/1379] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:21.512283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7e140122-303b-4417-b422-4f1e27ae7917 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:21.513218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7e140122-303b-4417-b422-4f1e27ae7917 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:21.519897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e140122-303b-4417-b422-4f1e27ae7917 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:21.520424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e140122-303b-4417-b422-4f1e27ae7917 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:21.521155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e140122-303b-4417-b422-4f1e27ae7917 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:21.521585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e140122-303b-4417-b422-4f1e27ae7917 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:21.550372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7e140122-303b-4417-b422-4f1e27ae7917 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041556 Jul 14 09:49:21.550921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 691/1380] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:22.482745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cb9b7ff0-2988-4d9a-923d-fa6788396137 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:22.483920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cb9b7ff0-2988-4d9a-923d-fa6788396137 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:22.490415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb9b7ff0-2988-4d9a-923d-fa6788396137 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:22.490858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb9b7ff0-2988-4d9a-923d-fa6788396137 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:22.491606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb9b7ff0-2988-4d9a-923d-fa6788396137 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:22.492036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb9b7ff0-2988-4d9a-923d-fa6788396137 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:22.618890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cb9b7ff0-2988-4d9a-923d-fa6788396137 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:22.627002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cb9b7ff0-2988-4d9a-923d-fa6788396137 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148144 Jul 14 09:49:22.627552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 692/1381] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:22 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:22.632257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4120595e-ea96-4c5b-9a91-8e91b6e2e457 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:22.633177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4120595e-ea96-4c5b-9a91-8e91b6e2e457 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:22.639041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4120595e-ea96-4c5b-9a91-8e91b6e2e457 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:22.639530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4120595e-ea96-4c5b-9a91-8e91b6e2e457 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:22.640317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4120595e-ea96-4c5b-9a91-8e91b6e2e457 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:22.640769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4120595e-ea96-4c5b-9a91-8e91b6e2e457 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:22.669076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4120595e-ea96-4c5b-9a91-8e91b6e2e457 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040467 Jul 14 09:49:22.669633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 693/1382] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:22 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:22.674735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1b424f3d-c91f-4584-aca9-f1077cf45421 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:22.675611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1b424f3d-c91f-4584-aca9-f1077cf45421 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:22.681147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b424f3d-c91f-4584-aca9-f1077cf45421 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:22.681594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b424f3d-c91f-4584-aca9-f1077cf45421 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:22.682374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b424f3d-c91f-4584-aca9-f1077cf45421 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:22.682811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b424f3d-c91f-4584-aca9-f1077cf45421 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:22.710445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1b424f3d-c91f-4584-aca9-f1077cf45421 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039829 Jul 14 09:49:22.710981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 694/1383] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:23.643981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3775186c-7d0f-4709-a4ac-4953241eff0c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:23.644621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3775186c-7d0f-4709-a4ac-4953241eff0c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:23.651186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3775186c-7d0f-4709-a4ac-4953241eff0c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:23.651628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3775186c-7d0f-4709-a4ac-4953241eff0c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:23.652373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3775186c-7d0f-4709-a4ac-4953241eff0c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:23.652799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3775186c-7d0f-4709-a4ac-4953241eff0c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:23.783302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3775186c-7d0f-4709-a4ac-4953241eff0c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:23.790916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3775186c-7d0f-4709-a4ac-4953241eff0c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150754 Jul 14 09:49:23.791476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 695/1384] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:23 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:23.795997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-278135d9-5a12-4e28-9d64-70d069a27d86 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:23.796903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-278135d9-5a12-4e28-9d64-70d069a27d86 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:23.802550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-278135d9-5a12-4e28-9d64-70d069a27d86 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:23.803007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-278135d9-5a12-4e28-9d64-70d069a27d86 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:23.803769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-278135d9-5a12-4e28-9d64-70d069a27d86 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:23.804205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-278135d9-5a12-4e28-9d64-70d069a27d86 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:23.833997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-278135d9-5a12-4e28-9d64-70d069a27d86 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041373 Jul 14 09:49:23.834862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 696/1385] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:23.839748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c8ac7ca0-8cc6-42e5-82fc-1e05e8de3d34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:23.840650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c8ac7ca0-8cc6-42e5-82fc-1e05e8de3d34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:23.847114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8ac7ca0-8cc6-42e5-82fc-1e05e8de3d34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:23.847567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8ac7ca0-8cc6-42e5-82fc-1e05e8de3d34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:23.848324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8ac7ca0-8cc6-42e5-82fc-1e05e8de3d34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:23.848762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8ac7ca0-8cc6-42e5-82fc-1e05e8de3d34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:23.876823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c8ac7ca0-8cc6-42e5-82fc-1e05e8de3d34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040962 Jul 14 09:49:23.877382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 697/1386] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:24.807940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-944daa01-4cff-4335-8179-917bfbc115d3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:24.808585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-944daa01-4cff-4335-8179-917bfbc115d3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:24.815511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-944daa01-4cff-4335-8179-917bfbc115d3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:24.815913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-944daa01-4cff-4335-8179-917bfbc115d3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:24.816675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-944daa01-4cff-4335-8179-917bfbc115d3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:24.817114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-944daa01-4cff-4335-8179-917bfbc115d3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:24.948251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-944daa01-4cff-4335-8179-917bfbc115d3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:24.956416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-944daa01-4cff-4335-8179-917bfbc115d3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.152496 Jul 14 09:49:24.956977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 698/1387] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:24 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:24.961469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0d97b189-bfd1-4510-9851-79a0fdd01721 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:24.962401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0d97b189-bfd1-4510-9851-79a0fdd01721 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:24.968493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d97b189-bfd1-4510-9851-79a0fdd01721 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:24.969270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d97b189-bfd1-4510-9851-79a0fdd01721 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:24.970499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d97b189-bfd1-4510-9851-79a0fdd01721 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:24.970948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d97b189-bfd1-4510-9851-79a0fdd01721 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:25.001221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0d97b189-bfd1-4510-9851-79a0fdd01721 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Jul 14 09:49:25.001769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 699/1388] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:24 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:25.006373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d34e773a-d434-474b-8387-415828756e34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:25.007257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d34e773a-d434-474b-8387-415828756e34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:25.012923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d34e773a-d434-474b-8387-415828756e34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:25.013362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d34e773a-d434-474b-8387-415828756e34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:25.014810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d34e773a-d434-474b-8387-415828756e34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:25.015242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d34e773a-d434-474b-8387-415828756e34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:25.018747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:25.044625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d34e773a-d434-474b-8387-415828756e34 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041810 Jul 14 09:49:25.045205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 700/1389] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:25.973692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bf33cd95-a0c4-40f4-a9f4-199ebe8b89b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:25.974340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bf33cd95-a0c4-40f4-a9f4-199ebe8b89b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:25.980772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf33cd95-a0c4-40f4-a9f4-199ebe8b89b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:25.981213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf33cd95-a0c4-40f4-a9f4-199ebe8b89b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:25.981959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf33cd95-a0c4-40f4-a9f4-199ebe8b89b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:25.982428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf33cd95-a0c4-40f4-a9f4-199ebe8b89b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:26.110016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bf33cd95-a0c4-40f4-a9f4-199ebe8b89b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:26.117461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bf33cd95-a0c4-40f4-a9f4-199ebe8b89b8 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147604 Jul 14 09:49:26.118027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 701/1390] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:25 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:26.122520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8a3d016d-2fff-47a5-9212-6e7ee3117e7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:26.123455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8a3d016d-2fff-47a5-9212-6e7ee3117e7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:26.129068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a3d016d-2fff-47a5-9212-6e7ee3117e7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:26.129513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a3d016d-2fff-47a5-9212-6e7ee3117e7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:26.130291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a3d016d-2fff-47a5-9212-6e7ee3117e7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:26.130728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a3d016d-2fff-47a5-9212-6e7ee3117e7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:26.159535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8a3d016d-2fff-47a5-9212-6e7ee3117e7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040506 Jul 14 09:49:26.160084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 702/1391] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:26.164454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-03438460-3254-4f1d-af7d-fe15665efa2f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:26.165325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-03438460-3254-4f1d-af7d-fe15665efa2f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:26.170804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03438460-3254-4f1d-af7d-fe15665efa2f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:26.171255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03438460-3254-4f1d-af7d-fe15665efa2f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:26.172001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03438460-3254-4f1d-af7d-fe15665efa2f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:26.172435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-03438460-3254-4f1d-af7d-fe15665efa2f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:26.199892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-03438460-3254-4f1d-af7d-fe15665efa2f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038870 Jul 14 09:49:26.200429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 703/1392] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:27.135110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ec1d0591-08f5-4415-9e8e-2ffc7f635556 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:27.135870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ec1d0591-08f5-4415-9e8e-2ffc7f635556 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:27.142373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec1d0591-08f5-4415-9e8e-2ffc7f635556 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:27.142819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec1d0591-08f5-4415-9e8e-2ffc7f635556 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:27.143567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec1d0591-08f5-4415-9e8e-2ffc7f635556 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:27.143992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec1d0591-08f5-4415-9e8e-2ffc7f635556 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:27.274367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ec1d0591-08f5-4415-9e8e-2ffc7f635556 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:27.282376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ec1d0591-08f5-4415-9e8e-2ffc7f635556 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151099 Jul 14 09:49:27.282932 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 704/1393] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:27 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:27.287348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-edb17806-2b4c-483c-bec3-5f600475389d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:27.288242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-edb17806-2b4c-483c-bec3-5f600475389d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:27.293830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-edb17806-2b4c-483c-bec3-5f600475389d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:27.294305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-edb17806-2b4c-483c-bec3-5f600475389d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:27.295696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-edb17806-2b4c-483c-bec3-5f600475389d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:27.296135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-edb17806-2b4c-483c-bec3-5f600475389d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:27.323790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-edb17806-2b4c-483c-bec3-5f600475389d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039898 Jul 14 09:49:27.324324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 705/1394] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:27.328704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7c0877fb-1b3e-475c-a6f2-5fc9a3c7baa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:27.329564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7c0877fb-1b3e-475c-a6f2-5fc9a3c7baa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:27.335044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c0877fb-1b3e-475c-a6f2-5fc9a3c7baa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:27.335483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c0877fb-1b3e-475c-a6f2-5fc9a3c7baa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:27.336218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c0877fb-1b3e-475c-a6f2-5fc9a3c7baa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:27.336644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c0877fb-1b3e-475c-a6f2-5fc9a3c7baa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:27.365399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7c0877fb-1b3e-475c-a6f2-5fc9a3c7baa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040126 Jul 14 09:49:27.365938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 706/1395] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:28.299903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2fdcc491-5002-4f23-bd8e-dcfb00374cc3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:28.300609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2fdcc491-5002-4f23-bd8e-dcfb00374cc3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:28.307024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fdcc491-5002-4f23-bd8e-dcfb00374cc3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:28.307468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fdcc491-5002-4f23-bd8e-dcfb00374cc3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:28.308207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fdcc491-5002-4f23-bd8e-dcfb00374cc3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:28.308641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fdcc491-5002-4f23-bd8e-dcfb00374cc3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:28.437437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2fdcc491-5002-4f23-bd8e-dcfb00374cc3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:28.445708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2fdcc491-5002-4f23-bd8e-dcfb00374cc3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149733 Jul 14 09:49:28.446271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 707/1396] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:28 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:28.450882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-73cb2cd5-e31a-4e91-ac40-86bf7cb6ad19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:28.451832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-73cb2cd5-e31a-4e91-ac40-86bf7cb6ad19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:28.458139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-73cb2cd5-e31a-4e91-ac40-86bf7cb6ad19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:28.458608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-73cb2cd5-e31a-4e91-ac40-86bf7cb6ad19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:28.459358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-73cb2cd5-e31a-4e91-ac40-86bf7cb6ad19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:28.459787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-73cb2cd5-e31a-4e91-ac40-86bf7cb6ad19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:28.487856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-73cb2cd5-e31a-4e91-ac40-86bf7cb6ad19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040608 Jul 14 09:49:28.488390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 708/1397] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:28.492894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d307f604-656b-4dc9-bb78-16defc8cd888 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:28.493765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d307f604-656b-4dc9-bb78-16defc8cd888 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:28.499865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d307f604-656b-4dc9-bb78-16defc8cd888 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:28.500305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d307f604-656b-4dc9-bb78-16defc8cd888 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:28.501046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d307f604-656b-4dc9-bb78-16defc8cd888 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:28.501475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d307f604-656b-4dc9-bb78-16defc8cd888 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:28.529512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d307f604-656b-4dc9-bb78-16defc8cd888 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040111 Jul 14 09:49:28.530362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 709/1398] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:29.462668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5c94c24a-c8f6-43e3-a359-1e0b631621b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:29.463314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5c94c24a-c8f6-43e3-a359-1e0b631621b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:29.469779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c94c24a-c8f6-43e3-a359-1e0b631621b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:29.470243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c94c24a-c8f6-43e3-a359-1e0b631621b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:29.470993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c94c24a-c8f6-43e3-a359-1e0b631621b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:29.471427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c94c24a-c8f6-43e3-a359-1e0b631621b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:29.598504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c94c24a-c8f6-43e3-a359-1e0b631621b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:29.606071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5c94c24a-c8f6-43e3-a359-1e0b631621b6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.147243 Jul 14 09:49:29.612660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 710/1399] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:29 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:29.612660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7e3d74f1-3421-48b7-80cd-676572e0cae9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:29.612660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7e3d74f1-3421-48b7-80cd-676572e0cae9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:29.617974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e3d74f1-3421-48b7-80cd-676572e0cae9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:29.618450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e3d74f1-3421-48b7-80cd-676572e0cae9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:29.619197 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e3d74f1-3421-48b7-80cd-676572e0cae9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:29.619625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e3d74f1-3421-48b7-80cd-676572e0cae9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:29.648663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7e3d74f1-3421-48b7-80cd-676572e0cae9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041029 Jul 14 09:49:29.649210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 711/1400] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:29.717535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1eb9ce63-9830-4b91-875a-cd7cd846bcdc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:29.718460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1eb9ce63-9830-4b91-875a-cd7cd846bcdc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:29.724345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1eb9ce63-9830-4b91-875a-cd7cd846bcdc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:29.724790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1eb9ce63-9830-4b91-875a-cd7cd846bcdc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:29.725543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1eb9ce63-9830-4b91-875a-cd7cd846bcdc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:29.725975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1eb9ce63-9830-4b91-875a-cd7cd846bcdc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:29.754553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1eb9ce63-9830-4b91-875a-cd7cd846bcdc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104334 Jul 14 09:49:29.755103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 712/1401] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:30.622520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fcd42800-2f51-43ac-8b5e-8e509099d9ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:30.623157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fcd42800-2f51-43ac-8b5e-8e509099d9ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:30.629674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcd42800-2f51-43ac-8b5e-8e509099d9ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:30.630123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcd42800-2f51-43ac-8b5e-8e509099d9ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:30.630914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcd42800-2f51-43ac-8b5e-8e509099d9ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:30.631353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcd42800-2f51-43ac-8b5e-8e509099d9ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:30.761580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fcd42800-2f51-43ac-8b5e-8e509099d9ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:30.769903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fcd42800-2f51-43ac-8b5e-8e509099d9ff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151314 Jul 14 09:49:30.770519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 713/1402] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:30 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:30.775119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-25240d33-c0da-4160-b615-1c6c40b88491 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:30.776021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-25240d33-c0da-4160-b615-1c6c40b88491 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:30.782586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25240d33-c0da-4160-b615-1c6c40b88491 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:30.783068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25240d33-c0da-4160-b615-1c6c40b88491 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:30.783832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25240d33-c0da-4160-b615-1c6c40b88491 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:30.784273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25240d33-c0da-4160-b615-1c6c40b88491 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:30.812411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-25240d33-c0da-4160-b615-1c6c40b88491 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040847 Jul 14 09:49:30.813151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 714/1403] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:30 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:30.817538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d9925d10-3047-4e8c-9a60-75f7850ebc7c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:30.818442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d9925d10-3047-4e8c-9a60-75f7850ebc7c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:30.823831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d9925d10-3047-4e8c-9a60-75f7850ebc7c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:30.824275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d9925d10-3047-4e8c-9a60-75f7850ebc7c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:30.825021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d9925d10-3047-4e8c-9a60-75f7850ebc7c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:30.825456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d9925d10-3047-4e8c-9a60-75f7850ebc7c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:30.853619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d9925d10-3047-4e8c-9a60-75f7850ebc7c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039525 Jul 14 09:49:30.854153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 715/1404] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:31.787574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-efa9ca3c-687d-45f9-bdf3-843674a4ad61 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:31.788214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-efa9ca3c-687d-45f9-bdf3-843674a4ad61 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:31.794760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efa9ca3c-687d-45f9-bdf3-843674a4ad61 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:31.795743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efa9ca3c-687d-45f9-bdf3-843674a4ad61 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:31.796493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efa9ca3c-687d-45f9-bdf3-843674a4ad61 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:31.796921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efa9ca3c-687d-45f9-bdf3-843674a4ad61 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:31.925182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-efa9ca3c-687d-45f9-bdf3-843674a4ad61 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:31.928615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:31.933328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-efa9ca3c-687d-45f9-bdf3-843674a4ad61 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.149719 Jul 14 09:49:31.933879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 716/1405] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:31 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:31.938969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2f4958ba-3a1e-477b-8959-73dd84b9e36d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:31.939871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2f4958ba-3a1e-477b-8959-73dd84b9e36d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:31.945509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2f4958ba-3a1e-477b-8959-73dd84b9e36d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:31.945984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2f4958ba-3a1e-477b-8959-73dd84b9e36d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:31.946799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2f4958ba-3a1e-477b-8959-73dd84b9e36d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:31.947234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2f4958ba-3a1e-477b-8959-73dd84b9e36d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:31.975323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2f4958ba-3a1e-477b-8959-73dd84b9e36d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040430 Jul 14 09:49:31.975863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 717/1406] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:31.980250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0e5ddecf-a76c-470b-82a6-4ec4471cdac4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:31.981127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0e5ddecf-a76c-470b-82a6-4ec4471cdac4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:31.987304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e5ddecf-a76c-470b-82a6-4ec4471cdac4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:31.987749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e5ddecf-a76c-470b-82a6-4ec4471cdac4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:31.988497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e5ddecf-a76c-470b-82a6-4ec4471cdac4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:31.988950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e5ddecf-a76c-470b-82a6-4ec4471cdac4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:32.017196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0e5ddecf-a76c-470b-82a6-4ec4471cdac4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040391 Jul 14 09:49:32.017731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 718/1407] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:32.950682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4011b25b-d3ab-47d3-9bf9-2964b9fa1355 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:32.951431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4011b25b-d3ab-47d3-9bf9-2964b9fa1355 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:32.957933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4011b25b-d3ab-47d3-9bf9-2964b9fa1355 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:32.958419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4011b25b-d3ab-47d3-9bf9-2964b9fa1355 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:32.959181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4011b25b-d3ab-47d3-9bf9-2964b9fa1355 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:32.959615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4011b25b-d3ab-47d3-9bf9-2964b9fa1355 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:33.113913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4011b25b-d3ab-47d3-9bf9-2964b9fa1355 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:33.121341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4011b25b-d3ab-47d3-9bf9-2964b9fa1355 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.174571 Jul 14 09:49:33.121908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 719/1408] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:32 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:33.126991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-07a921a7-a303-4e0f-9d71-bbf5d4df648d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:33.127887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-07a921a7-a303-4e0f-9d71-bbf5d4df648d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:33.133393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07a921a7-a303-4e0f-9d71-bbf5d4df648d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:33.133845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07a921a7-a303-4e0f-9d71-bbf5d4df648d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:33.134644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07a921a7-a303-4e0f-9d71-bbf5d4df648d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:33.135078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07a921a7-a303-4e0f-9d71-bbf5d4df648d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:33.163202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-07a921a7-a303-4e0f-9d71-bbf5d4df648d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040267 Jul 14 09:49:33.163746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 720/1409] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:33.168149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-682951fc-d5a7-44e8-b708-70998d74e094 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:33.169026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-682951fc-d5a7-44e8-b708-70998d74e094 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:33.175365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-682951fc-d5a7-44e8-b708-70998d74e094 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:33.175815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-682951fc-d5a7-44e8-b708-70998d74e094 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:33.176574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-682951fc-d5a7-44e8-b708-70998d74e094 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:33.177012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-682951fc-d5a7-44e8-b708-70998d74e094 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:33.204955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-682951fc-d5a7-44e8-b708-70998d74e094 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040195 Jul 14 09:49:33.205433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 721/1410] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:34.138068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8ff7b526-2adc-4d0d-9342-d0b57140338f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:34.138792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8ff7b526-2adc-4d0d-9342-d0b57140338f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:34.145826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ff7b526-2adc-4d0d-9342-d0b57140338f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:34.146310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ff7b526-2adc-4d0d-9342-d0b57140338f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:34.147073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ff7b526-2adc-4d0d-9342-d0b57140338f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:34.147507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ff7b526-2adc-4d0d-9342-d0b57140338f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:34.273365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8ff7b526-2adc-4d0d-9342-d0b57140338f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:34.280866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8ff7b526-2adc-4d0d-9342-d0b57140338f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.146799 Jul 14 09:49:34.281457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 722/1411] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:34 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:34.285902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-de2f5158-bca1-4c16-a14c-6bebe76226d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:34.286822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-de2f5158-bca1-4c16-a14c-6bebe76226d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:34.292557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de2f5158-bca1-4c16-a14c-6bebe76226d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:34.292999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de2f5158-bca1-4c16-a14c-6bebe76226d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:34.293753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de2f5158-bca1-4c16-a14c-6bebe76226d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:34.294388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de2f5158-bca1-4c16-a14c-6bebe76226d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:34.323184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-de2f5158-bca1-4c16-a14c-6bebe76226d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 Jul 14 09:49:34.323720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 723/1412] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:34.328115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7533cad6-37ca-448c-8a38-706b1326184a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:34.328985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7533cad6-37ca-448c-8a38-706b1326184a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:34.334370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7533cad6-37ca-448c-8a38-706b1326184a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:34.334808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7533cad6-37ca-448c-8a38-706b1326184a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:34.335542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7533cad6-37ca-448c-8a38-706b1326184a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:34.335997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7533cad6-37ca-448c-8a38-706b1326184a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:34.363674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7533cad6-37ca-448c-8a38-706b1326184a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039021 Jul 14 09:49:34.364196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 724/1413] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:35.297776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eeb2d05c-26ad-485c-9563-1c976855bdf7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:35.298468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-eeb2d05c-26ad-485c-9563-1c976855bdf7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:35.304944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eeb2d05c-26ad-485c-9563-1c976855bdf7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:35.305404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eeb2d05c-26ad-485c-9563-1c976855bdf7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:35.306168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eeb2d05c-26ad-485c-9563-1c976855bdf7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:35.306629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eeb2d05c-26ad-485c-9563-1c976855bdf7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:35.438024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-eeb2d05c-26ad-485c-9563-1c976855bdf7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:35.445580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eeb2d05c-26ad-485c-9563-1c976855bdf7 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.151699 Jul 14 09:49:35.446143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 725/1414] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:35 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:35.515288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8c0e8040-a459-462d-8f35-f0c5892cdc06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:35.516201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8c0e8040-a459-462d-8f35-f0c5892cdc06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:35.522120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c0e8040-a459-462d-8f35-f0c5892cdc06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:35.522600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c0e8040-a459-462d-8f35-f0c5892cdc06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:35.523357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c0e8040-a459-462d-8f35-f0c5892cdc06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:35.523790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c0e8040-a459-462d-8f35-f0c5892cdc06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:35.552083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8c0e8040-a459-462d-8f35-f0c5892cdc06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104824 Jul 14 09:49:35.552559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 726/1415] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:35 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:35.560024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-139d16b6-66f9-40c1-b4c6-c18322fd94a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:35.560957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-139d16b6-66f9-40c1-b4c6-c18322fd94a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:35.567063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-139d16b6-66f9-40c1-b4c6-c18322fd94a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:35.567514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-139d16b6-66f9-40c1-b4c6-c18322fd94a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:35.568274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-139d16b6-66f9-40c1-b4c6-c18322fd94a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:35.568708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-139d16b6-66f9-40c1-b4c6-c18322fd94a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:35.597123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-139d16b6-66f9-40c1-b4c6-c18322fd94a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043579 Jul 14 09:49:35.597678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 727/1416] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:36.463416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5740528e-d730-43ed-9596-4ebbff4fb989 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:36.464102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5740528e-d730-43ed-9596-4ebbff4fb989 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:36.471056 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5740528e-d730-43ed-9596-4ebbff4fb989 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:36.471501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5740528e-d730-43ed-9596-4ebbff4fb989 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:36.472257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5740528e-d730-43ed-9596-4ebbff4fb989 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:36.472690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5740528e-d730-43ed-9596-4ebbff4fb989 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:36.602253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5740528e-d730-43ed-9596-4ebbff4fb989 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:36.609907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5740528e-d730-43ed-9596-4ebbff4fb989 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.150354 Jul 14 09:49:36.610490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 728/1417] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:36 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:36.615102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8cc4b81a-627f-4345-80c0-8877880a1bde tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:36.615995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8cc4b81a-627f-4345-80c0-8877880a1bde tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:36.621493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8cc4b81a-627f-4345-80c0-8877880a1bde tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:36.621889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8cc4b81a-627f-4345-80c0-8877880a1bde tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:36.622832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8cc4b81a-627f-4345-80c0-8877880a1bde tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:36.623255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8cc4b81a-627f-4345-80c0-8877880a1bde tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:36.652342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8cc4b81a-627f-4345-80c0-8877880a1bde tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040786 Jul 14 09:49:36.652895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 729/1418] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:36.658063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-15aec759-ccd2-4b12-8f4f-31b48c006715 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:36.658977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-15aec759-ccd2-4b12-8f4f-31b48c006715 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:36.664438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15aec759-ccd2-4b12-8f4f-31b48c006715 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:36.664881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15aec759-ccd2-4b12-8f4f-31b48c006715 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:36.665620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15aec759-ccd2-4b12-8f4f-31b48c006715 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:36.666049 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15aec759-ccd2-4b12-8f4f-31b48c006715 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:36.693469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-15aec759-ccd2-4b12-8f4f-31b48c006715 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039621 Jul 14 09:49:36.694005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 730/1419] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:37.627501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a567cca7-6a8b-4ac5-be81-67e8e4052eff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:37.628106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a567cca7-6a8b-4ac5-be81-67e8e4052eff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:37.634727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a567cca7-6a8b-4ac5-be81-67e8e4052eff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:37.635178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a567cca7-6a8b-4ac5-be81-67e8e4052eff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:37.635936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a567cca7-6a8b-4ac5-be81-67e8e4052eff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:37.636375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a567cca7-6a8b-4ac5-be81-67e8e4052eff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:37.764620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a567cca7-6a8b-4ac5-be81-67e8e4052eff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:37.772159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a567cca7-6a8b-4ac5-be81-67e8e4052eff tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148518 Jul 14 09:49:37.772724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 731/1420] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:37 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:37.777201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7c4967b8-0e3e-4e3c-9ccf-1040068b4413 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:37.778106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7c4967b8-0e3e-4e3c-9ccf-1040068b4413 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:37.784431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c4967b8-0e3e-4e3c-9ccf-1040068b4413 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:37.784909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c4967b8-0e3e-4e3c-9ccf-1040068b4413 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:37.785669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c4967b8-0e3e-4e3c-9ccf-1040068b4413 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:37.786129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c4967b8-0e3e-4e3c-9ccf-1040068b4413 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:37.815150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7c4967b8-0e3e-4e3c-9ccf-1040068b4413 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Jul 14 09:49:37.815629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 732/1421] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:37.820024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ce8facba-9085-41b1-bb4b-8738c3042b3e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:37.820930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ce8facba-9085-41b1-bb4b-8738c3042b3e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:37.823485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:37.827862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce8facba-9085-41b1-bb4b-8738c3042b3e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:37.828308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce8facba-9085-41b1-bb4b-8738c3042b3e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:37.829058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce8facba-9085-41b1-bb4b-8738c3042b3e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:37.829490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce8facba-9085-41b1-bb4b-8738c3042b3e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:37.845642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:37.858166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ce8facba-9085-41b1-bb4b-8738c3042b3e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041603 Jul 14 09:49:37.858738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 733/1422] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:38.789569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-59be93df-2132-4fe0-8ba4-70f5a17204a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:38.790248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-59be93df-2132-4fe0-8ba4-70f5a17204a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:38.797317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59be93df-2132-4fe0-8ba4-70f5a17204a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:38.797757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59be93df-2132-4fe0-8ba4-70f5a17204a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:38.798531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59be93df-2132-4fe0-8ba4-70f5a17204a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:38.798961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59be93df-2132-4fe0-8ba4-70f5a17204a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:38.931768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-59be93df-2132-4fe0-8ba4-70f5a17204a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:38.940128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-59be93df-2132-4fe0-8ba4-70f5a17204a9 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.154531 Jul 14 09:49:38.940882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 734/1423] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:38 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:38.945391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eac7f01b-7d27-4f4e-8d51-bc8ff9c7924c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:38.946306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-eac7f01b-7d27-4f4e-8d51-bc8ff9c7924c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:38.951862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eac7f01b-7d27-4f4e-8d51-bc8ff9c7924c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:38.952304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eac7f01b-7d27-4f4e-8d51-bc8ff9c7924c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:38.953053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eac7f01b-7d27-4f4e-8d51-bc8ff9c7924c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:38.953612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eac7f01b-7d27-4f4e-8d51-bc8ff9c7924c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:38.981662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eac7f01b-7d27-4f4e-8d51-bc8ff9c7924c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039718 Jul 14 09:49:38.982225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 735/1424] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:38.987203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-115d5ba6-60cd-426b-9b68-bce06d6c479a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:38.988115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-115d5ba6-60cd-426b-9b68-bce06d6c479a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:38.993650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-115d5ba6-60cd-426b-9b68-bce06d6c479a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:38.994107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-115d5ba6-60cd-426b-9b68-bce06d6c479a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:38.994895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-115d5ba6-60cd-426b-9b68-bce06d6c479a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:38.995330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-115d5ba6-60cd-426b-9b68-bce06d6c479a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:39.023625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-115d5ba6-60cd-426b-9b68-bce06d6c479a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040437 Jul 14 09:49:39.024170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 736/1425] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:39.956915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-299f5308-8b3d-48b9-aa4c-de7998301149 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:39.957524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-299f5308-8b3d-48b9-aa4c-de7998301149 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:39.964118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-299f5308-8b3d-48b9-aa4c-de7998301149 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:39.964562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-299f5308-8b3d-48b9-aa4c-de7998301149 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:39.965317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-299f5308-8b3d-48b9-aa4c-de7998301149 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:39.965757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-299f5308-8b3d-48b9-aa4c-de7998301149 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:40.093505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-299f5308-8b3d-48b9-aa4c-de7998301149 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:49:40.100999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-299f5308-8b3d-48b9-aa4c-de7998301149 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.148072 Jul 14 09:49:40.101564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 737/1426] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:49:39 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 09:49:40.106095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7d1cb903-fb4c-47cc-8875-5928ba8185bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:40.107092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7d1cb903-fb4c-47cc-8875-5928ba8185bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:40.113250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d1cb903-fb4c-47cc-8875-5928ba8185bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:40.113729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d1cb903-fb4c-47cc-8875-5928ba8185bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:40.114495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d1cb903-fb4c-47cc-8875-5928ba8185bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:40.114933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d1cb903-fb4c-47cc-8875-5928ba8185bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:40.142701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7d1cb903-fb4c-47cc-8875-5928ba8185bb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040082 Jul 14 09:49:40.143243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 738/1427] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:49:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:49:40.147637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fbf7a0ca-dc54-4e39-915a-771374c49c5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:40.148510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fbf7a0ca-dc54-4e39-915a-771374c49c5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:40.153909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fbf7a0ca-dc54-4e39-915a-771374c49c5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:40.154393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fbf7a0ca-dc54-4e39-915a-771374c49c5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:40.155689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fbf7a0ca-dc54-4e39-915a-771374c49c5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:40.156119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fbf7a0ca-dc54-4e39-915a-771374c49c5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:40.184861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fbf7a0ca-dc54-4e39-915a-771374c49c5c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040629 Jul 14 09:49:40.185465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 739/1428] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:49:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:49:40.228856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:49:40.229340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:49:40.235642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:40.236085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:40.236839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:49:40.237272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:49:45.949729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:49:46.137634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:49:48.202648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:49:48.203107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:49:48.459437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:49:48.460024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:49:50.233312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=14 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:55.954455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:49:56.142453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=46 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:50:40.536434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcec8b40-9864-4688-9d41-051d34c078e9) Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:50:40.538696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:50:40.540285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcec8b40-9864-4688-9d41-051d34c078e9) Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:50:40.541297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcec8b40-9864-4688-9d41-051d34c078e9) Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:50:40.542430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcec8b40-9864-4688-9d41-051d34c078e9) Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.543583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcec8b40-9864-4688-9d41-051d34c078e9) Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:50:40.544643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcec8b40-9864-4688-9d41-051d34c078e9) Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcec8b40-9864-4688-9d41-051d34c078e9) Jul 14 09:50:40.545748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.548118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcec8b40-9864-4688-9d41-051d34c078e9) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:50:40.548118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5518c3be-f8a0-414f-8bd3-f076626aa80e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 120.244833 Jul 14 09:50:40.548118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 690/1429] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:48:40 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 120246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:50:40.576646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-311365e8-e0b4-4bf9-bc1c-4154476f43cf) Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:50:40.580108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:50:40.581787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-311365e8-e0b4-4bf9-bc1c-4154476f43cf) Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:50:40.582636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-311365e8-e0b4-4bf9-bc1c-4154476f43cf) Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:50:40.583775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-311365e8-e0b4-4bf9-bc1c-4154476f43cf) Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.584925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-311365e8-e0b4-4bf9-bc1c-4154476f43cf) Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:50:40.585921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-311365e8-e0b4-4bf9-bc1c-4154476f43cf) Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-311365e8-e0b4-4bf9-bc1c-4154476f43cf) Jul 14 09:50:40.587550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:50:40.590480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-311365e8-e0b4-4bf9-bc1c-4154476f43cf) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:50:40.591745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d7ac2126-451d-48d6-ae72-06a2889526db tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 60.366340 Jul 14 09:50:40.592710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 740/1430] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:49:40 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 60368 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 09:50:40.597993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8c57598f-2995-4e53-a6f2-ef1202db9c22 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:50:40.599699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8c57598f-2995-4e53-a6f2-ef1202db9c22 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:50:40.606143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c57598f-2995-4e53-a6f2-ef1202db9c22 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.606693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c57598f-2995-4e53-a6f2-ef1202db9c22 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.607548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c57598f-2995-4e53-a6f2-ef1202db9c22 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.608053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c57598f-2995-4e53-a6f2-ef1202db9c22 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.626819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8dfa97fd-fdb8-46d1-978b-22e8cbc5e23e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:50:40.628032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8dfa97fd-fdb8-46d1-978b-22e8cbc5e23e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:50:40.634764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8dfa97fd-fdb8-46d1-978b-22e8cbc5e23e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.635212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8dfa97fd-fdb8-46d1-978b-22e8cbc5e23e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.636529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8dfa97fd-fdb8-46d1-978b-22e8cbc5e23e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.636969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8dfa97fd-fdb8-46d1-978b-22e8cbc5e23e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.638596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8c57598f-2995-4e53-a6f2-ef1202db9c22 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Jul 14 09:50:40.642313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 741/1431] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:50:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:50:40.647343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4f82a233-6204-420e-a48b-715f966b58ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:50:40.648250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4f82a233-6204-420e-a48b-715f966b58ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:50:40.654510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f82a233-6204-420e-a48b-715f966b58ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.655018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f82a233-6204-420e-a48b-715f966b58ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.655886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f82a233-6204-420e-a48b-715f966b58ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.656324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f82a233-6204-420e-a48b-715f966b58ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.684961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4f82a233-6204-420e-a48b-715f966b58ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041379 Jul 14 09:50:40.685792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 742/1432] 10.222.0.40 () {60 vars in 1342 bytes} [Thu Jul 14 09:50:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:50:40.691106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c46225f-59dc-47ce-9699-0add298fcfd8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:50:40.691596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c46225f-59dc-47ce-9699-0add298fcfd8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:50:40.697421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c46225f-59dc-47ce-9699-0add298fcfd8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.697868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c46225f-59dc-47ce-9699-0add298fcfd8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.698654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c46225f-59dc-47ce-9699-0add298fcfd8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.699092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c46225f-59dc-47ce-9699-0add298fcfd8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.780249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8dfa97fd-fdb8-46d1-978b-22e8cbc5e23e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27cfaef90a5048569453430e75c4c42b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28617ad1f8d40faa7d2e317b32951ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 09:50:40.787776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8dfa97fd-fdb8-46d1-978b-22e8cbc5e23e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 200 len: 1569 microversion: 2.1 time: 0.245650 Jul 14 09:50:40.788334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 691/1433] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:50:40 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 09:50:40.792645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d88a6abc-6bbc-40c6-a78d-b6a723ff3a4c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:50:40.793125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d88a6abc-6bbc-40c6-a78d-b6a723ff3a4c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:50:40.798675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d88a6abc-6bbc-40c6-a78d-b6a723ff3a4c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.799119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d88a6abc-6bbc-40c6-a78d-b6a723ff3a4c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.799877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d88a6abc-6bbc-40c6-a78d-b6a723ff3a4c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.800541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d88a6abc-6bbc-40c6-a78d-b6a723ff3a4c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.826553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d88a6abc-6bbc-40c6-a78d-b6a723ff3a4c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:50:40.904918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d88a6abc-6bbc-40c6-a78d-b6a723ff3a4c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "DELETE /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 204 len: 0 microversion: 2.1 time: 0.115117 Jul 14 09:50:40.906038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 692/1434] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:50:40 2022] DELETE /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:50:40.912205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:50:40.912786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:50:40.918850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.919303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:40.920083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:50:40.920512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:50:50.694858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=6 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:50:50.718203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=16 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:50:50.916512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:50:50.940279 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:51:18.281175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:51:18.281842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:51:21.911877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:51:21.912408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:51:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 09:51:46.306363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-1c46225f-59dc-47ce-9699-0add298fcfd8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:51:46.348525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:51:50.579021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:51:50.579511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:51:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 09:51:56.310604 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:51:56.353206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:52:40.701876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c46225f-59dc-47ce-9699-0add298fcfd8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 202 len: 0 microversion: 2.1 time: 120.014869 Jul 14 09:52:40.703471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 743/1435] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:50:40 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 0 bytes in 120017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:52:40.709494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ebe94619-650b-4d26-bed9-30dc53985fb5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:52:40.710648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ebe94619-650b-4d26-bed9-30dc53985fb5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:52:40.719081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebe94619-650b-4d26-bed9-30dc53985fb5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.719816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebe94619-650b-4d26-bed9-30dc53985fb5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.720969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebe94619-650b-4d26-bed9-30dc53985fb5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.721544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebe94619-650b-4d26-bed9-30dc53985fb5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.726372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b5734a1-bc85-4153-aced-67cefac48e9a) Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:52:40.728691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:52:40.730077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b5734a1-bc85-4153-aced-67cefac48e9a) Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:52:40.730756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b5734a1-bc85-4153-aced-67cefac48e9a) Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:52:40.731849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b5734a1-bc85-4153-aced-67cefac48e9a) Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:52:40.733029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b5734a1-bc85-4153-aced-67cefac48e9a) Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:52:40.734056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b5734a1-bc85-4153-aced-67cefac48e9a) Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b5734a1-bc85-4153-aced-67cefac48e9a) Jul 14 09:52:40.737516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.743739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4b5734a1-bc85-4153-aced-67cefac48e9a) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:52:40.743739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e93b22d9-36a2-4bb9-a751-1708a0fe005d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 119.822785 Jul 14 09:52:40.743739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 693/1436] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:50:40 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 119824 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:52:40.743739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:52:40.744390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:52:40.753631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.754080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.754406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ebe94619-650b-4d26-bed9-30dc53985fb5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049724 Jul 14 09:52:40.754896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.755396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 744/1437] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:52:40 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:52:40.755519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.759868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bc8701c5-82f7-41a7-b262-832a599d4f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:52:40.760782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bc8701c5-82f7-41a7-b262-832a599d4f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:52:40.767601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc8701c5-82f7-41a7-b262-832a599d4f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.768047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc8701c5-82f7-41a7-b262-832a599d4f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.768811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc8701c5-82f7-41a7-b262-832a599d4f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.769242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc8701c5-82f7-41a7-b262-832a599d4f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.769779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:52:40.771341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:52:40.772821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:52:40.774117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:52:40.775368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:52:40.778205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:52:40.779344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bbe90118-5a07-4952-987d-870ea8679139 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.047470 Jul 14 09:52:40.780261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 694/1438] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:52:40 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:52:40.785860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6e75a5b2-0bd7-400c-8532-3e338afba85e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:52:40.786592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6e75a5b2-0bd7-400c-8532-3e338afba85e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:52:40.792860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e75a5b2-0bd7-400c-8532-3e338afba85e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.793741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e75a5b2-0bd7-400c-8532-3e338afba85e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.794900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e75a5b2-0bd7-400c-8532-3e338afba85e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.795639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e75a5b2-0bd7-400c-8532-3e338afba85e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.822839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6e75a5b2-0bd7-400c-8532-3e338afba85e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:52:40.867273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bc8701c5-82f7-41a7-b262-832a599d4f7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/action" status: 200 len: 82657 microversion: 2.1 time: 0.110726 Jul 14 09:52:40.867942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 745/1439] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 09:52:40 2022] POST /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/action => generated 82657 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 09:52:40.905292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6e75a5b2-0bd7-400c-8532-3e338afba85e tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.123280 Jul 14 09:52:40.905937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 695/1440] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:52:40 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:52:40.913105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a92e3d06-ff30-4c0d-adf8-757b72b639c4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:52:40.914403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a92e3d06-ff30-4c0d-adf8-757b72b639c4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:52:40.920374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a92e3d06-ff30-4c0d-adf8-757b72b639c4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.920812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a92e3d06-ff30-4c0d-adf8-757b72b639c4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.921608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a92e3d06-ff30-4c0d-adf8-757b72b639c4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:40.922073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a92e3d06-ff30-4c0d-adf8-757b72b639c4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:40.996822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-f64e4fe3-f792-46ee-9c34-1937b4833816 req-43152684-29c8-4819-ad00-3bfc9e449012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a699dfcd-f703-4225-a432-860189583054", "tag": "f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:52:41.005979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-f64e4fe3-f792-46ee-9c34-1937b4833816 req-43152684-29c8-4819-ad00-3bfc9e449012 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:41.006446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-f64e4fe3-f792-46ee-9c34-1937b4833816 req-43152684-29c8-4819-ad00-3bfc9e449012 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:41.016926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-f64e4fe3-f792-46ee-9c34-1937b4833816 req-43152684-29c8-4819-ad00-3bfc9e449012 service nova] Creating event network-changed:f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659 for instance a699dfcd-f703-4225-a432-860189583054 on hv-cinder-82549 Jul 14 09:52:41.021582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-f64e4fe3-f792-46ee-9c34-1937b4833816 req-43152684-29c8-4819-ad00-3bfc9e449012 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152339 Jul 14 09:52:41.022480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 746/1441] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:52:41.028023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a92e3d06-ff30-4c0d-adf8-757b72b639c4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "POST /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/action" status: 200 len: 37855 microversion: 2.20 time: 0.119707 Jul 14 09:52:41.028187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:52:41.028704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:52:41.028826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 696/1442] 10.222.0.40 () {62 vars in 1318 bytes} [Thu Jul 14 09:52:40 2022] POST /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f/action => generated 37855 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 14 09:52:41.034599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:52:41.035201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:52:41.035586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:41.036051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:41.036826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:41.037247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:41.042154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:41.042631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:41.043395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:52:41.043821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:52:51.032712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=8 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:52:51.039580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:52:51.058830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:52:51.073133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:53:08.211280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:53:08.212007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:53:08.467980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:53:08.468517 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 09:53:46.681288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:53:46.771398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:53:56.686565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:53:56.775444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:54:38.289564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:54:38.290422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:54:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:54:40.906218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f1525e8-b5bb-498b-8381-a599b747df20) Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:54:40.908574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:54:40.910051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f1525e8-b5bb-498b-8381-a599b747df20) Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:40.911366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f1525e8-b5bb-498b-8381-a599b747df20) Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:40.913067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f1525e8-b5bb-498b-8381-a599b747df20) Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.914682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f1525e8-b5bb-498b-8381-a599b747df20) Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:40.916863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f1525e8-b5bb-498b-8381-a599b747df20) Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f1525e8-b5bb-498b-8381-a599b747df20) Jul 14 09:54:40.919297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.921479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f1525e8-b5bb-498b-8381-a599b747df20) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:40.921479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-30930910-80ec-4557-b6b6-8173255999ba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 119.886533 Jul 14 09:54:40.921479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 747/1443] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:52:41 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 269 bytes in 119888 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:54:40.921479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8b1b7ae2-1cf1-4af6-9f0d-4622c71ef9e8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:40.922071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8b1b7ae2-1cf1-4af6-9f0d-4622c71ef9e8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:40.926768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b1b7ae2-1cf1-4af6-9f0d-4622c71ef9e8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:40.927218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b1b7ae2-1cf1-4af6-9f0d-4622c71ef9e8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:40.927981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b1b7ae2-1cf1-4af6-9f0d-4622c71ef9e8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:40.928417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b1b7ae2-1cf1-4af6-9f0d-4622c71ef9e8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:40.941567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6141e8f9-3f09-40d2-8fb8-8aac603c4c88) Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:54:40.943975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:54:40.945625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6141e8f9-3f09-40d2-8fb8-8aac603c4c88) Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:40.946431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6141e8f9-3f09-40d2-8fb8-8aac603c4c88) Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:40.947778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6141e8f9-3f09-40d2-8fb8-8aac603c4c88) Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.950336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6141e8f9-3f09-40d2-8fb8-8aac603c4c88) Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:40.951551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6141e8f9-3f09-40d2-8fb8-8aac603c4c88) Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6141e8f9-3f09-40d2-8fb8-8aac603c4c88) Jul 14 09:54:40.952795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:40.953972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6141e8f9-3f09-40d2-8fb8-8aac603c4c88) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:40.953972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2c140fc9-0464-4e2c-8dc1-0b2a37c05a43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 119.915560 Jul 14 09:54:40.953972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 697/1444] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:52:41 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 119917 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:54:40.972784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8b1b7ae2-1cf1-4af6-9f0d-4622c71ef9e8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061245 Jul 14 09:54:40.974037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 748/1445] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:54:40 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:54:40.979110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:40.979600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:40.986279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:40.986801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:40.987630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:40.988136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.016160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:54:41.068132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.compute.api [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Instance is already in deleting state, ignoring this request Jul 14 09:54:41.068973 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-43a40a53-2b08-4418-885a-1b2f323277ed tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.093404 Jul 14 09:54:41.069822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 749/1446] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:54:40 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:54:41.085879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.086665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.093156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.093604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.094423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.095023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.114255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:54:41.115779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.117361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.118267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.119888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.121255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.121255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b63e75b1-14d9-42c4-8960-e480a2c34251 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.169774 Jul 14 09:54:41.121255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 698/1447] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:54:40 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:54:41.122943 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.123427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.129205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.129615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.130407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.130834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.217583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:54:41.223830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.224330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.231464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.231920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.232834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.233264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.282362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2474a2e0-5a59-4f13-a82f-836edc1cac09) Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:54:41.284876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:54:41.286480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2474a2e0-5a59-4f13-a82f-836edc1cac09) Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.287615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2474a2e0-5a59-4f13-a82f-836edc1cac09) Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.288838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2474a2e0-5a59-4f13-a82f-836edc1cac09) Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.290010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2474a2e0-5a59-4f13-a82f-836edc1cac09) Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.291045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2474a2e0-5a59-4f13-a82f-836edc1cac09) Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2474a2e0-5a59-4f13-a82f-836edc1cac09) Jul 14 09:54:41.292322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.294087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2474a2e0-5a59-4f13-a82f-836edc1cac09) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.294087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-22ac24be-0518-4d89-a23f-aa2e77a3c05b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 0.167187 Jul 14 09:54:41.294087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 699/1448] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 269 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:54:41.294087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.295258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.299056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.299506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.300343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.300705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.331453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:54:41.380095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:54:41.408798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d00e9b8d-2877-4d23-9364-948ab43cafd7) Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:54:41.410975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:54:41.412554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d00e9b8d-2877-4d23-9364-948ab43cafd7) Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.413574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d00e9b8d-2877-4d23-9364-948ab43cafd7) Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.414846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d00e9b8d-2877-4d23-9364-948ab43cafd7) Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.416226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d00e9b8d-2877-4d23-9364-948ab43cafd7) Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.417433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d00e9b8d-2877-4d23-9364-948ab43cafd7) Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d00e9b8d-2877-4d23-9364-948ab43cafd7) Jul 14 09:54:41.418914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.420127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d00e9b8d-2877-4d23-9364-948ab43cafd7) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.420127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c47a86fa-ed11-4098-9f1d-34b67ed7ec80 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 0.341616 Jul 14 09:54:41.420127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 750/1449] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 269 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:54:41.420127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c7a6db5d-4840-4b85-9cd4-08efc4260f3a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.420470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c7a6db5d-4840-4b85-9cd4-08efc4260f3a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.426894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c7a6db5d-4840-4b85-9cd4-08efc4260f3a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.427339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c7a6db5d-4840-4b85-9cd4-08efc4260f3a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.428091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c7a6db5d-4840-4b85-9cd4-08efc4260f3a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.428524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c7a6db5d-4840-4b85-9cd4-08efc4260f3a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.442829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4ad6dc5-60b9-4ff2-ab1a-3c8aeb0ead5e) Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:54:41.445033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:54:41.446743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4ad6dc5-60b9-4ff2-ab1a-3c8aeb0ead5e) Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.447540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4ad6dc5-60b9-4ff2-ab1a-3c8aeb0ead5e) Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.449692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4ad6dc5-60b9-4ff2-ab1a-3c8aeb0ead5e) Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.451199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4ad6dc5-60b9-4ff2-ab1a-3c8aeb0ead5e) Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.452561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4ad6dc5-60b9-4ff2-ab1a-3c8aeb0ead5e) Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4ad6dc5-60b9-4ff2-ab1a-3c8aeb0ead5e) Jul 14 09:54:41.453926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.455196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4ad6dc5-60b9-4ff2-ab1a-3c8aeb0ead5e) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.455196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-27649694-9cd7-448f-b447-e65805cd8a18 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 0.158415 Jul 14 09:54:41.455196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 700/1450] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:54:41.455196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.455546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.459023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.459459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.460188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c7a6db5d-4840-4b85-9cd4-08efc4260f3a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 Jul 14 09:54:41.460313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.460614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.460946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 751/1451] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:54:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:54:41.465951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1467bb99-98ce-4602-a9af-f2d66e314d90 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.466475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1467bb99-98ce-4602-a9af-f2d66e314d90 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.473331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1467bb99-98ce-4602-a9af-f2d66e314d90 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.473881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1467bb99-98ce-4602-a9af-f2d66e314d90 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.474686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1467bb99-98ce-4602-a9af-f2d66e314d90 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.475131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1467bb99-98ce-4602-a9af-f2d66e314d90 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.475253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:54:41.476849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.478556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.479450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.480720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.482017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.482017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3853f327-92c0-4e5a-9594-5a7bfe865910 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.031999 Jul 14 09:54:41.482017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 701/1452] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:54:41 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:54:41.486705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.487189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.494847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.495295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.496128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.496622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.501949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1467bb99-98ce-4602-a9af-f2d66e314d90 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:54:41.597509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1467bb99-98ce-4602-a9af-f2d66e314d90 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.135304 Jul 14 09:54:41.598262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 752/1453] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:54:41.603180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:54:41.603514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-eb47bb2b-03c9-443a-833b-65b4f58c4088 req-a95ed1ae-0ab3-49f3-8ab9-5e47f8e958af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251fb34b-1364-48f0-89fb-248c708b799d", "name": "network-vif-deleted", "tag": "99dc9503-d87e-41e8-be83-144e940d4c66"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:54:41.613652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-eb47bb2b-03c9-443a-833b-65b4f58c4088 req-a95ed1ae-0ab3-49f3-8ab9-5e47f8e958af service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.614891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-eb47bb2b-03c9-443a-833b-65b4f58c4088 req-a95ed1ae-0ab3-49f3-8ab9-5e47f8e958af service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.629608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-eb47bb2b-03c9-443a-833b-65b4f58c4088 req-a95ed1ae-0ab3-49f3-8ab9-5e47f8e958af service nova] Creating event network-vif-deleted:99dc9503-d87e-41e8-be83-144e940d4c66 for instance 251fb34b-1364-48f0-89fb-248c708b799d on hv-cinder-82549 Jul 14 09:54:41.635482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-eb47bb2b-03c9-443a-833b-65b4f58c4088 req-a95ed1ae-0ab3-49f3-8ab9-5e47f8e958af service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035702 Jul 14 09:54:41.636329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 753/1454] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:54:41.643174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.643868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.650127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.650634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.651403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.651843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.669886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ecef1e48-fc3f-4521-be65-ff156318c0c0) Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:54:41.672242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:54:41.673807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ecef1e48-fc3f-4521-be65-ff156318c0c0) Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.674807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ecef1e48-fc3f-4521-be65-ff156318c0c0) Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.676321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ecef1e48-fc3f-4521-be65-ff156318c0c0) Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.677638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ecef1e48-fc3f-4521-be65-ff156318c0c0) Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.678872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ecef1e48-fc3f-4521-be65-ff156318c0c0) Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ecef1e48-fc3f-4521-be65-ff156318c0c0) Jul 14 09:54:41.680132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.682070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ecef1e48-fc3f-4521-be65-ff156318c0c0) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.682954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f534e3e4-6b2b-4935-b269-28dd738ef3b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 0.200015 Jul 14 09:54:41.684309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 702/1455] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 269 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:54:41.689391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.689882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.696124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.696579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.697352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.697791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.741330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:54:41.791389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:54:41.823559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba9f72de-040a-469c-9b96-d32fb85e6b27) Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:54:41.826030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:54:41.827395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba9f72de-040a-469c-9b96-d32fb85e6b27) Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.828100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba9f72de-040a-469c-9b96-d32fb85e6b27) Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.831243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba9f72de-040a-469c-9b96-d32fb85e6b27) Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.832461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba9f72de-040a-469c-9b96-d32fb85e6b27) Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.833459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba9f72de-040a-469c-9b96-d32fb85e6b27) Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba9f72de-040a-469c-9b96-d32fb85e6b27) Jul 14 09:54:41.835831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.837912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba9f72de-040a-469c-9b96-d32fb85e6b27) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.837912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d3e81458-8dd8-481f-8528-60ebf93797ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 0.189627 Jul 14 09:54:41.837912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 754/1456] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 269 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:54:41.837912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1ff74422-8855-4c62-a868-7aae50e61168 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.839510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1ff74422-8855-4c62-a868-7aae50e61168 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.843950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ff74422-8855-4c62-a868-7aae50e61168 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.844520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ff74422-8855-4c62-a868-7aae50e61168 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.845426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ff74422-8855-4c62-a868-7aae50e61168 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.846151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1ff74422-8855-4c62-a868-7aae50e61168 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.862888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03d2162-3fac-49ca-8c7a-c721373e4002) Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:54:41.865351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:54:41.868137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03d2162-3fac-49ca-8c7a-c721373e4002) Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.871386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03d2162-3fac-49ca-8c7a-c721373e4002) Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:54:41.874440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03d2162-3fac-49ca-8c7a-c721373e4002) Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.880067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03d2162-3fac-49ca-8c7a-c721373e4002) Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.882904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03d2162-3fac-49ca-8c7a-c721373e4002) Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03d2162-3fac-49ca-8c7a-c721373e4002) Jul 14 09:54:41.885659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.888649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d03d2162-3fac-49ca-8c7a-c721373e4002) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.888649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-acacbfad-d5cc-4f22-873d-42cfd63126d2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 0.181947 Jul 14 09:54:41.888649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 703/1457] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:54:41.888649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.889284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.889284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.889284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.889284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.890942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.891099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1ff74422-8855-4c62-a868-7aae50e61168 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056651 Jul 14 09:54:41.891099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 755/1458] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:54:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:54:41.892535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.893019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.899219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.899665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.900465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.900880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.904484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:54:41.905559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.906859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:54:41.907566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:54:41.910827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:54:41.911872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:54:41.911872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e1ec7fe2-08e1-40d4-82c9-74a1ce24e907 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.037746 Jul 14 09:54:41.911872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 704/1459] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:54:41 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:54:41.912616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:41.913306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:41.920486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:54:41.920944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:54:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 (ip 10.222.0.40) !!! Jul 14 09:54:41.923355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.926528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.926528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:41.926528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:41.937031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:54:41.994550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.compute.api [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Instance is already in deleting state, ignoring this request Jul 14 09:54:41.995389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-034f3bc9-c7f3-469a-9d40-18a9b125383d tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.107620 Jul 14 09:54:41.996788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 756/1460] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:54:42.001930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:54:42.002511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:54:42.010421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:42.010879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:42.012415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:54:42.012844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:54:42.022401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:54:51.917856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=16 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:54:52.006534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=25 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:54:52.026496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=46 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:54:52.039938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:55:46.928365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2a31962b-017a-4055-828d-8598b8c717a1) Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:55:46.930744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:55:46.932249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2a31962b-017a-4055-828d-8598b8c717a1) Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:55:46.933499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2a31962b-017a-4055-828d-8598b8c717a1) Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:55:46.935381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2a31962b-017a-4055-828d-8598b8c717a1) Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:46.938976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2a31962b-017a-4055-828d-8598b8c717a1) Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:46.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2a31962b-017a-4055-828d-8598b8c717a1) Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2a31962b-017a-4055-828d-8598b8c717a1) Jul 14 09:55:46.942474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:46.943988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2a31962b-017a-4055-828d-8598b8c717a1) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:55:46.943988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-11e0cccb-4d27-4fb8-986a-3d6fd5ee5c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 65.023448 Jul 14 09:55:46.943988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 705/1461] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 269 bytes in 65024 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:55:46.987140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:55:47.097483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:55:47.099509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:55:47.107062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.107579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.108443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.108945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.143365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04ecfd26-f175-4304-a2d0-b09832b98261) Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:55:47.145693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:55:47.147987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04ecfd26-f175-4304-a2d0-b09832b98261) Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:55:47.150286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04ecfd26-f175-4304-a2d0-b09832b98261) Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:55:47.154224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04ecfd26-f175-4304-a2d0-b09832b98261) Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.156213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04ecfd26-f175-4304-a2d0-b09832b98261) Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:47.158385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04ecfd26-f175-4304-a2d0-b09832b98261) Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04ecfd26-f175-4304-a2d0-b09832b98261) Jul 14 09:55:47.160574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.162394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-04ecfd26-f175-4304-a2d0-b09832b98261) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:55:47.162394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-08e70166-67be-447f-9418-d341c3de721b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 65.149422 Jul 14 09:55:47.162394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 757/1462] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:54:41 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 269 bytes in 65150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:55:47.198075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:55:47.260606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5193a24-ac2b-4fe8-9945-0fb70526260f) Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:55:47.263750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:55:47.266094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5193a24-ac2b-4fe8-9945-0fb70526260f) Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:55:47.266951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5193a24-ac2b-4fe8-9945-0fb70526260f) Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:55:47.268300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5193a24-ac2b-4fe8-9945-0fb70526260f) Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.269740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5193a24-ac2b-4fe8-9945-0fb70526260f) Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:47.271038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5193a24-ac2b-4fe8-9945-0fb70526260f) Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5193a24-ac2b-4fe8-9945-0fb70526260f) Jul 14 09:55:47.272454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.273645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5193a24-ac2b-4fe8-9945-0fb70526260f) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:55:47.273645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7c1cbb3a-0eb2-42d6-ac7e-327b2a22dde4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 0.331878 Jul 14 09:55:47.273645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 706/1463] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:55:46 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 334 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:55:47.273645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:55:47.273996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:55:47.280815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.282009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.282009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.283125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.307555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:55:47.309109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:55:47.311948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:55:47.313617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:55:47.315176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.316519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:55:47.316519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-32feadcc-8bdd-44ad-9edd-7a28e8289567 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.042493 Jul 14 09:55:47.316519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 707/1464] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:55:47 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:55:47.354248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-261d39a7-cbee-4ec8-a3ca-d2d5378db3b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:55:47.355253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-261d39a7-cbee-4ec8-a3ca-d2d5378db3b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:55:47.362490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-261d39a7-cbee-4ec8-a3ca-d2d5378db3b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.362940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-261d39a7-cbee-4ec8-a3ca-d2d5378db3b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.363719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-261d39a7-cbee-4ec8-a3ca-d2d5378db3b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.364200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-261d39a7-cbee-4ec8-a3ca-d2d5378db3b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.399311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-261d39a7-cbee-4ec8-a3ca-d2d5378db3b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.250094 Jul 14 09:55:47.399824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 758/1465] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:55:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:55:47.405457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:55:47.405951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:55:47.412895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.413344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.414138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.414604 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.498218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:55:47.498950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:55:47.505323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.505769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.506861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.507303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.517051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:55:47.539878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:55:47.598416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2388ad36-50ef-4607-a4a8-43e706253569) Jul 14 09:55:47.601374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.compute.api [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Instance is already in deleting state, ignoring this request Jul 14 09:55:47.602233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-006dae8d-450c-4e90-a62d-73b4f505e67f tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.290214 Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:55:47.602980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:55:47.604759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2388ad36-50ef-4607-a4a8-43e706253569) Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:55:47.605393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2388ad36-50ef-4607-a4a8-43e706253569) Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:55:47.606532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2388ad36-50ef-4607-a4a8-43e706253569) Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.607647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2388ad36-50ef-4607-a4a8-43e706253569) Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:47.608671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2388ad36-50ef-4607-a4a8-43e706253569) Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2388ad36-50ef-4607-a4a8-43e706253569) Jul 14 09:55:47.611023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:55:47.614501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 708/1466] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:55:47 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:55:47.614995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2388ad36-50ef-4607-a4a8-43e706253569) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:55:47.614995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8cf34a97-e8af-4b28-bf81-22f3882a601a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 0.204386 Jul 14 09:55:47.614995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 759/1467] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:55:47 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 269 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:55:47.615986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-b63b9c01-71a2-4647-b508-d2fc00e9bbcf req-8cb21d3a-7fa4-4256-93cd-7526aa93892c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a699dfcd-f703-4225-a432-860189583054", "name": "network-vif-deleted", "tag": "f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 09:55:47.618346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-b63b9c01-71a2-4647-b508-d2fc00e9bbcf req-8cb21d3a-7fa4-4256-93cd-7526aa93892c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.618648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:55:47.618966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-b63b9c01-71a2-4647-b508-d2fc00e9bbcf req-8cb21d3a-7fa4-4256-93cd-7526aa93892c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.619250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:55:47.630374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.631008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.631843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.632086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-b63b9c01-71a2-4647-b508-d2fc00e9bbcf req-8cb21d3a-7fa4-4256-93cd-7526aa93892c service nova] Creating event network-vif-deleted:f8b91b4e-1b10-4d9f-a9f3-ff3c1449d659 for instance a699dfcd-f703-4225-a432-860189583054 on hv-cinder-82549 Jul 14 09:55:47.632289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.638583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-b63b9c01-71a2-4647-b508-d2fc00e9bbcf req-8cb21d3a-7fa4-4256-93cd-7526aa93892c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033444 Jul 14 09:55:47.639482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 709/1468] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 09:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:55:47.645297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:55:47.645872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:55:47.652676 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.653080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:47.654157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:55:47.654612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:55:57.625107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=6 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:55:57.649650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=10 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:55:57.658431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=22 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:55:57.678086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:56:28.220125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:56:28.220868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:56:28.476141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:56:28.476730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 09:56:42.101652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:56:42.145278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:56:50.591504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:56:50.592154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:56:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 09:56:52.105946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:56:52.150016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:57:47.736790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b7b589-a46f-476a-b85f-71d518bd51f6) Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:57:47.739145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:57:47.740833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b7b589-a46f-476a-b85f-71d518bd51f6) Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:57:47.742260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b7b589-a46f-476a-b85f-71d518bd51f6) Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:57:47.745423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b7b589-a46f-476a-b85f-71d518bd51f6) Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b7b589-a46f-476a-b85f-71d518bd51f6) Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:57:47.748359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b7b589-a46f-476a-b85f-71d518bd51f6) Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b7b589-a46f-476a-b85f-71d518bd51f6) Jul 14 09:57:47.749885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.751494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b7b589-a46f-476a-b85f-71d518bd51f6) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:57:47.751494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-709afb4d-a86f-4e75-83e8-18851166d780 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 120.133298 Jul 14 09:57:47.751494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 760/1469] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:55:47 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 269 bytes in 120135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:57:47.751494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-950042fe-2992-425f-8ae2-622db31e407a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:57:47.751918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-950042fe-2992-425f-8ae2-622db31e407a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:57:47.754745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-950042fe-2992-425f-8ae2-622db31e407a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.755201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-950042fe-2992-425f-8ae2-622db31e407a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.755972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-950042fe-2992-425f-8ae2-622db31e407a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.756419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-950042fe-2992-425f-8ae2-622db31e407a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.772514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7e5a2c5-b8ec-44f7-80f7-54f99db5a180) Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:57:47.774869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 09:57:47.776225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7e5a2c5-b8ec-44f7-80f7-54f99db5a180) Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:57:47.777104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7e5a2c5-b8ec-44f7-80f7-54f99db5a180) Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:57:47.778313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7e5a2c5-b8ec-44f7-80f7-54f99db5a180) Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.780048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7e5a2c5-b8ec-44f7-80f7-54f99db5a180) Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:57:47.781065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7e5a2c5-b8ec-44f7-80f7-54f99db5a180) Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7e5a2c5-b8ec-44f7-80f7-54f99db5a180) Jul 14 09:57:47.782164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.783245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7e5a2c5-b8ec-44f7-80f7-54f99db5a180) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:57:47.783245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-21c82243-3332-4710-973c-6686a7b0b6fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 120.135426 Jul 14 09:57:47.783245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 710/1470] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:55:47 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 269 bytes in 120137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:57:47.784701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:57:47.784701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:57:47.789696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-950042fe-2992-425f-8ae2-622db31e407a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Jul 14 09:57:47.790422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.790821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 761/1471] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:57:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:57:47.791014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.791798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.792237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.796164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:57:47.796921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:57:47.802794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.803394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.804031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.804474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.806229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:57:47.807765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:57:47.811587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:57:47.813589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:57:47.816548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:57:47.819547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:57:47.819547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-48e24b1d-9008-4ed9-bfbb-8c780b50fefe tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.031091 Jul 14 09:57:47.819547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 711/1472] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:57:47 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:57:47.819547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:57:47.819547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:57:47.821224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.821652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.822463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.822903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.829685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:57:47.882805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.compute.api [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Instance is already in deleting state, ignoring this request Jul 14 09:57:47.883646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5abfeb18-b7ce-4cf3-8741-0f6fcdc032af tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.091973 Jul 14 09:57:47.884209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 762/1473] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:57:47 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:57:47.889402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:57:47.889891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:57:47.895731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.896177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:47.896948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:57:47.897461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:57:57.820802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:57:57.845161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=6 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:57:57.893762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=6 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:57:57.915785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:57:58.298962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:57:58.299230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 09:58:01.946148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:58:01.946710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:58:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 09:58:36.023493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:58:36.023493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:58:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 09:58:42.259647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:58:42.303978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 09:58:52.264414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:58:52.311567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:59:48.112579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38c8eebc-7c64-434f-aaa3-57bf49b7df86) Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 09:59:48.116965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 09:59:48.119778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38c8eebc-7c64-434f-aaa3-57bf49b7df86) Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:59:48.121045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38c8eebc-7c64-434f-aaa3-57bf49b7df86) Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:59:48.124315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38c8eebc-7c64-434f-aaa3-57bf49b7df86) Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.126924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38c8eebc-7c64-434f-aaa3-57bf49b7df86) Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:59:48.129504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38c8eebc-7c64-434f-aaa3-57bf49b7df86) Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38c8eebc-7c64-434f-aaa3-57bf49b7df86) Jul 14 09:59:48.131297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.133531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-38c8eebc-7c64-434f-aaa3-57bf49b7df86) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:59:48.133531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9568bcb4-99dc-4f73-8611-54542f1320ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 120.308425 Jul 14 09:59:48.133531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 712/1474] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:57:47 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 269 bytes in 120310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:59:48.133531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:59:48.134151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:59:48.140812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.141412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.142459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.143590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.230241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:59:48.230457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 09:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 09:59:48.296649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f86dff05-0568-4442-bee9-88a31d1b9a2c) Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:59:48.299880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 09:59:48.303406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f86dff05-0568-4442-bee9-88a31d1b9a2c) Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:59:48.304807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f86dff05-0568-4442-bee9-88a31d1b9a2c) Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 09:59:48.307371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f86dff05-0568-4442-bee9-88a31d1b9a2c) Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.309795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f86dff05-0568-4442-bee9-88a31d1b9a2c) Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:59:48.312031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f86dff05-0568-4442-bee9-88a31d1b9a2c) Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f86dff05-0568-4442-bee9-88a31d1b9a2c) Jul 14 09:59:48.314375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.316531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f86dff05-0568-4442-bee9-88a31d1b9a2c) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:59:48.316531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a0d04069-773f-4a80-80f5-55e1c8a2bcac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 120.418795 Jul 14 09:59:48.316531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 763/1475] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:57:47 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 269 bytes in 120421 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 09:59:48.318555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-35489ee5-2e00-427a-baf9-21d556a1aaa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:59:48.319600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-35489ee5-2e00-427a-baf9-21d556a1aaa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:59:48.326961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35489ee5-2e00-427a-baf9-21d556a1aaa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.327528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35489ee5-2e00-427a-baf9-21d556a1aaa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.328384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35489ee5-2e00-427a-baf9-21d556a1aaa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.328994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35489ee5-2e00-427a-baf9-21d556a1aaa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.362107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-35489ee5-2e00-427a-baf9-21d556a1aaa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054503 Jul 14 09:59:48.362981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 764/1476] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 09:59:48 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 09:59:48.464595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:59:48.465221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:59:48.471639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.472094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.473432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.473871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.487235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 09:59:48.492373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 09:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d (ip 10.222.0.40) !!! Jul 14 09:59:48.494247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 09:59:48.497249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:59:48.498924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 09:59:48.499828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 09:59:48.501262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 09:59:48.502668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 09:59:48.502668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0636d3ea-e9f7-42d4-a038-db27dfc73320 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.137247 Jul 14 09:59:48.502923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 765/1477] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 09:59:48 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 09:59:48.510123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:59:48.511576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:59:48.520060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.520515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.521297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.521742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.559515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 09:59:48.612754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.compute.api [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Instance is already in deleting state, ignoring this request Jul 14 09:59:48.613737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5e968778-4513-4208-b863-8ef7f0a454c6 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.107870 Jul 14 09:59:48.614464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 766/1478] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 09:59:48 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 09:59:48.619859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 09:59:48.620421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 09:59:48.627309 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.627879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:48.628809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 09:59:48.629289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 09:59:58.137849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:59:58.168691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:59:58.624870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=8 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 09:59:58.660317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:00:10.599497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:00:10.600497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:00:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:00:42.406310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:00:42.456108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:00:52.412656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:00:52.461051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:01:18.307525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:01:18.308278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:01:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 10:01:21.955088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:01:21.955710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:01:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:01:48.566955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0ace2cac-b90e-4ca4-aa1d-77377cf03166) Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 HTTP/1.1 Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:01:48.569666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:01:48.571240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0ace2cac-b90e-4ca4-aa1d-77377cf03166) Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '7f265cbd-76a7-486d-873c-085ab051c168', 'id': '46190db4-e605-49d6-b376-a7c45ff90461'} Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:01:48.571923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0ace2cac-b90e-4ca4-aa1d-77377cf03166) Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:01:48.573069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0ace2cac-b90e-4ca4-aa1d-77377cf03166) Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.575274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0ace2cac-b90e-4ca4-aa1d-77377cf03166) Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:01:48.577186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0ace2cac-b90e-4ca4-aa1d-77377cf03166) Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0ace2cac-b90e-4ca4-aa1d-77377cf03166) Jul 14 10:01:48.580658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.582498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0ace2cac-b90e-4ca4-aa1d-77377cf03166) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:01:48.582498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461" status: 400 len: 269 microversion: 2.1 time: 120.449552 Jul 14 10:01:48.582498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (ip 10.222.0.40) !!! Jul 14 10:01:48.582498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:01:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 (10.222.0.40) Jul 14 10:01:48.582498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: CRITICAL nova [None req-a99d5240-878c-4f33-8f36-1f8cf66071a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Unhandled error: OSError: write error Jul 14 10:01:48.582498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova OSError: write error Jul 14 10:01:48.582498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova Jul 14 10:01:48.583270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 713/1479] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:59:48 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments/46190db4-e605-49d6-b376-a7c45ff90461 => generated 0 bytes in 120452 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:01:48.583270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:01:48.583270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:01:48.587622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.588067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.588839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.589267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.609139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fb3b301-8b31-4f00-8e05-5580480ddd5f) Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:01:48.615205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:01:48.616628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fb3b301-8b31-4f00-8e05-5580480ddd5f) Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:01:48.617285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fb3b301-8b31-4f00-8e05-5580480ddd5f) Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:01:48.618386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fb3b301-8b31-4f00-8e05-5580480ddd5f) Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.620127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fb3b301-8b31-4f00-8e05-5580480ddd5f) Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:01:48.622467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fb3b301-8b31-4f00-8e05-5580480ddd5f) Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fb3b301-8b31-4f00-8e05-5580480ddd5f) Jul 14 10:01:48.624896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.629634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2fb3b301-8b31-4f00-8e05-5580480ddd5f) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:01:48.629634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 120.001314 Jul 14 10:01:48.629634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:01:48.629634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:01:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (10.222.0.40) Jul 14 10:01:48.629634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-78dfc791-49d9-41ab-95c4-06bf02fe63fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Unhandled error: OSError: write error Jul 14 10:01:48.629634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:01:48.629634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:01:48.630728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 767/1480] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 09:59:48 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 0 bytes in 120003 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:01:48.630728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f540e61e-cb85-4873-8148-eb09d47a877e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:01:48.630728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f540e61e-cb85-4873-8148-eb09d47a877e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:01:48.634991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f540e61e-cb85-4873-8148-eb09d47a877e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.635437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f540e61e-cb85-4873-8148-eb09d47a877e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.636209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f540e61e-cb85-4873-8148-eb09d47a877e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.636629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f540e61e-cb85-4873-8148-eb09d47a877e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.679967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f540e61e-cb85-4873-8148-eb09d47a877e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059718 Jul 14 10:01:48.680549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 768/1481] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:01:48 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:01:48.770057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c51de4a5-4d8c-4fe3-9e45-e8a0468c5eaa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:01:48.771513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c51de4a5-4d8c-4fe3-9e45-e8a0468c5eaa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:01:48.781989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c51de4a5-4d8c-4fe3-9e45-e8a0468c5eaa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.782483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c51de4a5-4d8c-4fe3-9e45-e8a0468c5eaa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.783275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c51de4a5-4d8c-4fe3-9e45-e8a0468c5eaa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.783714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c51de4a5-4d8c-4fe3-9e45-e8a0468c5eaa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.830116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c51de4a5-4d8c-4fe3-9e45-e8a0468c5eaa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148115 Jul 14 10:01:48.831157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 769/1482] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:01:48 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:01:48.839151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:01:48.840042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:01:48.848238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.849161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.849470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.849912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.866252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:01:48.867319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:01:48.871241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:01:48.872507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:01:48.873731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:01:48.876402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:01:48.876402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4e34e472-e2a1-408f-b6d5-a261710dd281 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.035739 Jul 14 10:01:48.876402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 770/1483] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:01:48 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:01:48.955142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:01:48.955648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:01:48.962732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.963184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.963955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:48.964397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:48.991277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:01:49.044445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.compute.api [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Instance is already in deleting state, ignoring this request Jul 14 10:01:49.045422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a6847bbc-3574-490f-9187-418312c74977 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.175148 Jul 14 10:01:49.047857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 771/1484] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:01:48 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:01:49.051053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:01:49.051581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:01:49.057941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:49.058427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:49.059200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:01:49.059633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:01:56.031763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:01:56.032381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:01:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 10:01:58.585648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:01:58.609804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:01:59.055799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=10 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:01:59.079737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:02:42.537926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:02:42.591807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:02:52.542952 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:02:52.596825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:08.241567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:03:08.242146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:03:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 10:03:08.518752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:03:08.519296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:03:30.609188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:03:30.609862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:03:48.938088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8e3900a-e269-4a70-a276-bcdf30fa1153) Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:03:48.943752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:03:48.946733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8e3900a-e269-4a70-a276-bcdf30fa1153) Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:03:48.948218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8e3900a-e269-4a70-a276-bcdf30fa1153) Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:03:48.950877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8e3900a-e269-4a70-a276-bcdf30fa1153) Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:48.954695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8e3900a-e269-4a70-a276-bcdf30fa1153) Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:03:48.956786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8e3900a-e269-4a70-a276-bcdf30fa1153) Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8e3900a-e269-4a70-a276-bcdf30fa1153) Jul 14 10:03:48.959068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:03:48.961493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8e3900a-e269-4a70-a276-bcdf30fa1153) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:03:48.961493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 120.372322 Jul 14 10:03:48.961493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:03:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 10:03:48.961493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:03:48 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (10.222.0.40) Jul 14 10:03:48.961493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: CRITICAL nova [None req-5a741482-b0ac-4fae-aa76-f57484eeebf3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Unhandled error: OSError: write error Jul 14 10:03:48.961493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova OSError: write error Jul 14 10:03:48.961493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova Jul 14 10:03:48.962902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 714/1485] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:01:48 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 0 bytes in 120375 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:03:48.962902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:03:48.962902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:03:48.967975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:48.968420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:48.969193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:48.969619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:48.993233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0ea6e61-dbe0-43a9-a08a-4087b5abf706) Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:03:49.000746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:03:49.003904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0ea6e61-dbe0-43a9-a08a-4087b5abf706) Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:03:49.005319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0ea6e61-dbe0-43a9-a08a-4087b5abf706) Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:03:49.009267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0ea6e61-dbe0-43a9-a08a-4087b5abf706) Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:49.013970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0ea6e61-dbe0-43a9-a08a-4087b5abf706) Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:03:49.018233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0ea6e61-dbe0-43a9-a08a-4087b5abf706) Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0ea6e61-dbe0-43a9-a08a-4087b5abf706) Jul 14 10:03:49.023024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.026225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0ea6e61-dbe0-43a9-a08a-4087b5abf706) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:03:49.026225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 119.956107 Jul 14 10:03:49.026225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:03:49.026225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (10.222.0.40) Jul 14 10:03:49.026225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-7667e7af-50a1-4185-8b46-0e47ad931774 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Unhandled error: OSError: write error Jul 14 10:03:49.026225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:03:49.026225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:03:49.027536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 772/1486] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:01:49 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 0 bytes in 119958 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:03:49.027536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:03:49.027536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:03:49.027536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.028149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.028149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.028149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.048752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:03:49.139189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 204 len: 0 microversion: 2.20 time: 0.132685 Jul 14 10:03:49.139775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f (ip 10.222.0.40) !!! Jul 14 10:03:49.139775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f (10.222.0.40) Jul 14 10:03:49.140543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-561b9202-ecbc-4269-ba01-38c0b9e59b9b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Unhandled error: OSError: write error Jul 14 10:03:49.140543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:03:49.140543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:03:49.140937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 773/1487] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:03:49 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:03:49.146132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d20a685a-a697-4072-89ab-4b112d5b5a7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:03:49.147257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d20a685a-a697-4072-89ab-4b112d5b5a7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:03:49.161586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d20a685a-a697-4072-89ab-4b112d5b5a7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.161586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d20a685a-a697-4072-89ab-4b112d5b5a7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.162408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d20a685a-a697-4072-89ab-4b112d5b5a7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.162971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d20a685a-a697-4072-89ab-4b112d5b5a7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.203592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d20a685a-a697-4072-89ab-4b112d5b5a7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061707 Jul 14 10:03:49.204250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments (ip 10.222.0.40) !!! Jul 14 10:03:49.204250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments (10.222.0.40) Jul 14 10:03:49.204986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-d20a685a-a697-4072-89ab-4b112d5b5a7f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Unhandled error: OSError: write error Jul 14 10:03:49.204986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:03:49.204986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:03:49.205465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 774/1488] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:03:49 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:03:49.209979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da156017-43fd-4f07-a397-cc2b26ef6b34 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:03:49.210980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da156017-43fd-4f07-a397-cc2b26ef6b34 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:03:49.218647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da156017-43fd-4f07-a397-cc2b26ef6b34 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.219508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da156017-43fd-4f07-a397-cc2b26ef6b34 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.220751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da156017-43fd-4f07-a397-cc2b26ef6b34 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.221074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da156017-43fd-4f07-a397-cc2b26ef6b34 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.268885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da156017-43fd-4f07-a397-cc2b26ef6b34 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062670 Jul 14 10:03:49.269456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments (ip 10.222.0.40) !!! Jul 14 10:03:49.269456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments (10.222.0.40) Jul 14 10:03:49.270057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-da156017-43fd-4f07-a397-cc2b26ef6b34 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Unhandled error: OSError: write error Jul 14 10:03:49.270057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:03:49.270057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:03:49.270398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 775/1489] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:03:49 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:03:49.274861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:03:49.275510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:03:49.282022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.282510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.283347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.283801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.300771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:03:49.302382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:03:49.303990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:03:49.305087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:03:49.307533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:03:49.309677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:03:49.309677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.032619 Jul 14 10:03:49.309677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d (ip 10.222.0.40) !!! Jul 14 10:03:49.309677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d (10.222.0.40) Jul 14 10:03:49.309677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-9de9b450-19d0-49e4-895b-31033ec8ff56 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Unhandled error: OSError: write error Jul 14 10:03:49.309677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:03:49.309677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:03:49.309677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 776/1490] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:03:49 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 0 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:03:49.310567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:03:49.310567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:03:49.319799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.320440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.321735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.322234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.360375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:03:49.412133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.compute.api [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Instance is already in deleting state, ignoring this request Jul 14 10:03:49.412883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.106914 Jul 14 10:03:49.413412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 (ip 10.222.0.40) !!! Jul 14 10:03:49.413412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:03:49 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 (10.222.0.40) Jul 14 10:03:49.413994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-fa3cc0ce-f531-4049-97ad-cd274b2d752c tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Unhandled error: OSError: write error Jul 14 10:03:49.413994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:03:49.413994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:03:49.414576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 777/1491] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:03:49 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:03:49.419275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:03:49.419811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:03:49.426663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.427116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:49.427894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:03:49.428335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:03:58.965270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:58.996985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:59.424764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:03:59.448495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:38.319283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:04:38.320277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 10:04:41.965832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:04:41.966534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:04:42.816007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:04:42.880158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:04:43.088873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7039eac-9b0e-4fb5-8dc3-763088a07d15) Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:43.091370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:04:43.094419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7039eac-9b0e-4fb5-8dc3-763088a07d15) Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.095564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7039eac-9b0e-4fb5-8dc3-763088a07d15) Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.097058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7039eac-9b0e-4fb5-8dc3-763088a07d15) Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.103761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7039eac-9b0e-4fb5-8dc3-763088a07d15) Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.108109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7039eac-9b0e-4fb5-8dc3-763088a07d15) Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7039eac-9b0e-4fb5-8dc3-763088a07d15) Jul 14 10:04:43.112165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.113700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c7039eac-9b0e-4fb5-8dc3-763088a07d15) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:43.113700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 54.143911 Jul 14 10:04:43.113700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 10:04:43.113700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (10.222.0.40) Jul 14 10:04:43.113700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: CRITICAL nova [None req-bb2ed5ac-8ef1-4794-b211-e54d6a220bca tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Unhandled error: OSError: write error Jul 14 10:04:43.113700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova OSError: write error Jul 14 10:04:43.113700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova Jul 14 10:04:43.114410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 715/1492] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:03:48 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 0 bytes in 54147 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.114410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.114410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.116532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.116974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.117736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.118163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.133355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566716bc-cfa5-4d4d-b43c-973c459f990b) Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:04:43.136319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:04:43.137883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566716bc-cfa5-4d4d-b43c-973c459f990b) Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.138654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566716bc-cfa5-4d4d-b43c-973c459f990b) Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.139959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566716bc-cfa5-4d4d-b43c-973c459f990b) Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.141286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566716bc-cfa5-4d4d-b43c-973c459f990b) Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.142488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566716bc-cfa5-4d4d-b43c-973c459f990b) Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566716bc-cfa5-4d4d-b43c-973c459f990b) Jul 14 10:04:43.143812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.145038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566716bc-cfa5-4d4d-b43c-973c459f990b) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:43.145038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 53.722702 Jul 14 10:04:43.145038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:04:43.145038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (10.222.0.40) Jul 14 10:04:43.145038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-561afcf2-35a5-4072-a176-b3ae626409ea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Unhandled error: OSError: write error Jul 14 10:04:43.145038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:04:43.145038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:04:43.145532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 778/1493] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:03:49 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 0 bytes in 53724 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.145532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.145532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.151288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.151744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.152525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.152964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.181832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:04:43.224289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:04:43.233255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.compute.api [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Instance is already in deleting state, ignoring this request Jul 14 10:04:43.234094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 204 len: 0 microversion: 2.20 time: 0.094151 Jul 14 10:04:43.234660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f (ip 10.222.0.40) !!! Jul 14 10:04:43.234660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f (10.222.0.40) Jul 14 10:04:43.235230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-c262f0e0-abed-465e-b146-d3c7f02da2b3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Unhandled error: OSError: write error Jul 14 10:04:43.235230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:04:43.235230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:04:43.236026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 779/1494] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.240622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3501d326-5d0d-4905-858d-7a99cd0e9bcc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.241540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3501d326-5d0d-4905-858d-7a99cd0e9bcc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.247616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3501d326-5d0d-4905-858d-7a99cd0e9bcc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.248064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3501d326-5d0d-4905-858d-7a99cd0e9bcc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.248831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3501d326-5d0d-4905-858d-7a99cd0e9bcc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.249274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3501d326-5d0d-4905-858d-7a99cd0e9bcc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.282610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3501d326-5d0d-4905-858d-7a99cd0e9bcc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Jul 14 10:04:43.283230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments (ip 10.222.0.40) !!! Jul 14 10:04:43.283230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments (10.222.0.40) Jul 14 10:04:43.283704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-3501d326-5d0d-4905-858d-7a99cd0e9bcc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Unhandled error: OSError: write error Jul 14 10:04:43.283704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:04:43.283704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:04:43.283970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 780/1495] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:04:43 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.288307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-471f8303-8294-4be6-92d8-3810168e9ac1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.289251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-471f8303-8294-4be6-92d8-3810168e9ac1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.296083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-471f8303-8294-4be6-92d8-3810168e9ac1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.296541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-471f8303-8294-4be6-92d8-3810168e9ac1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.296977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d04a15e-3760-4e8e-ac6e-5443363676e8) Jul 14 10:04:43.297297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-471f8303-8294-4be6-92d8-3810168e9ac1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.297741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-471f8303-8294-4be6-92d8-3810168e9ac1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:43.300228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:04:43.301649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d04a15e-3760-4e8e-ac6e-5443363676e8) Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.302300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d04a15e-3760-4e8e-ac6e-5443363676e8) Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.303512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d04a15e-3760-4e8e-ac6e-5443363676e8) Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.304683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d04a15e-3760-4e8e-ac6e-5443363676e8) Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.305692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d04a15e-3760-4e8e-ac6e-5443363676e8) Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d04a15e-3760-4e8e-ac6e-5443363676e8) Jul 14 10:04:43.306808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.307852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d04a15e-3760-4e8e-ac6e-5443363676e8) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:43.307852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 0.203555 Jul 14 10:04:43.307852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (ip 10.222.0.40) !!! Jul 14 10:04:43.307852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee (10.222.0.40) Jul 14 10:04:43.307852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: CRITICAL nova [None req-4bd6884f-a84d-48dc-9990-1e041f7307a7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Unhandled error: OSError: write error Jul 14 10:04:43.307852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova OSError: write error Jul 14 10:04:43.307852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova Jul 14 10:04:43.308332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 716/1496] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 0 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.308583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.309204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.316481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.316991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.317847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.318307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.334247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:43.335690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.337653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:43.338672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.340717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.343141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:43.343245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-471f8303-8294-4be6-92d8-3810168e9ac1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051839 Jul 14 10:04:43.343342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.032074 Jul 14 10:04:43.343441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments (ip 10.222.0.40) !!! Jul 14 10:04:43.343441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments (10.222.0.40) Jul 14 10:04:43.343624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d (ip 10.222.0.40) !!! Jul 14 10:04:43.343624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d (10.222.0.40) Jul 14 10:04:43.343790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-471f8303-8294-4be6-92d8-3810168e9ac1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Unhandled error: OSError: write error Jul 14 10:04:43.343790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:04:43.343790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:04:43.343790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 781/1497] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:04:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.344242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: CRITICAL nova [None req-f9ca20ae-555c-4d51-8de2-8895a2f9e931 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Unhandled error: OSError: write error Jul 14 10:04:43.344242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova OSError: write error Jul 14 10:04:43.344242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova Jul 14 10:04:43.344242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 717/1498] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:04:43 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 0 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.344631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.344801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.344955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.345109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.348681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.349081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.349238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.349530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.349997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.350322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.350470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.350758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.389565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:04:43.444670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:04:43.502670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 204 len: 0 microversion: 2.1 time: 0.163428 Jul 14 10:04:43.503456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 (ip 10.222.0.40) !!! Jul 14 10:04:43.503456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:04:43 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 (10.222.0.40) Jul 14 10:04:43.504286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: CRITICAL nova [None req-22a956bc-badb-4f54-96b6-e10e9f28778b tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Unhandled error: OSError: write error Jul 14 10:04:43.504286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova OSError: write error Jul 14 10:04:43.504286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova Jul 14 10:04:43.504678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 782/1499] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.510670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.511250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.528033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.528299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ec15575-0b2c-404d-b26b-0f29a984bf1d) Jul 14 10:04:43.528521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.529697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.530297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:43.530937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:04:43.533611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ec15575-0b2c-404d-b26b-0f29a984bf1d) Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.534767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ec15575-0b2c-404d-b26b-0f29a984bf1d) Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.536027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ec15575-0b2c-404d-b26b-0f29a984bf1d) Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.537527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ec15575-0b2c-404d-b26b-0f29a984bf1d) Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.540044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ec15575-0b2c-404d-b26b-0f29a984bf1d) Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ec15575-0b2c-404d-b26b-0f29a984bf1d) Jul 14 10:04:43.542780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.545039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5ec15575-0b2c-404d-b26b-0f29a984bf1d) {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:43.545039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 0.193214 Jul 14 10:04:43.545039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (ip 10.222.0.40) !!! Jul 14 10:04:43.545039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:04:43 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 (10.222.0.40) Jul 14 10:04:43.545039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: CRITICAL nova [None req-c1f4d793-3220-4f0d-92ba-e58068e12497 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Unhandled error: OSError: write error Jul 14 10:04:43.545039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova OSError: write error Jul 14 10:04:43.545039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova Jul 14 10:04:43.545946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 718/1500] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 0 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 10:04:43.551039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.551631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.558125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.558125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.561479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.561479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.593635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:04:43.653011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.compute.api [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Instance is already in deleting state, ignoring this request Jul 14 10:04:43.653848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fc23b51c-0d2c-4420-8746-8cc98142e6ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 204 len: 0 microversion: 2.20 time: 0.112096 Jul 14 10:04:43.654740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 719/1501] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:04:43.660308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c9a49fbd-8ebb-4c6d-bb12-ac4c97fd877b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.660907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 21359018-1e48-4ba4-9529-a19b35577d59 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:04:43.661287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c9a49fbd-8ebb-4c6d-bb12-ac4c97fd877b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.667442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9a49fbd-8ebb-4c6d-bb12-ac4c97fd877b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.667879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9a49fbd-8ebb-4c6d-bb12-ac4c97fd877b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.668649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9a49fbd-8ebb-4c6d-bb12-ac4c97fd877b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.669114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9a49fbd-8ebb-4c6d-bb12-ac4c97fd877b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.713113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c9a49fbd-8ebb-4c6d-bb12-ac4c97fd877b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056716 Jul 14 10:04:43.714064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 720/1502] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:04:43 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:04:43.722537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a3c1d43d-fd5e-4be2-bf34-9ebd09ca648b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.724011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a3c1d43d-fd5e-4be2-bf34-9ebd09ca648b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.733748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3c1d43d-fd5e-4be2-bf34-9ebd09ca648b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.734517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3c1d43d-fd5e-4be2-bf34-9ebd09ca648b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.736372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3c1d43d-fd5e-4be2-bf34-9ebd09ca648b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.737083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3c1d43d-fd5e-4be2-bf34-9ebd09ca648b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.746799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f9a7196-2c68-4b17-b77b-80ff70fc2d43) Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee HTTP/1.1 Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:04:43.748981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:04:43.751900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f9a7196-2c68-4b17-b77b-80ff70fc2d43) Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '21359018-1e48-4ba4-9529-a19b35577d59', 'id': 'b38a0711-20f9-4eba-93a0-14733d5579ee'} Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.753134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f9a7196-2c68-4b17-b77b-80ff70fc2d43) Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:43.755684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f9a7196-2c68-4b17-b77b-80ff70fc2d43) Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.758083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f9a7196-2c68-4b17-b77b-80ff70fc2d43) Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.760635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f9a7196-2c68-4b17-b77b-80ff70fc2d43) Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f9a7196-2c68-4b17-b77b-80ff70fc2d43) Jul 14 10:04:43.763151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.765285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f9a7196-2c68-4b17-b77b-80ff70fc2d43) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:43.765285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9adafefe-f403-4e55-9b61-06a9924e1c73 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee" status: 400 len: 269 microversion: 2.1 time: 0.244936 Jul 14 10:04:43.765285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 783/1503] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59/os-volume_attachments/b38a0711-20f9-4eba-93a0-14733d5579ee => generated 269 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:04:43.765285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.765891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 251fb34b-1364-48f0-89fb-248c708b799d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.765891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.765891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.765891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.766506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.779293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a3c1d43d-fd5e-4be2-bf34-9ebd09ca648b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063620 Jul 14 10:04:43.780097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 721/1504] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:04:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:04:43.781400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d HTTP/1.1 Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:04:43.783610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.786120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '251fb34b-1364-48f0-89fb-248c708b799d'} Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:43.788403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. Jul 14 10:04:43.791489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.793617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 251fb34b-1364-48f0-89fb-248c708b799d could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:43.793834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.794005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-34f72d64-7583-435a-928e-6ac50563cc9e tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d" status: 404 len: 111 microversion: 2.1 time: 0.032839 Jul 14 10:04:43.794171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.794369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 784/1505] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:04:43 2022] GET /compute/v2.1/servers/251fb34b-1364-48f0-89fb-248c708b799d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:43.794369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.794369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.795120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.795120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.795468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.795777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.799887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.800631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.801588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.802037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.811461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] HTTP exception thrown: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Request method failure captured: Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 HTTP/1.1 Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-SDOa8td5k0-HQQqB8yz5Lp11SjU391gbVWFXwBzwdGGA7T9Y7Wlnx64YbjT0GS8sC8U7eSonmSeHqExgEJBJIB9m1LhBs2dWplc6QHSMnxEzJYDhauwJIpvilKABmOzTOhlmi_UDdXH7Z_S8Ge3aMcb4alQ-ksIrVdjlyHFXDzYP4 Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:43.812993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestShelveInstance-1607221687 Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 27cfaef90a5048569453430e75c4c42b Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:43.815618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'a699dfcd-f703-4225-a432-860189583054'} Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:43.817733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:43.820072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:43.822718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Returning 404 to user: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:43.822718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f7069979-ba97-4978-84b7-60ab2ea65065 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 404 len: 111 microversion: 2.1 time: 0.033587 Jul 14 10:04:43.822718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 722/1506] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:43.822718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.822718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.826490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.826928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.827681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.828110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.858180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:04:43.897261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:04:43.909127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.compute.api [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Instance is already in deleting state, ignoring this request Jul 14 10:04:43.909944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-074c5a42-d62d-4b4e-8afa-95bb70bb220a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 204 len: 0 microversion: 2.20 time: 0.093700 Jul 14 10:04:43.910852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 723/1507] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:04:43.915804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-862cbe9a-f368-40f5-b1d9-57f079da834c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:43.916506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-862cbe9a-f368-40f5-b1d9-57f079da834c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:43.923264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-862cbe9a-f368-40f5-b1d9-57f079da834c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.923898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-862cbe9a-f368-40f5-b1d9-57f079da834c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.925056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-862cbe9a-f368-40f5-b1d9-57f079da834c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:43.925620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-862cbe9a-f368-40f5-b1d9-57f079da834c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:43.964626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-862cbe9a-f368-40f5-b1d9-57f079da834c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052729 Jul 14 10:04:43.965623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 724/1508] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:04:43 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:04:43.980463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8f170cbf-c4f9-4b8c-9a04-d813b7820c7d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '.version_select at 0x7f7da1e7b790>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.004740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8f170cbf-c4f9-4b8c-9a04-d813b7820c7d tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394" status: 202 len: 0 microversion: 2.1 time: 0.038071 Jul 14 10:04:44.005432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 725/1509] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:04:44.012296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.013025 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.018445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3aeb0fe-85aa-4502-a16b-4bfc173f1fec) Jul 14 10:04:44.022928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.023807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:04:44.024148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:04:44.026211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3aeb0fe-85aa-4502-a16b-4bfc173f1fec) Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:44.027046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3aeb0fe-85aa-4502-a16b-4bfc173f1fec) Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:04:44.028635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3aeb0fe-85aa-4502-a16b-4bfc173f1fec) Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.029790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3aeb0fe-85aa-4502-a16b-4bfc173f1fec) Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.031734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3aeb0fe-85aa-4502-a16b-4bfc173f1fec) Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3aeb0fe-85aa-4502-a16b-4bfc173f1fec) Jul 14 10:04:44.036002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.038352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.038352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.038627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a3aeb0fe-85aa-4502-a16b-4bfc173f1fec) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:44.042798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c89cf8d-5817-4936-a71b-48a0842f6a04 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 0.253172 Jul 14 10:04:44.042798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 785/1510] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:04:43 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 269 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:04:44.044543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] HTTP exception thrown: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Request method failure captured: Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 HTTP/1.1 Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-SDOa8td5k0-HQQqB8yz5Lp11SjU391gbVWFXwBzwdGGA7T9Y7Wlnx64YbjT0GS8sC8U7eSonmSeHqExgEJBJIB9m1LhBs2dWplc6QHSMnxEzJYDhauwJIpvilKABmOzTOhlmi_UDdXH7Z_S8Ge3aMcb4alQ-ksIrVdjlyHFXDzYP4 Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:44.046537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 27cfaef90a5048569453430e75c4c42b Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.048001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'a699dfcd-f703-4225-a432-860189583054'} Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:44.048737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.050022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.051817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Returning 404 to user: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:44.051817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b0e706fe-5a94-4310-be6c-bfe7ab5ec3f3 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 404 len: 111 microversion: 2.1 time: 0.041500 Jul 14 10:04:44.051817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 726/1511] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:04:44 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:44.052970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.054384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.057156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.057845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.064730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.065439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.066249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.066601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.066747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.067321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.068366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.068870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.105098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:04:44.154556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.compute.api [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Instance is already in deleting state, ignoring this request Jul 14 10:04:44.155388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-42d5e9d4-0027-417c-b624-75388bf85336 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 204 len: 0 microversion: 2.20 time: 0.105346 Jul 14 10:04:44.155961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 727/1512] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:04:44 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:04:44.160700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f79df203-2cf3-427a-8955-1597b81269c5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.161707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f79df203-2cf3-427a-8955-1597b81269c5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.167859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f79df203-2cf3-427a-8955-1597b81269c5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.168252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f79df203-2cf3-427a-8955-1597b81269c5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.169024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f79df203-2cf3-427a-8955-1597b81269c5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.169454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f79df203-2cf3-427a-8955-1597b81269c5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.202928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f79df203-2cf3-427a-8955-1597b81269c5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Jul 14 10:04:44.203487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 728/1513] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:04:44 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:04:44.208493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ae94a83c-feec-4a22-a3c0-a09b2dd314e6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '.version_select at 0x7f7da1ab6ca0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.222974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-ae94a83c-feec-4a22-a3c0-a09b2dd314e6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ae94a83c-feec-4a22-a3c0-a09b2dd314e6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394 HTTP/1.1 Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:44.251689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'tempest-keypair-362486394'} Jul 14 10:04:44.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 14 10:04:44.254987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 10:04:44.256447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.257896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.259260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ae94a83c-feec-4a22-a3c0-a09b2dd314e6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:44.259260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ae94a83c-feec-4a22-a3c0-a09b2dd314e6 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394" status: 404 len: 131 microversion: 2.1 time: 0.048845 Jul 14 10:04:44.259260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 729/1514] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 10:04:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394 => generated 131 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:44.259260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.259260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.266099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.266577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.267938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.268369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.282338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] HTTP exception thrown: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Request method failure captured: Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 HTTP/1.1 Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-SDOa8td5k0-HQQqB8yz5Lp11SjU391gbVWFXwBzwdGGA7T9Y7Wlnx64YbjT0GS8sC8U7eSonmSeHqExgEJBJIB9m1LhBs2dWplc6QHSMnxEzJYDhauwJIpvilKABmOzTOhlmi_UDdXH7Z_S8Ge3aMcb4alQ-ksIrVdjlyHFXDzYP4 Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:44.283996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 27cfaef90a5048569453430e75c4c42b Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.285568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'a699dfcd-f703-4225-a432-860189583054'} Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:44.286529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.288006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.289420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Returning 404 to user: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:44.289420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bcb73520-5c58-475f-b88b-156a8a3e6eaf tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 404 len: 111 microversion: 2.1 time: 0.030656 Jul 14 10:04:44.289420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 730/1515] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:04:44 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:44.290521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.291012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.297564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.298002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.298812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.299238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.330091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:04:44.333857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:44.380688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.compute.api [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Instance is already in deleting state, ignoring this request Jul 14 10:04:44.381417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-68db590c-afac-40f6-8579-2e918c39f60c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 204 len: 0 microversion: 2.20 time: 0.094590 Jul 14 10:04:44.382001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 731/1516] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:04:44 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:04:44.386692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4ea89ce2-3166-4f9c-9727-c6317d79be92 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.387602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4ea89ce2-3166-4f9c-9727-c6317d79be92 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.394071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ea89ce2-3166-4f9c-9727-c6317d79be92 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.395226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ea89ce2-3166-4f9c-9727-c6317d79be92 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.395355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ea89ce2-3166-4f9c-9727-c6317d79be92 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.395722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ea89ce2-3166-4f9c-9727-c6317d79be92 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.427172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4ea89ce2-3166-4f9c-9727-c6317d79be92 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Jul 14 10:04:44.427741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 732/1517] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:04:44 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:04:44.432132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48ddc428-12b6-411b-9ebf-6851c9503a7c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '.version_select at 0x7f7da1d27e50>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.442957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-48ddc428-12b6-411b-9ebf-6851c9503a7c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48ddc428-12b6-411b-9ebf-6851c9503a7c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394 HTTP/1.1 Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:44.444839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'tempest-keypair-362486394'} Jul 14 10:04:44.446436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 14 10:04:44.447286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 10:04:44.448868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.450338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.451562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48ddc428-12b6-411b-9ebf-6851c9503a7c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:44.451562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-48ddc428-12b6-411b-9ebf-6851c9503a7c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394" status: 404 len: 131 microversion: 2.1 time: 0.018120 Jul 14 10:04:44.451562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 733/1518] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 10:04:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394 => generated 131 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:44.453605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.454277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.461585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.462033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.462832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.463266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.476505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] HTTP exception thrown: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Request method failure captured: Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 HTTP/1.1 Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-SDOa8td5k0-HQQqB8yz5Lp11SjU391gbVWFXwBzwdGGA7T9Y7Wlnx64YbjT0GS8sC8U7eSonmSeHqExgEJBJIB9m1LhBs2dWplc6QHSMnxEzJYDhauwJIpvilKABmOzTOhlmi_UDdXH7Z_S8Ge3aMcb4alQ-ksIrVdjlyHFXDzYP4 Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:44.478039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 27cfaef90a5048569453430e75c4c42b Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.479906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'a699dfcd-f703-4225-a432-860189583054'} Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:44.480976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.482438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.483788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Returning 404 to user: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:44.483788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eb0e352c-698e-4174-941b-812094f1b9a4 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 404 len: 111 microversion: 2.1 time: 0.031008 Jul 14 10:04:44.483788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 734/1519] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:04:44 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:44.484483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.484967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.490980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.491425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.492191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.492617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.520154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:04:44.570923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.compute.api [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Instance is already in deleting state, ignoring this request Jul 14 10:04:44.571737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cd0c01b2-7a1d-43d6-8f1e-37c9ae13deb4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 204 len: 0 microversion: 2.20 time: 0.090860 Jul 14 10:04:44.572280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 735/1520] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:04:44 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:04:44.577415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-664a293f-c3ca-4d3f-a259-d58c557c671b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.578552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-664a293f-c3ca-4d3f-a259-d58c557c671b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.585308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-664a293f-c3ca-4d3f-a259-d58c557c671b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.585748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-664a293f-c3ca-4d3f-a259-d58c557c671b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.589167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-664a293f-c3ca-4d3f-a259-d58c557c671b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.589611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-664a293f-c3ca-4d3f-a259-d58c557c671b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.622013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-664a293f-c3ca-4d3f-a259-d58c557c671b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048483 Jul 14 10:04:44.622711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 736/1521] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:04:44 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:04:44.628038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb6dd2f6-72e7-4f22-ba73-05ab5a4de574 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '.version_select at 0x7f7da1ab95e0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.638855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-eb6dd2f6-72e7-4f22-ba73-05ab5a4de574 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb6dd2f6-72e7-4f22-ba73-05ab5a4de574 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394 HTTP/1.1 Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:44.640663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'tempest-keypair-362486394'} Jul 14 10:04:44.643474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 14 10:04:44.645037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 10:04:44.647368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a Jul 14 10:04:44.649444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.653371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb6dd2f6-72e7-4f22-ba73-05ab5a4de574 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Keypair tempest-keypair-362486394 not found for user f1d0b9390f474de79828a675d4e0646a {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:44.653371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eb6dd2f6-72e7-4f22-ba73-05ab5a4de574 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394" status: 404 len: 131 microversion: 2.1 time: 0.018358 Jul 14 10:04:44.653371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 737/1522] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 10:04:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-362486394 => generated 131 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:44.653371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.653371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] [instance: a699dfcd-f703-4225-a432-860189583054] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.657888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.658372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.659170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.659598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.674065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] HTTP exception thrown: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Request method failure captured: Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 HTTP/1.1 Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-SDOa8td5k0-HQQqB8yz5Lp11SjU391gbVWFXwBzwdGGA7T9Y7Wlnx64YbjT0GS8sC8U7eSonmSeHqExgEJBJIB9m1LhBs2dWplc6QHSMnxEzJYDhauwJIpvilKABmOzTOhlmi_UDdXH7Z_S8Ge3aMcb4alQ-ksIrVdjlyHFXDzYP4 Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:04:44.675635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_a28617ad1f8d40faa7d2e317b32951ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: a28617ad1f8d40faa7d2e317b32951ab Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestShelveInstance-1607221687 Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 27cfaef90a5048569453430e75c4c42b Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestShelveInstance-1607221687-project Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.677612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'a699dfcd-f703-4225-a432-860189583054'} Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:04:44.679186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. Jul 14 10:04:44.682092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:04:44.685021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Returning 404 to user: Instance a699dfcd-f703-4225-a432-860189583054 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:04:44.685021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-96db2881-203a-43be-87ca-20b9216d5b72 tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054" status: 404 len: 111 microversion: 2.1 time: 0.031461 Jul 14 10:04:44.685021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 738/1523] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:04:44 2022] GET /compute/v2.1/servers/a699dfcd-f703-4225-a432-860189583054 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:04:44.685021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:44.685021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:44.690047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.690515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.691465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:44.692291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:44.980168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:44.991015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:44.992552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:44.993719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3087a9f5-eacb-44ac-aae8-6e83a5c61184 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.315294 Jul 14 10:04:45.005926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 739/1524] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:04:45.093145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9cfbe65e-8487-4305-9030-7ada4edcefee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] Calling method '.version_select at 0x7f7da1ab23a0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:45.114386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9cfbe65e-8487-4305-9030-7ada4edcefee tempest-TestShelveInstance-1607221687 tempest-TestShelveInstance-1607221687-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-123116946" status: 202 len: 0 microversion: 2.1 time: 0.025162 Jul 14 10:04:45.115170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 740/1525] 10.222.0.40 () {58 vars in 1250 bytes} [Thu Jul 14 10:04:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-123116946 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:04:45.641483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-984fd946-60fa-40d9-98ce-dd8d1b458f36 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:04:45.643375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-984fd946-60fa-40d9-98ce-dd8d1b458f36 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:45.655870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-984fd946-60fa-40d9-98ce-dd8d1b458f36 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:45.656344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-984fd946-60fa-40d9-98ce-dd8d1b458f36 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:45.657177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-984fd946-60fa-40d9-98ce-dd8d1b458f36 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:45.658125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-984fd946-60fa-40d9-98ce-dd8d1b458f36 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:45.772952 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-984fd946-60fa-40d9-98ce-dd8d1b458f36 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/action" status: 200 len: 41190 microversion: 2.1 time: 0.139028 Jul 14 10:04:45.773604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 741/1526] 10.222.0.40 () {60 vars in 1277 bytes} [Thu Jul 14 10:04:45 2022] POST /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168/action => generated 41190 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:04:46.022021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:46.022767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:46.030252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:46.030704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:46.031485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:46.031913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:46.204839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:46.214083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:46.215718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:46.216964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-32e9881f-c306-4762-b8be-e72ef2579b46 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.199871 Jul 14 10:04:46.217621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 742/1527] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:04:47.236859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:47.238224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:47.247834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:47.248278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:47.249245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:47.249708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:47.429884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:47.439709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:47.441230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:47.442647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-26c31648-9838-4ced-bd81-d2bffcf87d18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.210380 Jul 14 10:04:47.443704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 743/1528] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:04:48.467387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:48.468073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:48.477811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:48.478551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:48.480362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:48.481357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:49.039533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:49.049133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:49.051021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:49.052021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-12bc4a88-58e4-4ff9-a7f7-47bb3862f134 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.589475 Jul 14 10:04:49.052591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 744/1529] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:04:50.081433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:50.082124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:50.089625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:50.090332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:50.091668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:50.091668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:50.316278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:50.328337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:50.329858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:50.331138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8d592343-b058-4ffc-ae7e-7795217cffe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.253773 Jul 14 10:04:50.332003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 745/1530] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:04:51.349219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:51.351470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:51.367688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:51.368425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:51.369516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:51.370119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:51.615995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:51.633439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:51.644867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:51.646329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3c37cfd0-6a7d-4dc2-83cb-ae6204634b63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.301083 Jul 14 10:04:51.647307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 746/1531] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:04:52.680002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:52.680669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:52.688742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:52.690624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:52.691981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:52.692691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:52.951308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:52.967253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:52.969132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:52.971126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4eeb129c-18b4-44f6-9f46-62a4c799be2c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.299438 Jul 14 10:04:52.971690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 747/1532] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:04:53.993460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:53.994677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:54.003172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:54.003749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:54.004658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:54.005182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:54.062347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=21 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:54.102956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:54.167153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:54.177345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:54.178895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:54.180120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-22dabcf3-c89a-48df-b44d-2305c34ecf47 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.191674 Jul 14 10:04:54.180695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 748/1533] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:04:55.203274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:55.204138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:55.214957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:55.215698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:55.217012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:55.217746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:55.370332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:55.379967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:55.381406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:55.383244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-362a6b96-19be-446d-9adb-b91ce867ec12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.186008 Jul 14 10:04:55.384049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 749/1534] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:04:56.403131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:56.403843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:56.410943 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:56.411388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:56.412151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:56.412610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:56.434003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:04:56.549619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:56.558983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:56.560508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:56.561658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d73dabe6-fa47-4631-b938-6d470474bddd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.162814 Jul 14 10:04:56.562231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 750/1535] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:04:57.580146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:57.580755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:57.587318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:57.587764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:57.588533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:57.588974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:57.727053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:57.735398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:57.737517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:57.738841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-af42b4dc-4a58-4a7e-bc1e-cbbe0fb6b216 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.162671 Jul 14 10:04:57.739437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 751/1536] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:04:58.763607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:58.764266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:58.771950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:58.772392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:58.773331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:58.773755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:58.924967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:58.934426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:58.936224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:04:58.937615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-240d11f9-65ff-4402-8e58-fd709c3f1f3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.183386 Jul 14 10:04:58.938204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 752/1537] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:04:59.957925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:04:59.958644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:04:59.964954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:59.965399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:04:59.966148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:04:59.966600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:00.094905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:00.103432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:00.104999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:00.106105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-93a76c29-37c2-4b61-9ba5-409bbf436021 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.153126 Jul 14 10:05:00.106722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 753/1538] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:04:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:01.125341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:01.126035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:01.132605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:01.133058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:01.133829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:01.134304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:01.273098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:01.281414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:01.282971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:01.284727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-17516fab-f059-47ea-8e51-a6bf02325c94 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.163338 Jul 14 10:05:01.285292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 754/1539] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:02.303835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:02.304540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:02.311066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:02.311508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:02.312299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:02.312726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:02.453870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:02.462303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:02.463803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:02.464959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4ab72fb0-65e1-458d-b641-7fe439fc9541 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.165094 Jul 14 10:05:02.465498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 755/1540] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:03.483968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:03.484606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:03.491651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:03.492093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:03.492837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:03.493262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:03.624405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:03.633277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:03.634814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:03.635951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6feb9727-b902-402c-8669-99c7211a8d8e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.155906 Jul 14 10:05:03.636510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 756/1541] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:04.654717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:04.655394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:04.661933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:04.662413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:04.663172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:04.663601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:04.792123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:04.801695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:04.803242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:04.804444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fb898122-5445-4f18-9d8d-63a8fb35ad6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.153710 Jul 14 10:05:04.805021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 757/1542] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:05.823255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:05.823868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:05.830887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:05.831328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:05.832084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:05.832514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:05.969115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:05.977824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:05.979388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:05.980853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-aabe1d97-72bf-4336-8915-a8b049bd24ab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.161284 Jul 14 10:05:05.981826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 758/1543] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:06.999594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:07.000252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:07.006857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:07.007401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:07.008059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:07.009931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:07.160929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:07.169291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:07.171103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:07.172239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2efbc8a5-bed0-4439-b649-0594b6677f18 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.176672 Jul 14 10:05:07.172803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 759/1544] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:08.191974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:08.192655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:08.199315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:08.199752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:08.200506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:08.200934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:08.332175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:08.340596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:08.342080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:08.343276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-16fc9dd3-5629-4553-abdf-a8e8c82d9df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.155319 Jul 14 10:05:08.343833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 760/1545] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:09.363043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:09.363741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:09.365926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:09.372292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:09.372754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:09.373522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:09.374130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:09.525911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:09.534917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:09.536464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:09.537628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-310bbd52-ed90-49d5-bbbc-7d881899f37e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.179206 Jul 14 10:05:09.538181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 761/1546] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:09 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:05:10.557257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:10.557962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:10.565024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:10.565615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:10.566856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:10.567571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:10.697940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:10.707196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:10.708702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:10.709902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3dc63ac0-3ce5-449d-829c-b6a621836bbd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.156682 Jul 14 10:05:10.710475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 762/1547] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:11.727567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:11.728223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:11.734572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:11.735008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:11.735809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:11.736234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:11.869136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:11.878055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:11.879588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:11.880747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-14ee617b-8607-45fe-957b-0f7e5985b5b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.157136 Jul 14 10:05:11.881302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 763/1548] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:12.898616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:12.899277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:12.905741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:12.906180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:12.906982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:12.908011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:13.036988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:13.045310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:13.047084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:13.048254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6ad6abc8-66a2-42c9-834b-c7e42192c625 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.153665 Jul 14 10:05:13.048803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 764/1549] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:14.065854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:14.066590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:14.073078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:14.073530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:14.074325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:14.074765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:14.206880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:14.215387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:14.216898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:14.218052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-55e69556-ca95-4047-935b-9c5975df0039 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.156160 Jul 14 10:05:14.218672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 765/1550] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:15.237069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:15.237776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:15.244341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:15.244778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:15.245542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:15.245967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:15.382256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:15.391347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:15.392860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:15.394020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-83ecdbe3-85bf-4421-a1a3-10a9f402f4c2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.161530 Jul 14 10:05:15.394609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 766/1551] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:16.412611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:16.413311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:16.419810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:16.420359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:16.421379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:16.421834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:16.426017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:16.557529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:16.566641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:16.568149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:16.569304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-12e5bef2-2667-40f8-9755-358e3c2dc6d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.160608 Jul 14 10:05:16.569872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 767/1552] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:17.587720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:17.588353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:17.595047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:17.595488 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:17.596248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:17.596672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:17.728763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:17.737855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:17.739475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:17.740661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-baf8690d-6b3f-449e-be73-a791801f1173 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.156869 Jul 14 10:05:17.741210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 768/1553] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:18.758696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:18.759401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:18.765721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:18.766158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:18.767022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:18.767448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:18.895719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:18.904330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:18.905840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:18.907538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ab58f068-6fc8-4366-b793-477180472f20 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.152206 Jul 14 10:05:18.908096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 769/1554] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:19.927566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:19.928498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:19.935060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:19.935505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:19.936274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:19.936707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:20.072499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:20.081015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:20.082535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:20.083667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1cdbcb50-45b1-49f4-a09f-d6139a005265 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.161181 Jul 14 10:05:20.084242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 770/1555] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:21.102099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:21.102841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:21.109426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:21.109864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:21.110642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:21.111066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:21.245630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:21.254599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:21.256090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:21.257221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-43a77444-6c72-4e83-8281-033bb253eeb0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.159076 Jul 14 10:05:21.257769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 771/1556] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:22.275773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:22.276418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:22.282852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:22.283879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:22.284649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:22.285082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:22.413148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:22.426576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:22.429448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:22.430908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-173c4ee5-4a03-40f7-aca1-53d8ac087892 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.159071 Jul 14 10:05:22.431647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 772/1557] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:23.450695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:23.451379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:23.458581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:23.459016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:23.459774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:23.460195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:23.611564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:23.620283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:23.621830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:23.623049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-adb3eaa7-a879-4cea-97c0-af670df03a1b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.176701 Jul 14 10:05:23.623608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 773/1558] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:24.641532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:24.642259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:24.649446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:24.649883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:24.650674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:24.651094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:24.793252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:24.802360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:24.803939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:24.805216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1b40ef3f-7b6a-41cb-b166-d5b4a7a31ca9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.167588 Jul 14 10:05:24.805771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 774/1559] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:25.824587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:25.825255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:25.831585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:25.832028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:25.832775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:25.833200 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:25.964489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:25.973000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:25.974511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:25.975662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f0d407e-0166-4770-9eb6-a08fe9c698dd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.155295 Jul 14 10:05:25.976221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 775/1560] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:26.994596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:26.995283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:27.001864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:27.002340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:27.003597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:27.004022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:27.135543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:27.144734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:27.146272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:27.147444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8c7e0187-b7bd-4d91-88c0-b16da1318ad3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.156801 Jul 14 10:05:27.148007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 776/1561] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:28.166125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:28.166832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:28.173506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:28.173928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:28.174708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:28.175639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:28.304464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:28.312740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:28.314250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:28.315385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b253c113-7ff7-40a0-aee2-5baa9156d375 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.153235 Jul 14 10:05:28.316581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 777/1562] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:29.333651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:29.334393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:29.340803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:29.341239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:29.341999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:29.342447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:29.478574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:29.493467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:29.495041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:29.496205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4d363ee9-3b73-40f4-bcb4-4f415a67d96f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.166495 Jul 14 10:05:29.496773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 778/1563] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:30.514332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:30.515273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:30.521653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:30.522095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:30.522872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:30.523351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:30.656978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:30.665875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:30.667420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:30.668566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bbf87ae8-140a-4335-b767-bc5bcdff4f64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.158395 Jul 14 10:05:30.669127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 779/1564] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:31.688040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:31.688712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:31.694920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:31.695308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:31.696057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:31.696517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:31.828968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:31.838007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:31.839531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:31.840696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-12aa6ffb-30db-4de6-aab7-74839793bf80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.156703 Jul 14 10:05:31.841246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 780/1565] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:32.859686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:32.860314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:32.867344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:32.867781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:32.868528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:32.868954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:32.994623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:33.003343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:33.004857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:33.006005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-07819da1-e356-4190-8172-7875830dd415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.150373 Jul 14 10:05:33.006592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 781/1566] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:34.024373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:34.025093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:34.031717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:34.032158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:34.032954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:34.033387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:34.169110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:34.178498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:34.179993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:34.181148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f1e08e71-e24d-40e3-a265-0a5a59bf544c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.160768 Jul 14 10:05:34.181706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 782/1567] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:35.200472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:35.201179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:35.208496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:35.208934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:35.209770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:35.210243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:35.351621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:35.355054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:35.360462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:35.362076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:35.363249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dc85c784-ff60-400b-8c4a-ba9d9ca2bab9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.166905 Jul 14 10:05:35.363799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 783/1568] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:36.381801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:36.382538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:36.389388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:36.389829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:36.390617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:36.391048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:36.532746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:36.543016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:36.544532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:36.546026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-efd8e4fc-c399-475c-85be-1ad22f6e9aba tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.168146 Jul 14 10:05:36.546630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 784/1569] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:37.564664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:37.565269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:37.571879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:37.572317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:37.573064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:37.573491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:37.714029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:37.723006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:37.724557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:37.725700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a29562ba-65b5-4883-a3b1-55fcd20e3af3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.164942 Jul 14 10:05:37.726274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 785/1570] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:38.744370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:38.745027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:38.751336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:38.751772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:38.752522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:38.752946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:38.889324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:38.898046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:38.899577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:38.900735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fabee397-749e-40f9-90cf-8eb62e52bd6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.160341 Jul 14 10:05:38.901294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 786/1571] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:39.919581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:39.920719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:39.923657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=52 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:05:39.930509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:39.930951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:39.931725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:39.932159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:40.074074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:40.082693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:40.084280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:40.085371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d557785e-13af-41d7-a266-a8a93994cbb1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.170448 Jul 14 10:05:40.085931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 787/1572] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:41.104632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:41.105410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:41.112886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:41.113222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:41.113834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:41.114307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:41.247728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:41.257228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:41.258772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:41.259935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-39b55841-194a-4f37-9612-bd28632fd29d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.159411 Jul 14 10:05:41.260498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 788/1573] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:42.279104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:42.279805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:42.287982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:42.288419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:42.289188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:42.289619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:42.424236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:42.433432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:42.435013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:42.436209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9c5124b5-dbfc-4256-bc13-c841291278cb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.161054 Jul 14 10:05:42.436783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 789/1574] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:43.455456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:43.456057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:43.462732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:43.463169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:43.463945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:43.464372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:43.603053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:43.612621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:43.614850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:43.616018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3c46aa1a-4af7-4110-a3d9-573be84195e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.164455 Jul 14 10:05:43.616665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 790/1575] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:44.634976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:44.635651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:44.642436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:44.642879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:44.643660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:44.644090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:44.780416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:44.789413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:44.790948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:44.792101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-540a755a-0c03-4d55-bdb0-604bf7061234 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.161048 Jul 14 10:05:44.792664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 791/1576] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:45.813009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:45.813680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:45.821037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:45.821474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:45.822264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:45.822687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:45.962822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:45.971307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:45.972823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:45.973977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2d4cc586-12aa-4bae-8060-b3027027506c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.165584 Jul 14 10:05:45.974573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 792/1577] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:46.992876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:46.993576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:47.000137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:47.000580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:47.001367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:47.001789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:47.148981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:47.157480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:47.159010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:47.160171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6f89ac84-84f3-477a-a5c7-b7ed84923ce2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.171252 Jul 14 10:05:47.160722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 793/1578] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:48.178568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:48.179292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:48.188562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:48.189137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:48.189922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:48.190385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:48.330919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:48.340281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:48.341779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:48.342971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d33e5a4b-bc92-4fc8-a0f1-d6f3b5a00260 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.168403 Jul 14 10:05:48.343543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 794/1579] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:49.361301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:49.362020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:49.369354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:49.369805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:49.370628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:49.371054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:49.513796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:49.523519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:49.525282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:49.526459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2ff80c97-97d5-4120-8411-b2880eb67793 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.169238 Jul 14 10:05:49.527034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 795/1580] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:49.852336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'services' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:05:50.545385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:50.545988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:50.552914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:50.553475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:50.554436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:50.555236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:50.629421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcf47b2e-de3f-4ff8-a56a-518333a4db5a) Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 HTTP/1.1 Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:05:50.631647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:05:50.633391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcf47b2e-de3f-4ff8-a56a-518333a4db5a) Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'server_id': '9e62e62e-be29-409c-a568-7269db0dba2d', 'id': 'ecf82858-1f8b-4a2f-ace7-782f73848dc8'} Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:05:50.634392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcf47b2e-de3f-4ff8-a56a-518333a4db5a) Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:05:50.635788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcf47b2e-de3f-4ff8-a56a-518333a4db5a) Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:05:50.637251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcf47b2e-de3f-4ff8-a56a-518333a4db5a) Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:05:50.638356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcf47b2e-de3f-4ff8-a56a-518333a4db5a) Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcf47b2e-de3f-4ff8-a56a-518333a4db5a) Jul 14 10:05:50.639730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:05:50.641708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fcf47b2e-de3f-4ff8-a56a-518333a4db5a) {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:05:50.641708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7612b336-e29b-4b6a-b141-003cb838658c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8" status: 400 len: 269 microversion: 2.1 time: 66.591942 Jul 14 10:05:50.641708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 786/1581] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:04:44 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d/os-volume_attachments/ecf82858-1f8b-4a2f-ace7-782f73848dc8 => generated 269 bytes in 66593 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:05:50.709221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:50.717763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:50.719304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:50.720469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f1bdf6cd-5502-4ced-94b4-0aa64c27f8c7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1800 microversion: 2.20 time: 0.179277 Jul 14 10:05:50.721024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 796/1582] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:05:51.743264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:51.743971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:51.751579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:51.752032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:51.752813 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:51.753245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:51.825779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:51.834952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:51.836487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:51.837670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8b865953-9728-4327-994d-e1bd50edf28e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1733 microversion: 2.20 time: 0.101763 Jul 14 10:05:51.838469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 787/1583] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1733 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:05:52.413186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-918eb7a1-cf5d-4cd3-95b2-3b6e848eb02a req-8ae5353b-a1fb-45f4-ac1c-74fb382bf046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00a0737-b755-4d07-a5a1-8b691911836f", "name": "network-vif-deleted", "tag": "1975270c-eaaa-4443-9916-238cad412d51"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:05:52.421702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-918eb7a1-cf5d-4cd3-95b2-3b6e848eb02a req-8ae5353b-a1fb-45f4-ac1c-74fb382bf046 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:52.422171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-918eb7a1-cf5d-4cd3-95b2-3b6e848eb02a req-8ae5353b-a1fb-45f4-ac1c-74fb382bf046 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:52.433308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-918eb7a1-cf5d-4cd3-95b2-3b6e848eb02a req-8ae5353b-a1fb-45f4-ac1c-74fb382bf046 service nova] Creating event network-vif-deleted:1975270c-eaaa-4443-9916-238cad412d51 for instance a00a0737-b755-4d07-a5a1-8b691911836f on hv-cinder-82549 Jul 14 10:05:52.438437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-918eb7a1-cf5d-4cd3-95b2-3b6e848eb02a req-8ae5353b-a1fb-45f4-ac1c-74fb382bf046 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098740 Jul 14 10:05:52.439141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 797/1584] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:05:52.856718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:52.857386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:52.864612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:52.866819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:52.866819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:52.866819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:52.937276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:52.947096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:52.948538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:52.949702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-276a7c03-8fbf-44df-91d6-305e856789c1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.096943 Jul 14 10:05:52.950293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 788/1585] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:05:53.969494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:53.970198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:53.976656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:53.977169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:53.977903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:53.978364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:54.040186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:54.049405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:54.053354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:54.055384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-39480438-e00b-4dc2-8ce3-06a2730db0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090418 Jul 14 10:05:54.056031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 798/1586] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:05:55.076090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:55.076646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:55.084194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:55.084644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:55.085423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:55.085863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:55.155030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:55.170153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:55.173072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:55.175211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6969371f-b39c-4195-8e68-df717dc82205 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.104614 Jul 14 10:05:55.176207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 789/1587] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:05:56.200041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:56.200686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:56.208447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:56.208892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:56.209885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:56.210350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:56.284422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:56.293913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:56.296068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:56.297231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-383aee33-ead3-478b-90ee-6e13915d99ef tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.101183 Jul 14 10:05:56.297815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 799/1588] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:05:57.315299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:57.316352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:57.323662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:57.324185 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:57.325073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:57.325534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:57.398086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:57.411627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:57.413128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:57.414315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1caacfae-a451-479c-8626-2ce6263e6083 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.103007 Jul 14 10:05:57.414865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 790/1589] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:05:58.435241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:58.435865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:58.442304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:58.442746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:58.443490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:58.443933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:58.507529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:58.515826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:58.517313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:58.518452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d7467cbb-796d-4ce9-a603-967fefa6d847 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087054 Jul 14 10:05:58.519001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 800/1590] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:05:59.537337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:59.537951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:05:59.544676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:59.545122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:59.545911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:59.546386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:59.608575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:59.616979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:59.618519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:05:59.619654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2fe11c6b-769c-4bb7-8073-1bfeb0eb8bd9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086824 Jul 14 10:05:59.620204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 791/1591] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:05:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:00.638022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:00.638626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:00.645770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:00.645770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:00.646470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:00.646891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:00.651158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:00.711754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:00.720176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:00.721655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:00.723325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-474ad76c-9548-461f-8a49-f2aff20c7d6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089245 Jul 14 10:06:00.723867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 801/1592] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:01.740996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:01.741543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:01.748168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:01.748612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:01.749364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:01.749799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:01.811538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:01.820083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:01.821586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:01.822753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d8c6a00c-22a8-4f4c-a33e-432d57d61628 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085751 Jul 14 10:06:01.823312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 792/1593] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:02.842731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:02.843318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:02.852135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:02.852574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:02.853878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:02.853878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:02.923283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:02.932715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:02.934208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:02.935358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-99553032-7529-4af2-916a-d63d021a30be tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.097735 Jul 14 10:06:02.935906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 802/1594] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:03.953079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:03.953692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:03.960218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:03.960896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:03.961428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:03.961869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:04.022235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:04.030544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:04.032048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:04.033178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5cab5922-af45-4d73-bcec-cdf4c7a99e79 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084116 Jul 14 10:06:04.033729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 793/1595] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:05.051313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:05.051914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:05.058395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:05.058835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:05.059585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:05.060016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:05.122596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:05.131691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:05.133306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:05.134472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-89254443-88e3-45e2-aff9-654a3f600bfc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087048 Jul 14 10:06:05.135029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 803/1596] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:06.153358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:06.153954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:06.161130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:06.161570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:06.162369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:06.162803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:06.225977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:06.234482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:06.235977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:06.237098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-49bd1422-db24-4bcc-adb9-6ac98d41693b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087691 Jul 14 10:06:06.237645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 794/1597] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:07.255456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:07.256037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:07.262572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:07.263013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:07.263769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:07.264200 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:07.325602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:07.334601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:07.336093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:07.337218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0586de6b-0bd1-4414-a741-a23b329be0ce tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086221 Jul 14 10:06:07.337769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 804/1598] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:08.355155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:08.355749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:08.363011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:08.363462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:08.364226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:08.364664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:08.426078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:08.434806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:08.436321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:08.437467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-539db56c-4ab3-4a0d-8287-ab7039e240e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086241 Jul 14 10:06:08.438023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 795/1599] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:09.455801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:09.457368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:09.463462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:09.463782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:09.464567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:09.464992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:09.534484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:09.544376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:09.545882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:09.547060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-82cb9584-0425-401f-86df-298c41206025 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.095353 Jul 14 10:06:09.547626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 805/1600] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:09 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:10.565180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:10.565782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:10.573922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:10.574402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:10.575170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:10.575602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:10.647851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:10.661914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:10.664633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:10.666696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-98166411-e617-465d-aece-c6694a2d5a80 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.105329 Jul 14 10:06:10.667590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 796/1601] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:11.693333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:11.693955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:11.696684 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=38 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:11.707482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:11.707482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:11.707482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:11.707482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:11.782508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:11.793758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:11.795654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:11.796833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bf5ee27a-36a2-4dea-9aa4-50e5efe14a3a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.108025 Jul 14 10:06:11.797602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 806/1602] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:12.817210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:12.818062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:12.824874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:12.825325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:12.826108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:12.826572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:12.896099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:12.905134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:12.906677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:12.907870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-987252af-2735-40c0-b3b5-418ac4edb203 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.095322 Jul 14 10:06:12.908845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 797/1603] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:13.926385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:13.926992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:13.933827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:13.934301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:13.935077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:13.935512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:14.010530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:14.020507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:14.022066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:14.023280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-23dd7ded-819d-47bf-bd65-8abe34164182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.100942 Jul 14 10:06:14.023853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 807/1604] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:15.044911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:15.045681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:15.047889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=23 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:15.054254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:15.054706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:15.055486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:15.055925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:15.058884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=71 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:15.130054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:15.139533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:15.141072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:15.142282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-baa3034b-f701-4cd4-a9a4-d756307b198b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.101602 Jul 14 10:06:15.142853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 798/1605] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:16.161151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:16.161743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:16.169682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:16.170128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:16.170931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:16.171356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:16.239496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:16.248513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:16.250008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:16.251180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-97bf9097-5cee-4655-b841-3a4f78475e64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.093995 Jul 14 10:06:16.251742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 808/1606] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:17.270963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:17.271738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:17.278887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:17.279376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:17.280260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:17.280742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:17.346597 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:17.355641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:17.357177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:17.358383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8aa72507-d386-4d94-8ab8-867dcf930d68 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092096 Jul 14 10:06:17.358953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 799/1607] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:18.378531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:18.379164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:18.389895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:18.390653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:18.391902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:18.392698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:18.468902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:18.479553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:18.481060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:18.482236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6b5b88f0-3864-49d4-a20f-5afc57f06e6b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.108448 Jul 14 10:06:18.482802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 809/1608] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:06:19.504033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:19.504812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:19.511324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:19.511778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:19.512555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:19.512996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:19.869579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:19.882519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:19.884235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:19.885410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0c1f6709-f58e-447e-b81e-5b415fc1167c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.385878 Jul 14 10:06:19.886165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 800/1609] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:20.905562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:20.906112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:20.913128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:20.913566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:20.914365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:20.914790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:20.979619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:20.990964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:20.992487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:20.993664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-800ccea4-f9c2-470e-97d8-5fec74feed11 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092170 Jul 14 10:06:20.994257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 810/1610] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:22.012847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:22.013562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:22.021071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:22.021526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:22.022511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:22.022886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:22.093362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:22.104766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:22.106308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:22.107458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cdc43a97-cac3-41a0-8959-2e6300be5a0b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.098825 Jul 14 10:06:22.108022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 801/1611] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:23.128178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:23.128767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:23.135289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:23.135729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:23.136478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:23.136932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:23.201795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:23.211437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:23.213247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:23.214502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fc67eb71-e251-4883-a6ad-170a8d47536b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090619 Jul 14 10:06:23.215106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 811/1612] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:24.234325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:24.234988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:24.241701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:24.242138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:24.242942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:24.243376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:24.308806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:24.317418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:24.318945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:24.320087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3c92d8b0-f66d-4635-bcd7-4d10c104e17b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089759 Jul 14 10:06:24.320641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 802/1613] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:25.338496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:25.339092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:25.346264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:25.346748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:25.347540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:25.348007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:25.409337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:25.417662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:25.419427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:25.420542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2ed36957-36fb-45c3-9a0a-eed9127e0fa5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086023 Jul 14 10:06:25.421085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 812/1614] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:26.439186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:26.440418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:26.447040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:26.447489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:26.448280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:26.448715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:26.509190 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:26.519133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:26.520630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:26.521763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5e93d237-ef5c-4623-a20f-c1c7baa6bc7e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086490 Jul 14 10:06:26.522458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 803/1615] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:27.539843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:27.540434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:27.547132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:27.547569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:27.548317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:27.548749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:27.610523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:27.619078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:27.620589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:27.621703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-759f1b30-74ae-4bef-a88b-6894de160759 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085906 Jul 14 10:06:27.622273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 813/1616] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:28.250609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:06:28.250856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:06:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:06:28.528215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:06:28.528739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:06:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:06:28.640322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:28.640934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:28.648186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:28.648636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:28.649436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:28.649875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:28.713188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:28.721681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:28.723227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:28.724382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-30f23d0e-7843-4842-9d73-0df0eb48c396 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088012 Jul 14 10:06:28.724937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 804/1617] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:29.743144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:29.743691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:29.750043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:29.750508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:29.751258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:29.751681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:29.977754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:29.986077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:29.988159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:29.989273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a3e5baad-1d8f-4dd2-a186-f72ff9c737e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.250257 Jul 14 10:06:29.989818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 814/1618] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:31.007938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:31.008543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:31.014990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:31.015434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:31.016179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:31.016609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:31.077606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:31.085926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:31.087521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:31.088645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ec52c27c-8b5d-451e-bfc7-0c4454bf0057 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084631 Jul 14 10:06:31.089191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 805/1619] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:32.106687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:32.107307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:32.113427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:32.113865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:32.114642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:32.115079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:32.117639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=83 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:32.176372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:32.184611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:32.186112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:32.187270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e5c774b3-f33c-4761-b88b-6f1c1fc92b87 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084474 Jul 14 10:06:32.187812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 815/1620] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:33.206069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:33.206692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:33.213622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:33.214127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:33.215079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:33.215512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:33.279993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:33.289140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:33.290755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:33.291874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2108826d-4026-4294-a744-1c3802a18550 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090688 Jul 14 10:06:33.292419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 806/1621] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:34.310333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:34.310968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:34.317519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:34.317963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:34.318912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:34.319361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:34.380230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:34.388654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:34.390147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:34.391299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9c555393-a875-4024-8227-fe31e917e443 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084914 Jul 14 10:06:34.391835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 816/1622] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:35.409079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:35.409612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:35.416578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:35.417035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:35.417833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:35.418297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:35.486122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:35.495377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:35.496892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:35.498041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-284ddf7a-7a92-4a62-8acb-834be4be16cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092990 Jul 14 10:06:35.498645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 807/1623] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:36.517109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:36.518484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:36.525251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:36.525699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:36.526505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:36.526941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:36.590833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:36.600499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:36.602001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:36.603198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-edf792af-4c42-482e-be99-af7e12c1717c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090039 Jul 14 10:06:36.604260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 817/1624] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:37.622238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:37.622897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:37.629433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:37.629907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:37.630690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:37.631252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:37.695422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:37.703827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:37.705333 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:37.706510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-aee233a2-3df8-455d-b991-c24216c43509 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088239 Jul 14 10:06:37.707099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 808/1625] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:38.724928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:38.725474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:38.731942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:38.732382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:38.733134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:38.733563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:38.793758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:38.802372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:38.803829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:38.805078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-66d5e31c-ff1d-4413-bbff-9e8d4740d88b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084764 Jul 14 10:06:38.805622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 818/1626] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:39.823746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:39.824306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:39.830670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:39.831111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:39.831861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:39.832290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:39.893968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:39.902396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:39.903888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:39.905009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-086ed940-9bf2-4282-a895-664d0f1e1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085239 Jul 14 10:06:39.905555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 809/1627] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:40.924922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:40.925437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:40.931862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:40.932297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:40.933048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:40.933474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:40.993887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:41.002825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:41.004346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:41.005481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cfc511ce-4665-4fe7-8e7c-c7ee2e01a3df tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085037 Jul 14 10:06:41.006039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 819/1628] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:42.024682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:42.025284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:42.031290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:42.031732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:42.032487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:42.032968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:42.095445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:42.104014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:42.105552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:42.106721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-51a60f1e-f299-4338-abf7-38c45486ba01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086215 Jul 14 10:06:42.107290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 810/1629] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:43.124815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:43.125448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:43.127799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=28 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:43.133183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:43.133632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:43.134419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:43.134850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:43.197861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:43.206972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:43.208471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:43.209596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-aefadf87-cb9e-4c34-8ec1-bd7d7e9be7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088783 Jul 14 10:06:43.210144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 820/1630] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:44.227443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:44.228061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:44.234601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:44.235044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:44.235810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:44.236905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:44.299608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:44.308095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:44.309699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:44.310774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-20cb60c3-c7ff-4484-bd4d-5a8925bd4327 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087338 Jul 14 10:06:44.311648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 811/1631] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:45.328776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:45.329384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:45.336810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:45.337245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:45.338014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:45.338475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:45.405576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:45.416159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:45.419175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:45.421200 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-191dacf4-6bd8-4c79-9c12-e713850e353e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.096102 Jul 14 10:06:45.422119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 821/1632] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:46.441031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:46.441623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:46.444155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=28 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:46.450029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:46.450504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:46.451282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:46.451717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:46.454786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=84 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:46.520421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:46.529181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:46.530724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:46.531896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-78dce28a-cd29-4c36-a5ea-233977f6a5f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.095648 Jul 14 10:06:46.532462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 812/1633] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:47.552233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:47.553230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:47.560567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:47.561670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:47.561862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:47.562168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:47.629190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:47.640027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:47.641563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:47.643253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-01fbafaa-a399-4ec4-989b-e17ba71a14f1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.096806 Jul 14 10:06:47.643813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 822/1634] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:48.661412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:48.662035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:48.669137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:48.669572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:48.670369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:48.670799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:48.760753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:48.769323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:48.770948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:48.772105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-096ce553-536d-4565-95c2-98937bdc30e3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.115222 Jul 14 10:06:48.772668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 813/1635] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:49.795266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:49.795826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:49.802850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:49.803337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:49.804074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:49.804532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:49.872087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:49.881299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:49.882888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:49.884098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-320c979d-cf37-4b41-ae4d-2a1757260742 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.093158 Jul 14 10:06:49.884650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 823/1636] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:50.902932 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:50.903485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:50.910223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:50.910671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:50.911437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:50.911873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:50.983535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:50.990228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:50.991740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:50.992899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-819754e0-2473-48f2-999d-d75da1297783 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.094000 Jul 14 10:06:50.993469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 814/1637] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:52.013429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:52.014078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:52.025612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:52.026061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:52.026892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:52.027328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:52.108227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:52.117211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:52.118748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:52.119905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-60c5b9aa-535b-4808-b383-f83c1918c34a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.111245 Jul 14 10:06:52.120460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 824/1638] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:53.138564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:53.139178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:53.146292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:53.146748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:53.147509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:53.147940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:53.212711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:53.223646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:53.225170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:53.226381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-207c05c4-241a-4e03-ae52-d212e252a72a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091740 Jul 14 10:06:53.226944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 815/1639] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:54.244903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:54.245518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:54.252805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:54.253250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:54.254017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:54.254472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:54.317718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:54.326812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:54.328324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:54.329530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a026014e-e89b-4368-aa03-4281e6e6b7e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088515 Jul 14 10:06:54.330079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 825/1640] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:55.347972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:55.348580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:55.356276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:55.356730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:55.357515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:55.357955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:55.428216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:55.437394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:55.439525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:55.440741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d5299333-2ae1-4ef8-a8fd-6fcb0ee9deaf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.097175 Jul 14 10:06:55.441515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 816/1641] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:56.459482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:56.460090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:56.466799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:56.467186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:56.467956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:56.468383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:56.534038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:56.542562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:56.544322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:56.545444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dfdfe0fd-2d43-4bea-b5f1-9ef23bec08e1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089924 Jul 14 10:06:56.545984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 826/1642] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:57.563603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:57.564321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:57.571219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:57.571701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:57.572466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:57.572902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:57.637602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:57.648589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:57.650085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:57.651260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-91f50ae3-2580-40c5-83d2-de20426800d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091639 Jul 14 10:06:57.651833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 817/1643] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:58.670320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:58.670903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:58.678230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:58.678670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:58.679568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:58.680767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:58.744268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:58.753397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:58.754958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:58.756094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-efcd628b-5ea7-4796-a126-dbd1b37e8fa8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090198 Jul 14 10:06:58.756642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 827/1644] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:59.775310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:59.775894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:06:59.782475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:59.782923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:59.783682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:06:59.784116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:06:59.850729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:59.860771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:59.862322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:06:59.864278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-36cc2aa4-e93e-4950-b30f-a560c8eed7b8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092948 Jul 14 10:06:59.864838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 818/1645] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:06:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:00.885718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:00.886409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:00.892978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:00.893430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:00.894211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:00.894662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:00.959140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:00.967684 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:00.969335 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:00.970525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-be03eab3-7393-4347-b31e-84c418f70652 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089212 Jul 14 10:07:00.971095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 828/1646] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:01.989396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:01.990005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:01.996806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:01.997253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:01.998017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:01.998485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:02.059929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:02.068323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:02.069817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:02.070986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e7904725-0e95-4581-8a35-1667961268aa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086077 Jul 14 10:07:02.071533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 819/1647] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:03.089172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:03.089798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:03.096126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:03.096564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:03.097319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:03.097744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:03.100443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=84 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:03.162251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:03.170953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:03.172448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:03.174132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3237f100-47a9-446d-bdbd-83967cdbeda1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088606 Jul 14 10:07:03.174719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 829/1648] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:04.192803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:04.193400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:04.199915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:04.200370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:04.201132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:04.201569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:04.268617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:04.278511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:04.280227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:04.281596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-df275115-a43d-4b8f-9328-ca06a9059b7f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092787 Jul 14 10:07:04.282333 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 820/1649] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:05.300921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:05.301525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:05.308148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:05.308598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:05.309362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:05.309794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:05.371756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:05.380653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:05.382153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:05.383425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cbb67c5a-a156-459d-b0d2-1688dd6ec3e2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086409 Jul 14 10:07:05.383926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 830/1650] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:06.402653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:06.403239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:06.409726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:06.410165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:06.410963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:06.411548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:06.475636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:06.484127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:06.485618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:06.487358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ddaf25d5-368b-4ebf-92be-ae551d2260f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087987 Jul 14 10:07:06.487964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 821/1651] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:07.505200 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:07.505912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:07.512353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:07.512798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:07.513556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:07.513988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:07.577044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:07.586849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:07.588394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:07.589555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e3b3c5ee-fc40-4d81-b22d-f13e385e0eee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088351 Jul 14 10:07:07.590113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 831/1652] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:08.608251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:08.608862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:08.615856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:08.616305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:08.617109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:08.617540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:08.685822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:08.695115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:08.696609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:08.697748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8ddbf97b-7e36-43a1-b184-d2a78876437e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.093447 Jul 14 10:07:08.698336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 822/1653] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:09.716480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:09.717126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:09.726004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:09.726768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:09.728038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:09.728751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:09.804194 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:09.812574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:09.814060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:09.815835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9d770b15-9656-45d6-a245-042b11b3ea01 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.103334 Jul 14 10:07:09.816372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 832/1654] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:09 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:10.834155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:10.834781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:10.841171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:10.841676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:10.842516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:10.842950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:10.909154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:10.917674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:10.919479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:10.920628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3fc652b9-0ba9-42c4-aaba-8b3e977d68a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090870 Jul 14 10:07:10.921182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 823/1655] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:11.939450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:11.940113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:11.947112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:11.947552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:11.948386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:11.948816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:12.015951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:12.025283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:12.026807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:12.028126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0241937f-83b4-4fcc-a572-55c09937c916 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092520 Jul 14 10:07:12.028689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 833/1656] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:13.047243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:13.047850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:13.054692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:13.055157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:13.055928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:13.056378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:13.124843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:13.134555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:13.136096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:13.137252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5c16ea89-d9ec-4383-8f12-a8bfe82eaf89 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.094408 Jul 14 10:07:13.137814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 824/1657] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:14.156414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:14.157010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:14.159884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=28 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:14.165212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:14.165645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:14.166422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:14.166848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:14.228211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:14.237122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:14.238694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:14.239813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8fccd273-56b0-4da7-8ca7-197bc39414db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087386 Jul 14 10:07:14.240362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 834/1658] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:07:15.258366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:15.258958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:15.265471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:15.265919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:15.266701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:15.267137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:15.327695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:15.336684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:15.338199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:15.339330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4fef7ee2-c8b1-4af0-98e3-04bae929fb63 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084919 Jul 14 10:07:15.339888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 825/1659] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:16.357522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:16.358109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:16.365550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:16.365992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:16.366823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:16.367257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:16.429381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:16.437890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:16.439461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:16.441169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-21b87539-ec92-492c-a368-8490f6aaec9d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087679 Jul 14 10:07:16.441716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 835/1660] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:17.459708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:17.460353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:17.462686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=28 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:17.467978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:17.468422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:17.469180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:17.469614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:17.474143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=84 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:17.537647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:17.546412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:17.549444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:17.550615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9c83b6cf-ed65-484c-b325-6e36551c8af0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.095401 Jul 14 10:07:17.551176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 826/1661] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:18.568572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:18.569175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:18.575664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:18.576112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:18.576868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:18.577300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:18.644668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:18.653278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:18.654797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:18.655928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-21344f55-159e-40d5-a01c-208419fe8b15 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091303 Jul 14 10:07:18.656480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 836/1662] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:19.675882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:19.676489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:19.683129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:19.683577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:19.684340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:19.684781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:19.745286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:19.754021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:19.755542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:19.756668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-845bbce7-8585-46ff-b08f-5b5a0f5f5f0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085423 Jul 14 10:07:19.757216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 827/1663] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:20.773621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:20.774249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:20.780819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:20.781263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:20.782020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:20.782482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:20.844337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:20.853487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:20.855227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:20.856639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-728fa32d-4898-44d4-836e-41421cf0320f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086827 Jul 14 10:07:20.857241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 837/1664] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:21.874791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:21.875344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:21.882330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:21.882782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:21.883547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:21.883983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:21.950539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:21.959200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:21.960696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:21.961825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-efb9c738-847c-499a-ada6-733709ca546a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091049 Jul 14 10:07:21.962405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 828/1665] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:22.982498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:22.983091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:22.990560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:22.991003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:22.991765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:22.992192 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:23.053133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:23.061370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:23.062903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:23.064028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-183d9619-6c56-4a9a-aeb1-822652024673 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086651 Jul 14 10:07:23.065283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 838/1666] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:24.081983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:24.082637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:24.089106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:24.089532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:24.090316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:24.090754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:24.152559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:24.161522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:24.163052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:24.164182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cc491ac7-6c1f-4df6-8507-6fe5e5ae3639 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086169 Jul 14 10:07:24.164736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 829/1667] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:25.183080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:25.183689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:25.190729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:25.191180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:25.191938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:25.192369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:25.256120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:25.264451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:25.265960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:25.267120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6bd11f57-3574-4b53-a51a-e3e111f1779c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087963 Jul 14 10:07:25.267731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 839/1668] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:26.288738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:26.289343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:26.296548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:26.296998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:26.297770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:26.300440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:26.365349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:26.374025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:26.375557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:26.377242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0c11911c-2041-48a9-b8c1-d64077f341ed tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.094712 Jul 14 10:07:26.377791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 830/1669] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:27.394799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:27.395382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:27.401837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:27.402309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:27.403060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:27.403486 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:27.463838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:27.472765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:27.474283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:27.475408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2812638f-4862-458a-b1fa-4f0902ca1670 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084517 Jul 14 10:07:27.475955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 840/1670] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:28.493539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:28.494144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:28.500507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:28.500939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:28.502358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:28.502790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:28.565765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:28.574672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:28.576157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:28.577278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cb39a94f-7d11-4e8f-b5e5-991ca6ecb8db tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087882 Jul 14 10:07:28.577825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 831/1671] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:29.595443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:29.596047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:29.602620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:29.603101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:29.603865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:29.604300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:29.665083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:29.673708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:29.675257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:29.676411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-13ad045d-1ad4-49c0-897a-08c1dfe7859b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084917 Jul 14 10:07:29.676962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 841/1672] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:30.694251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:30.694850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:30.701310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:30.701753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:30.702546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:30.702976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:30.766554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:30.775406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:30.776897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:30.778013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6778ec91-2145-4bd5-ac24-fa8b28fd44b7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087678 Jul 14 10:07:30.778588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 832/1673] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:31.796623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:31.797172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:31.803970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:31.804408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:31.805165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:31.805597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:31.866444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:31.874811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:31.876314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:31.877592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7b1442f8-8629-4cb1-8924-a4e44a58b8cd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085367 Jul 14 10:07:31.878137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 842/1674] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:32.895277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:32.895819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:32.902233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:32.902679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:32.903432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:32.903859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:32.965087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:32.973540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:32.975079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:32.976201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-21fcef6e-8e99-4c6f-b493-83107b9b36a1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084924 Jul 14 10:07:32.976750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 833/1675] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:33.994747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:33.995357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:34.002324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:34.002773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:34.003554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:34.004121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:34.006932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=84 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:34.067475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:34.076574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:34.078056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:34.079208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1b770a71-790c-4511-af4f-1f4e5cb4b275 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088428 Jul 14 10:07:34.080397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 843/1676] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:35.098177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:35.098811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:35.105365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:35.106017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:35.106589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:35.107020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:35.172468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:35.181357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:35.182913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:35.184053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0848b2c3-f537-49b1-8ebc-85aa1527685c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090044 Jul 14 10:07:35.184601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 834/1677] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:36.202807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:36.203400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:36.210409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:36.210848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:36.211597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:36.212023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:36.272464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:36.280622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:36.282110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:36.285786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7dd384e0-c40f-4bf6-9240-5b3e4c7ad8c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086943 Jul 14 10:07:36.286377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 844/1678] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:37.303677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:37.304272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:37.310744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:37.311191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:37.311951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:37.312384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:37.372194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:37.380441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:37.381944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:37.383094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1faf833a-bf9f-4197-bdf3-97e445f62640 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.083352 Jul 14 10:07:37.383655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 835/1679] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:38.402115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:38.402778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:38.409827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:38.410297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:38.411057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:38.411484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:38.473605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:38.481984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:38.483507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:38.484639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-82c57735-97ea-49c1-8c02-0df7fe6591b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086461 Jul 14 10:07:38.485281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 845/1680] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:39.504157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:39.504775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:39.511257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:39.511706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:39.512464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:39.512901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:39.577876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:39.586400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:39.587908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:39.589042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-552caf25-c149-4d13-b77b-0ea29ed73915 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089516 Jul 14 10:07:39.589597 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 836/1681] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:40.607105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:40.607709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:40.615077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:40.615516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:40.616269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:40.616697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:40.680611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:40.688939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:40.690471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:40.691604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ac26d046-9d4d-4509-b713-57b756528687 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088409 Jul 14 10:07:40.692152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 846/1682] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:41.710536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:41.711285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:41.717228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:41.717674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:41.718455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:41.718893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:41.779674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:41.788186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:41.789684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:41.790858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b8c7626-9007-4a55-a23c-e16b02117e00 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084433 Jul 14 10:07:41.791407 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 837/1683] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:42.809081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:42.809657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:42.816210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:42.816641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:42.817497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:42.817923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:42.878254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:42.886651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:42.888159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:42.889294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-38a57544-b8ee-4ffd-91d2-43a2cfb04236 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084254 Jul 14 10:07:42.889840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 847/1684] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:43.908762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:43.909487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:43.916009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:43.916458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:43.917221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:43.917659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:43.982908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:43.992310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:43.993827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:43.995014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dd919980-bd66-4134-97ce-b0f68138fd54 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090880 Jul 14 10:07:43.995573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 838/1685] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:45.012954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:45.013559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:45.015871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=28 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:45.021300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:45.021743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:45.022528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:45.022962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:45.083530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:45.091922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:45.093421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:45.094584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0db08a04-a768-4484-8cf2-71b76ec8679c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085562 Jul 14 10:07:45.095675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 848/1686] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:46.113176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:46.113808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:46.120321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:46.120767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:46.121525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:46.121961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:46.183503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:46.192447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:46.194055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:46.195214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c438f223-373a-4b79-b803-548dfb998a85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085962 Jul 14 10:07:46.195759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 839/1687] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:47.213879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:47.214500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:47.221033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:47.221473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:47.222254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:47.222687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:47.282694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:47.290971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:47.292487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:47.293900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6ab7c978-5a47-407e-8eff-f9ae9193fd86 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.083984 Jul 14 10:07:47.294490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 849/1688] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:48.312344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:48.312981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:48.315293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=28 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:48.320673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:48.321115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:48.321892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:48.322347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:48.326344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=84 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:48.385837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:48.394869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:48.397443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:48.398655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-aaf53651-477f-4e13-8b6d-7b2ab85887b9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090124 Jul 14 10:07:48.399505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 840/1689] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:49.417402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:49.417991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:49.426040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:49.426502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:49.427384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:49.427811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:49.489464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:49.497854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:49.499388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:49.500515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c646a34b-fb18-45a6-a21f-d7c18a458c5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087408 Jul 14 10:07:49.501726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 850/1690] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:50.519541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:50.520172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:50.526819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:50.527270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:50.528038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:50.528498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:50.591996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:50.600302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:50.601788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:50.602950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7f03f2e6-e70f-44f4-b764-053d2d34173d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087847 Jul 14 10:07:50.603505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 841/1691] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:51.276419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-af0ce4d3-4d01-499c-ab3c-19f4b3cd7160 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:51.276960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af0ce4d3-4d01-499c-ab3c-19f4b3cd7160 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:51.283459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af0ce4d3-4d01-499c-ab3c-19f4b3cd7160 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.283905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af0ce4d3-4d01-499c-ab3c-19f4b3cd7160 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.284676 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af0ce4d3-4d01-499c-ab3c-19f4b3cd7160 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.285122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af0ce4d3-4d01-499c-ab3c-19f4b3cd7160 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.310028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af0ce4d3-4d01-499c-ab3c-19f4b3cd7160 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:07:51.321783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-225fada5-a6ad-4292-aa4b-557bf93e9628 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:51.322315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-225fada5-a6ad-4292-aa4b-557bf93e9628 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:51.328651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-225fada5-a6ad-4292-aa4b-557bf93e9628 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.329650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-225fada5-a6ad-4292-aa4b-557bf93e9628 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.330495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-225fada5-a6ad-4292-aa4b-557bf93e9628 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.330931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-225fada5-a6ad-4292-aa4b-557bf93e9628 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.356246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-225fada5-a6ad-4292-aa4b-557bf93e9628 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:07:51.401895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-af0ce4d3-4d01-499c-ab3c-19f4b3cd7160 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 204 len: 0 microversion: 2.1 time: 0.128924 Jul 14 10:07:51.402981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 851/1692] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:07:51 2022] DELETE /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:07:51.411877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5e69382a-49f3-41e9-8f54-0f920a144ffe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:51.412564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5e69382a-49f3-41e9-8f54-0f920a144ffe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:51.418753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e69382a-49f3-41e9-8f54-0f920a144ffe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.419199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e69382a-49f3-41e9-8f54-0f920a144ffe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.419961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e69382a-49f3-41e9-8f54-0f920a144ffe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.420390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e69382a-49f3-41e9-8f54-0f920a144ffe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.448668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-225fada5-a6ad-4292-aa4b-557bf93e9628 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 204 len: 0 microversion: 2.1 time: 0.132090 Jul 14 10:07:51.449560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 842/1693] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:07:51 2022] DELETE /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 10:07:51.458470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a6036a80-a7c5-4af3-9e5c-573473b8ff93 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:51.459180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a6036a80-a7c5-4af3-9e5c-573473b8ff93 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:51.465253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6036a80-a7c5-4af3-9e5c-573473b8ff93 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.465705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6036a80-a7c5-4af3-9e5c-573473b8ff93 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.466609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6036a80-a7c5-4af3-9e5c-573473b8ff93 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.467037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6036a80-a7c5-4af3-9e5c-573473b8ff93 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.616188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5e69382a-49f3-41e9-8f54-0f920a144ffe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:51.624674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5e69382a-49f3-41e9-8f54-0f920a144ffe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1720 microversion: 2.1 time: 0.217195 Jul 14 10:07:51.625328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 852/1694] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:51 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:07:51.629998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:51.630697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:51.636693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.637206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.637964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:51.638498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:51.642925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a6036a80-a7c5-4af3-9e5c-573473b8ff93 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:51.651163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a6036a80-a7c5-4af3-9e5c-573473b8ff93 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.197291 Jul 14 10:07:51.651916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 843/1695] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:51 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:07:51.700380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:51.709353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:51.710892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:51.712016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3c93ad02-888b-43f7-8ccd-b87a9189aca0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085691 Jul 14 10:07:51.712563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 853/1696] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:52.643050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-00987f0f-c6ea-43ab-9ef3-518333d36a73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:52.643652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-00987f0f-c6ea-43ab-9ef3-518333d36a73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:52.650337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00987f0f-c6ea-43ab-9ef3-518333d36a73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:52.650791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00987f0f-c6ea-43ab-9ef3-518333d36a73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:52.651556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00987f0f-c6ea-43ab-9ef3-518333d36a73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:52.652020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00987f0f-c6ea-43ab-9ef3-518333d36a73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:52.669139 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dd7c5004-049a-4a8c-b355-fd379643fbd4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:52.669738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dd7c5004-049a-4a8c-b355-fd379643fbd4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:52.676607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd7c5004-049a-4a8c-b355-fd379643fbd4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:52.677039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd7c5004-049a-4a8c-b355-fd379643fbd4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:52.677804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd7c5004-049a-4a8c-b355-fd379643fbd4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:52.678254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd7c5004-049a-4a8c-b355-fd379643fbd4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:52.862361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-00987f0f-c6ea-43ab-9ef3-518333d36a73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:52.866425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dd7c5004-049a-4a8c-b355-fd379643fbd4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:52.870894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-00987f0f-c6ea-43ab-9ef3-518333d36a73 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1720 microversion: 2.1 time: 0.232294 Jul 14 10:07:52.871472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 844/1697] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:52 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:52.876600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dd7c5004-049a-4a8c-b355-fd379643fbd4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.211053 Jul 14 10:07:52.877588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:52.878412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:52.885426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:52.886103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:52.886914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:52.887355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:52.887923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 854/1698] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:52 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:07:52.952025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:52.961683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:52.963226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:52.964373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b6e4b18-8177-433f-a954-9aa4ed3dd0d7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091797 Jul 14 10:07:52.964933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 845/1699] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:53.432192 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-1738098c-1a99-41ba-8d2c-b53b5f348c55 req-0b142c49-8685-4a30-b1ec-3d456e6e813b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99819874-5159-49fd-81c9-78998c928020", "name": "network-vif-deleted", "tag": "c1165b3f-8447-4ca2-8d04-05ed3e331d2a"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:07:53.443315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-1738098c-1a99-41ba-8d2c-b53b5f348c55 req-0b142c49-8685-4a30-b1ec-3d456e6e813b service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:53.444052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-1738098c-1a99-41ba-8d2c-b53b5f348c55 req-0b142c49-8685-4a30-b1ec-3d456e6e813b service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:53.457184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-1738098c-1a99-41ba-8d2c-b53b5f348c55 req-0b142c49-8685-4a30-b1ec-3d456e6e813b service nova] Creating event network-vif-deleted:c1165b3f-8447-4ca2-8d04-05ed3e331d2a for instance 99819874-5159-49fd-81c9-78998c928020 on hv-cinder-82549 Jul 14 10:07:53.464881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-1738098c-1a99-41ba-8d2c-b53b5f348c55 req-0b142c49-8685-4a30-b1ec-3d456e6e813b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037620 Jul 14 10:07:53.465887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 855/1700] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:53.888972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6590adb3-53e9-4a01-9b4b-29ec85bd4eb6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:53.889494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6590adb3-53e9-4a01-9b4b-29ec85bd4eb6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:53.895685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7c8e2444-ba83-4689-bc7a-f3bb209357e3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:53.896189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6590adb3-53e9-4a01-9b4b-29ec85bd4eb6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:53.896572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7c8e2444-ba83-4689-bc7a-f3bb209357e3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:53.896712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6590adb3-53e9-4a01-9b4b-29ec85bd4eb6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:53.897379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6590adb3-53e9-4a01-9b4b-29ec85bd4eb6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:53.897814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6590adb3-53e9-4a01-9b4b-29ec85bd4eb6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:53.903602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8e2444-ba83-4689-bc7a-f3bb209357e3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:53.904284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8e2444-ba83-4689-bc7a-f3bb209357e3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:53.905005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8e2444-ba83-4689-bc7a-f3bb209357e3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:53.905443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8e2444-ba83-4689-bc7a-f3bb209357e3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:53.972629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6590adb3-53e9-4a01-9b4b-29ec85bd4eb6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:53.982475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6590adb3-53e9-4a01-9b4b-29ec85bd4eb6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.097419 Jul 14 10:07:53.983050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 846/1701] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:53 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:53.988302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:53.988902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:53.995090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:53.995602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:53.996383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:53.996821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:54.073981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:54.083304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:54.084810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:54.085963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-28d7673a-47d6-4647-893c-3181b55055e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.101810 Jul 14 10:07:54.086551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 847/1702] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:54.098441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7c8e2444-ba83-4689-bc7a-f3bb209357e3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:54.109298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7c8e2444-ba83-4689-bc7a-f3bb209357e3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.217866 Jul 14 10:07:54.111142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 856/1703] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:53 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:54.999941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e18503ea-141a-4f56-b2f6-eb4e29aa5c7a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:55.000541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e18503ea-141a-4f56-b2f6-eb4e29aa5c7a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:55.007780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e18503ea-141a-4f56-b2f6-eb4e29aa5c7a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:55.008222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e18503ea-141a-4f56-b2f6-eb4e29aa5c7a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:55.009180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e18503ea-141a-4f56-b2f6-eb4e29aa5c7a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:55.009616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e18503ea-141a-4f56-b2f6-eb4e29aa5c7a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:55.071047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e18503ea-141a-4f56-b2f6-eb4e29aa5c7a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:55.078978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e18503ea-141a-4f56-b2f6-eb4e29aa5c7a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083056 Jul 14 10:07:55.079542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 848/1704] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:54 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:55.104440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:55.105100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:55.111691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:55.112152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:55.112951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:55.113385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:55.129489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-97c9272d-8546-43d5-b9ea-caf216374754 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:55.130109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-97c9272d-8546-43d5-b9ea-caf216374754 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:55.136199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97c9272d-8546-43d5-b9ea-caf216374754 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:55.136610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97c9272d-8546-43d5-b9ea-caf216374754 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:55.137399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97c9272d-8546-43d5-b9ea-caf216374754 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:55.137906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97c9272d-8546-43d5-b9ea-caf216374754 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:55.180554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:55.189608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:55.191144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:55.192293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6ac55d0f-662c-4053-ba47-d79f946536ea tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091761 Jul 14 10:07:55.192855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 857/1705] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:55.273447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-97c9272d-8546-43d5-b9ea-caf216374754 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:55.281361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-97c9272d-8546-43d5-b9ea-caf216374754 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.156654 Jul 14 10:07:55.281943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 849/1706] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:55 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:07:56.096361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-396386ab-2ac7-4af0-9cfd-565d62fdf529 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:56.096976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-396386ab-2ac7-4af0-9cfd-565d62fdf529 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:56.103035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-396386ab-2ac7-4af0-9cfd-565d62fdf529 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:56.103483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-396386ab-2ac7-4af0-9cfd-565d62fdf529 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:56.104248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-396386ab-2ac7-4af0-9cfd-565d62fdf529 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:56.104682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-396386ab-2ac7-4af0-9cfd-565d62fdf529 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:56.168667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-396386ab-2ac7-4af0-9cfd-565d62fdf529 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:56.171169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:56.178872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-396386ab-2ac7-4af0-9cfd-565d62fdf529 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086339 Jul 14 10:07:56.179430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 858/1707] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:56 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:56.209692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:56.210366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:56.216804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:56.217247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:56.217995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:56.218478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:56.279039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:56.287755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:56.289249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:56.290424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c36beb76-0eb4-4d32-96c2-8c0f99f5cf22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084591 Jul 14 10:07:56.290975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 850/1708] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:56.299395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-285b3387-ab47-45db-8948-9200af58c63c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:56.300015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-285b3387-ab47-45db-8948-9200af58c63c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:56.307975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-285b3387-ab47-45db-8948-9200af58c63c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:56.308426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-285b3387-ab47-45db-8948-9200af58c63c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:56.309209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-285b3387-ab47-45db-8948-9200af58c63c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:56.309642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-285b3387-ab47-45db-8948-9200af58c63c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:56.443878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-285b3387-ab47-45db-8948-9200af58c63c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:56.451939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-285b3387-ab47-45db-8948-9200af58c63c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157037 Jul 14 10:07:56.452511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 859/1709] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:56 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:57.196144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d46fb1f7-6a3b-4251-8e27-17c543fafedf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:57.196754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d46fb1f7-6a3b-4251-8e27-17c543fafedf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:57.202903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d46fb1f7-6a3b-4251-8e27-17c543fafedf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:57.203358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d46fb1f7-6a3b-4251-8e27-17c543fafedf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:57.204122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d46fb1f7-6a3b-4251-8e27-17c543fafedf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:57.204561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d46fb1f7-6a3b-4251-8e27-17c543fafedf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:57.266342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d46fb1f7-6a3b-4251-8e27-17c543fafedf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:57.275018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d46fb1f7-6a3b-4251-8e27-17c543fafedf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082677 Jul 14 10:07:57.275513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 851/1710] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:57 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:57.309203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:57.309809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:57.316913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:57.317361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:57.318125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:57.321773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:57.387219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:57.396210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:57.397792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:57.399075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-893848f6-2948-471c-b92d-79eb78727745 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.093705 Jul 14 10:07:57.399653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 860/1711] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:57.469577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-185b4693-4f00-4fdb-be50-e6f266c3fef9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:57.470208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-185b4693-4f00-4fdb-be50-e6f266c3fef9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:57.476361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-185b4693-4f00-4fdb-be50-e6f266c3fef9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:57.476890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-185b4693-4f00-4fdb-be50-e6f266c3fef9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:57.477638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-185b4693-4f00-4fdb-be50-e6f266c3fef9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:57.478070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-185b4693-4f00-4fdb-be50-e6f266c3fef9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:57.607135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-185b4693-4f00-4fdb-be50-e6f266c3fef9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:57.615859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-185b4693-4f00-4fdb-be50-e6f266c3fef9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150057 Jul 14 10:07:57.616432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 852/1712] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:57 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:58.291878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7ae34441-e617-46b7-a32d-2b32708eeffd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:58.292484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7ae34441-e617-46b7-a32d-2b32708eeffd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:58.298834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ae34441-e617-46b7-a32d-2b32708eeffd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:58.299272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ae34441-e617-46b7-a32d-2b32708eeffd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:58.300031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ae34441-e617-46b7-a32d-2b32708eeffd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:58.300461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ae34441-e617-46b7-a32d-2b32708eeffd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:58.330579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:07:58.331355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:07:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 (ip 10.222.0.40) !!! Jul 14 10:07:58.363309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7ae34441-e617-46b7-a32d-2b32708eeffd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:58.372840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7ae34441-e617-46b7-a32d-2b32708eeffd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084420 Jul 14 10:07:58.373847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 861/1713] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:58 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:58.416851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:58.417467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:58.424587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:58.425044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:58.425815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:58.426280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:58.500262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:58.508793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:58.510313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:58.511444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f71cb07f-f7d0-4448-8f77-118fa2a9d8a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.098514 Jul 14 10:07:58.511995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 853/1714] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:58.633660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21c3f961-8e4d-404f-a8ea-83c89adc5d64 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:58.634281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-21c3f961-8e4d-404f-a8ea-83c89adc5d64 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:58.640732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c3f961-8e4d-404f-a8ea-83c89adc5d64 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:58.641173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c3f961-8e4d-404f-a8ea-83c89adc5d64 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:58.641922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c3f961-8e4d-404f-a8ea-83c89adc5d64 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:58.642453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21c3f961-8e4d-404f-a8ea-83c89adc5d64 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:58.772925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21c3f961-8e4d-404f-a8ea-83c89adc5d64 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:58.780916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-21c3f961-8e4d-404f-a8ea-83c89adc5d64 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151235 Jul 14 10:07:58.781491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 862/1715] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:58 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:59.390378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ce745a5c-61ea-4b26-8d2b-0c783ecba3c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:59.390985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ce745a5c-61ea-4b26-8d2b-0c783ecba3c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:59.397935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce745a5c-61ea-4b26-8d2b-0c783ecba3c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:59.398305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce745a5c-61ea-4b26-8d2b-0c783ecba3c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:59.399076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce745a5c-61ea-4b26-8d2b-0c783ecba3c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:59.399508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ce745a5c-61ea-4b26-8d2b-0c783ecba3c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:59.462886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ce745a5c-61ea-4b26-8d2b-0c783ecba3c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:59.471495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ce745a5c-61ea-4b26-8d2b-0c783ecba3c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085021 Jul 14 10:07:59.472066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 854/1716] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:59 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:07:59.529883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:59.530521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:59.537794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:59.538111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:59.538893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:59.539340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:59.600594 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:59.608866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:59.610393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:59.612135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cf73ea30-bb60-4ef2-b0f5-e43e38070aa2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086208 Jul 14 10:07:59.612746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 863/1717] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:07:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:59.798374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f3ae418c-52f3-4f7e-af2c-ea4cde23a72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:59.798986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f3ae418c-52f3-4f7e-af2c-ea4cde23a72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:07:59.804996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3ae418c-52f3-4f7e-af2c-ea4cde23a72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:59.805450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3ae418c-52f3-4f7e-af2c-ea4cde23a72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:59.806229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3ae418c-52f3-4f7e-af2c-ea4cde23a72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:07:59.806671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3ae418c-52f3-4f7e-af2c-ea4cde23a72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:07:59.809271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:59.941848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f3ae418c-52f3-4f7e-af2c-ea4cde23a72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:07:59.949865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f3ae418c-52f3-4f7e-af2c-ea4cde23a72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155443 Jul 14 10:07:59.950457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 855/1718] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:07:59 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:00.488965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-90cfe324-b54d-4ece-80e4-3b9e2d78d0b8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:00.489567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-90cfe324-b54d-4ece-80e4-3b9e2d78d0b8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:00.495721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90cfe324-b54d-4ece-80e4-3b9e2d78d0b8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:00.496172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90cfe324-b54d-4ece-80e4-3b9e2d78d0b8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:00.496972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90cfe324-b54d-4ece-80e4-3b9e2d78d0b8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:00.497406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90cfe324-b54d-4ece-80e4-3b9e2d78d0b8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:00.561591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-90cfe324-b54d-4ece-80e4-3b9e2d78d0b8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:00.570292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-90cfe324-b54d-4ece-80e4-3b9e2d78d0b8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085712 Jul 14 10:08:00.570844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 864/1719] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:00 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:00.630685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:00.631289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:00.637718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:00.638160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:00.638943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:00.639373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:00.700450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:00.709304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:00.710846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:00.711975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-939598ac-9f25-4479-974c-fed973974b04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085796 Jul 14 10:08:00.712529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 856/1720] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:00.967441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f5fd77bb-4e82-4fa7-92ee-6a1854904b49 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:00.968038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f5fd77bb-4e82-4fa7-92ee-6a1854904b49 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:00.974653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f5fd77bb-4e82-4fa7-92ee-6a1854904b49 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:00.975099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f5fd77bb-4e82-4fa7-92ee-6a1854904b49 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:00.975858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f5fd77bb-4e82-4fa7-92ee-6a1854904b49 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:00.976292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f5fd77bb-4e82-4fa7-92ee-6a1854904b49 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:01.104760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f5fd77bb-4e82-4fa7-92ee-6a1854904b49 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:01.112621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f5fd77bb-4e82-4fa7-92ee-6a1854904b49 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149085 Jul 14 10:08:01.113181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 865/1721] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:00 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:01.586897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-90047afb-05c7-4600-ab64-b526d85b261d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:01.587504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-90047afb-05c7-4600-ab64-b526d85b261d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:01.593486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-90047afb-05c7-4600-ab64-b526d85b261d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:01.593929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-90047afb-05c7-4600-ab64-b526d85b261d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:01.594713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-90047afb-05c7-4600-ab64-b526d85b261d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:01.595689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-90047afb-05c7-4600-ab64-b526d85b261d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:01.656059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-90047afb-05c7-4600-ab64-b526d85b261d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:01.664040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-90047afb-05c7-4600-ab64-b526d85b261d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081052 Jul 14 10:08:01.664600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 857/1722] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:01 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:01.730730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:01.731337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:01.737499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:01.737938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:01.738723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:01.739176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:01.802470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:01.810772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:01.812267 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:01.813392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9ce347e8-6047-4cef-8d56-e6b35167e638 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086819 Jul 14 10:08:01.814469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 866/1723] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:01.975100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:08:01.975291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:08:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:08:02.128773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7844e7f3-6d58-404d-84b5-1a4bb3985ee2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:02.129371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7844e7f3-6d58-404d-84b5-1a4bb3985ee2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:02.135384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7844e7f3-6d58-404d-84b5-1a4bb3985ee2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:02.135826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7844e7f3-6d58-404d-84b5-1a4bb3985ee2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:02.136575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7844e7f3-6d58-404d-84b5-1a4bb3985ee2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:02.137031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7844e7f3-6d58-404d-84b5-1a4bb3985ee2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:02.265966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7844e7f3-6d58-404d-84b5-1a4bb3985ee2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:02.273829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7844e7f3-6d58-404d-84b5-1a4bb3985ee2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148928 Jul 14 10:08:02.274410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 858/1724] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:02 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:02.683050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e27c7785-9c13-487f-8cf6-185b2fe26d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:02.683687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e27c7785-9c13-487f-8cf6-185b2fe26d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:02.690562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e27c7785-9c13-487f-8cf6-185b2fe26d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:02.691034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e27c7785-9c13-487f-8cf6-185b2fe26d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:02.691811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e27c7785-9c13-487f-8cf6-185b2fe26d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:02.692242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e27c7785-9c13-487f-8cf6-185b2fe26d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:02.756518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e27c7785-9c13-487f-8cf6-185b2fe26d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:02.764578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e27c7785-9c13-487f-8cf6-185b2fe26d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085402 Jul 14 10:08:02.765143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 867/1725] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:02 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:02.832454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:02.832999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:02.839751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:02.840203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:02.840968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:02.841406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:02.902573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:02.911769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:02.913281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:02.914442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-75e4e36b-66f8-4608-88bb-ccc37f47bca4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086510 Jul 14 10:08:02.914991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 859/1726] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:03.291127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-649a5365-8e4a-46c5-9d4a-cdd6e917fc60 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:03.291734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-649a5365-8e4a-46c5-9d4a-cdd6e917fc60 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:03.298100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-649a5365-8e4a-46c5-9d4a-cdd6e917fc60 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:03.299205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-649a5365-8e4a-46c5-9d4a-cdd6e917fc60 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:03.299963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-649a5365-8e4a-46c5-9d4a-cdd6e917fc60 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:03.300394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-649a5365-8e4a-46c5-9d4a-cdd6e917fc60 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:03.429984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-649a5365-8e4a-46c5-9d4a-cdd6e917fc60 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:03.437936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-649a5365-8e4a-46c5-9d4a-cdd6e917fc60 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150749 Jul 14 10:08:03.438550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 868/1727] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:03 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:03.785540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e4a98800-5d6e-40fe-b818-161e08a12430 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:03.786155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e4a98800-5d6e-40fe-b818-161e08a12430 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:03.792361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4a98800-5d6e-40fe-b818-161e08a12430 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:03.792753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4a98800-5d6e-40fe-b818-161e08a12430 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:03.793771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4a98800-5d6e-40fe-b818-161e08a12430 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:03.794225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4a98800-5d6e-40fe-b818-161e08a12430 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:03.854770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e4a98800-5d6e-40fe-b818-161e08a12430 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:03.862633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e4a98800-5d6e-40fe-b818-161e08a12430 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081505 Jul 14 10:08:03.863187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 860/1728] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:03 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:03.932771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:03.933402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:03.940413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:03.940863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:03.941609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:03.942038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:04.013931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:04.023170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:04.024657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:04.026107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9cdb300c-68b4-41e8-b30a-d0f632b662ee tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.097275 Jul 14 10:08:04.026680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 869/1729] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:04.456312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1f610e34-eb60-4d8f-b4d7-19634bb79ecc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:04.456844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1f610e34-eb60-4d8f-b4d7-19634bb79ecc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:04.462972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f610e34-eb60-4d8f-b4d7-19634bb79ecc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:04.463427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f610e34-eb60-4d8f-b4d7-19634bb79ecc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:04.464192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f610e34-eb60-4d8f-b4d7-19634bb79ecc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:04.464633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f610e34-eb60-4d8f-b4d7-19634bb79ecc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:04.594047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1f610e34-eb60-4d8f-b4d7-19634bb79ecc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:04.602797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1f610e34-eb60-4d8f-b4d7-19634bb79ecc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150961 Jul 14 10:08:04.603366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 861/1730] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:04 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:04.880138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ee9f0272-0b0b-428f-8167-e74b957bb324 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:04.880663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ee9f0272-0b0b-428f-8167-e74b957bb324 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:04.886733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee9f0272-0b0b-428f-8167-e74b957bb324 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:04.887178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee9f0272-0b0b-428f-8167-e74b957bb324 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:04.887934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee9f0272-0b0b-428f-8167-e74b957bb324 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:04.888366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ee9f0272-0b0b-428f-8167-e74b957bb324 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:04.950319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ee9f0272-0b0b-428f-8167-e74b957bb324 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:04.958935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ee9f0272-0b0b-428f-8167-e74b957bb324 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083275 Jul 14 10:08:04.959489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 870/1731] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:04 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:05.045200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:05.045811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:05.053274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:05.053732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:05.054551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:05.054989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:05.117765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:05.126677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:05.128336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:05.129506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-968eafb3-b48a-43ec-899e-bd80d0980831 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088652 Jul 14 10:08:05.130379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 862/1732] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:05.619749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0662dd23-0f6b-47bb-83b5-6838fb9a027e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:05.620349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0662dd23-0f6b-47bb-83b5-6838fb9a027e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:05.627003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0662dd23-0f6b-47bb-83b5-6838fb9a027e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:05.627480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0662dd23-0f6b-47bb-83b5-6838fb9a027e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:05.628311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0662dd23-0f6b-47bb-83b5-6838fb9a027e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:05.628732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0662dd23-0f6b-47bb-83b5-6838fb9a027e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:05.757181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0662dd23-0f6b-47bb-83b5-6838fb9a027e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:05.765087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0662dd23-0f6b-47bb-83b5-6838fb9a027e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149235 Jul 14 10:08:05.765657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 871/1733] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:05 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:05.975055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-28cf47d2-2bf5-4deb-ac8b-35fe956e4cd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:05.975661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-28cf47d2-2bf5-4deb-ac8b-35fe956e4cd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:05.981689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28cf47d2-2bf5-4deb-ac8b-35fe956e4cd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:05.982128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28cf47d2-2bf5-4deb-ac8b-35fe956e4cd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:05.982907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28cf47d2-2bf5-4deb-ac8b-35fe956e4cd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:05.983337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28cf47d2-2bf5-4deb-ac8b-35fe956e4cd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:06.048720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-28cf47d2-2bf5-4deb-ac8b-35fe956e4cd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:06.057156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-28cf47d2-2bf5-4deb-ac8b-35fe956e4cd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085978 Jul 14 10:08:06.057720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 863/1734] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:05 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:06.147648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:06.148294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:06.154793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:06.155237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:06.156000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:06.156429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:06.217222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:06.226426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:06.227876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:06.229014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-29d35740-0ed1-4ac3-ac3c-9e17f0a5ae22 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085346 Jul 14 10:08:06.229572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 872/1735] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:06.782572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e11d33cd-4c67-4b7f-bcfa-b228095535e1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:06.783179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e11d33cd-4c67-4b7f-bcfa-b228095535e1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:06.789404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e11d33cd-4c67-4b7f-bcfa-b228095535e1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:06.789845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e11d33cd-4c67-4b7f-bcfa-b228095535e1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:06.790634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e11d33cd-4c67-4b7f-bcfa-b228095535e1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:06.791063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e11d33cd-4c67-4b7f-bcfa-b228095535e1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:06.924747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e11d33cd-4c67-4b7f-bcfa-b228095535e1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:06.932599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e11d33cd-4c67-4b7f-bcfa-b228095535e1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154020 Jul 14 10:08:06.933154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 864/1736] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:06 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:07.074134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-75f3f627-cb53-4faa-8d93-25cdcd4b5e0f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:07.074762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-75f3f627-cb53-4faa-8d93-25cdcd4b5e0f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:07.081816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75f3f627-cb53-4faa-8d93-25cdcd4b5e0f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:07.082285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75f3f627-cb53-4faa-8d93-25cdcd4b5e0f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:07.083042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75f3f627-cb53-4faa-8d93-25cdcd4b5e0f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:07.083503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75f3f627-cb53-4faa-8d93-25cdcd4b5e0f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:07.145911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-75f3f627-cb53-4faa-8d93-25cdcd4b5e0f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:07.154468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-75f3f627-cb53-4faa-8d93-25cdcd4b5e0f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084115 Jul 14 10:08:07.155108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 873/1737] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:07 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:07.248659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:07.249267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:07.255963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:07.256326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:07.257088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:07.257526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:07.331822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:07.340389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:07.341897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:07.343077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a872c296-dbf3-44d1-b8e2-b6c758f5e4c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.099185 Jul 14 10:08:07.343642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 865/1738] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:07.950619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-459dc22d-8089-4223-b274-c883e41fab33 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:07.951282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-459dc22d-8089-4223-b274-c883e41fab33 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:07.958023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-459dc22d-8089-4223-b274-c883e41fab33 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:07.958502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-459dc22d-8089-4223-b274-c883e41fab33 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:07.959263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-459dc22d-8089-4223-b274-c883e41fab33 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:07.959691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-459dc22d-8089-4223-b274-c883e41fab33 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:08.087035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-459dc22d-8089-4223-b274-c883e41fab33 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:08.094931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-459dc22d-8089-4223-b274-c883e41fab33 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148402 Jul 14 10:08:08.096130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 874/1739] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:07 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:08.174353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-732d78c0-7300-4af7-b3b0-11bad6d4e2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:08.174952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-732d78c0-7300-4af7-b3b0-11bad6d4e2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:08.180879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-732d78c0-7300-4af7-b3b0-11bad6d4e2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:08.181319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-732d78c0-7300-4af7-b3b0-11bad6d4e2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:08.182090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-732d78c0-7300-4af7-b3b0-11bad6d4e2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:08.182546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-732d78c0-7300-4af7-b3b0-11bad6d4e2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:08.242583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-732d78c0-7300-4af7-b3b0-11bad6d4e2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:08.250513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-732d78c0-7300-4af7-b3b0-11bad6d4e2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.079964 Jul 14 10:08:08.251241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 866/1740] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:08 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:08.361829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:08.362462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:08.369014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:08.369458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:08.370247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:08.370683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:08.385509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:08.438575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:08.447118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:08.448620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:08.449759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-61a37288-2297-4f0e-b1b5-3fb1f25e23bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092407 Jul 14 10:08:08.450325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 875/1741] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:09.113101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-01ca99ac-b429-4a30-846e-f4990e93efef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:09.113707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-01ca99ac-b429-4a30-846e-f4990e93efef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:09.120202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01ca99ac-b429-4a30-846e-f4990e93efef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:09.120649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01ca99ac-b429-4a30-846e-f4990e93efef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:09.121402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01ca99ac-b429-4a30-846e-f4990e93efef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:09.121834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01ca99ac-b429-4a30-846e-f4990e93efef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:09.258870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-01ca99ac-b429-4a30-846e-f4990e93efef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:09.266782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-01ca99ac-b429-4a30-846e-f4990e93efef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.158106 Jul 14 10:08:09.267305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3abadab9-7838-47a0-9b67-1138450f6f8c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:09.267440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 867/1742] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:09 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:09.267916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3abadab9-7838-47a0-9b67-1138450f6f8c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:09.274077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3abadab9-7838-47a0-9b67-1138450f6f8c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:09.274549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3abadab9-7838-47a0-9b67-1138450f6f8c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:09.275304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3abadab9-7838-47a0-9b67-1138450f6f8c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:09.275732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3abadab9-7838-47a0-9b67-1138450f6f8c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:09.336131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3abadab9-7838-47a0-9b67-1138450f6f8c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:09.343992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3abadab9-7838-47a0-9b67-1138450f6f8c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.080548 Jul 14 10:08:09.344547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 876/1743] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:09 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:09.467700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:09.468304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:09.474992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:09.475428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:09.476173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:09.476601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:09.536725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:09.545488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:09.547021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:09.548160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8f0a90ff-4497-4bc4-90fe-88151c674106 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084364 Jul 14 10:08:09.548760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 868/1744] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:09 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:10.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-613be9a7-a018-434f-825a-a138aab874bd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:10.284447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-613be9a7-a018-434f-825a-a138aab874bd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:10.291152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-613be9a7-a018-434f-825a-a138aab874bd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:10.291730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-613be9a7-a018-434f-825a-a138aab874bd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:10.292492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-613be9a7-a018-434f-825a-a138aab874bd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:10.292924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-613be9a7-a018-434f-825a-a138aab874bd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:10.362525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a96ceea1-9901-40c3-98fa-e0a73b294991 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:10.363235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a96ceea1-9901-40c3-98fa-e0a73b294991 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:10.369447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a96ceea1-9901-40c3-98fa-e0a73b294991 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:10.369909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a96ceea1-9901-40c3-98fa-e0a73b294991 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:10.370704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a96ceea1-9901-40c3-98fa-e0a73b294991 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:10.371141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a96ceea1-9901-40c3-98fa-e0a73b294991 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:10.445309 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a96ceea1-9901-40c3-98fa-e0a73b294991 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:10.448352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-613be9a7-a018-434f-825a-a138aab874bd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:10.453247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a96ceea1-9901-40c3-98fa-e0a73b294991 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.095341 Jul 14 10:08:10.453901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 869/1745] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:10 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:10.456263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-613be9a7-a018-434f-825a-a138aab874bd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.176293 Jul 14 10:08:10.456822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 877/1746] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:10 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:10.569077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:10.569715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:10.575830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:10.576284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:10.577038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:10.577474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:10.637399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:10.645793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:10.647335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:10.648463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3c8eae7f-a805-40fb-a721-736209ceb0a5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.083350 Jul 14 10:08:10.649022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 870/1747] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:11.471631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b3ad292e-6f68-44be-9603-60c1e26be41d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:11.472125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b3ad292e-6f68-44be-9603-60c1e26be41d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:11.473707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7d0b59de-5237-4259-a67b-aa3a721b5d0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:11.474433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7d0b59de-5237-4259-a67b-aa3a721b5d0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:11.478680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b3ad292e-6f68-44be-9603-60c1e26be41d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:11.479126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b3ad292e-6f68-44be-9603-60c1e26be41d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:11.479894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b3ad292e-6f68-44be-9603-60c1e26be41d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:11.480323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b3ad292e-6f68-44be-9603-60c1e26be41d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:11.481092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d0b59de-5237-4259-a67b-aa3a721b5d0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:11.481605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d0b59de-5237-4259-a67b-aa3a721b5d0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:11.482397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d0b59de-5237-4259-a67b-aa3a721b5d0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:11.482834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d0b59de-5237-4259-a67b-aa3a721b5d0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:11.569492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b3ad292e-6f68-44be-9603-60c1e26be41d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:11.577353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b3ad292e-6f68-44be-9603-60c1e26be41d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.111127 Jul 14 10:08:11.577921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 878/1748] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:11 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:11.635696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7d0b59de-5237-4259-a67b-aa3a721b5d0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:11.637851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:11.645169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7d0b59de-5237-4259-a67b-aa3a721b5d0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.175942 Jul 14 10:08:11.645730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 871/1749] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:11 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:11.666949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:11.667500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:11.674423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:11.674872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:11.675633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:11.676064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:11.736045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:11.744433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:11.745948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:11.747114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6b9ced2c-a32b-4d61-8c34-67cbeb71865f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084109 Jul 14 10:08:11.747670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 879/1750] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:12.594351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-443d24cb-bb58-4930-9718-a7140437b8f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:12.594987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-443d24cb-bb58-4930-9718-a7140437b8f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:12.602153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-443d24cb-bb58-4930-9718-a7140437b8f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:12.602637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-443d24cb-bb58-4930-9718-a7140437b8f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:12.603437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-443d24cb-bb58-4930-9718-a7140437b8f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:12.603872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-443d24cb-bb58-4930-9718-a7140437b8f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:12.663354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-813a7d36-a922-442c-985b-fe7f94647d7a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:12.663735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-813a7d36-a922-442c-985b-fe7f94647d7a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:12.665103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-443d24cb-bb58-4930-9718-a7140437b8f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:12.670544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-813a7d36-a922-442c-985b-fe7f94647d7a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:12.670982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-813a7d36-a922-442c-985b-fe7f94647d7a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:12.671760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-813a7d36-a922-442c-985b-fe7f94647d7a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:12.672195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-813a7d36-a922-442c-985b-fe7f94647d7a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:12.673566 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-443d24cb-bb58-4930-9718-a7140437b8f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083128 Jul 14 10:08:12.674221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 872/1751] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:12 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:12.764720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:12.765321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:12.771855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:12.772302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:12.773065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:12.773495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:12.806809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-813a7d36-a922-442c-985b-fe7f94647d7a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:12.815718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-813a7d36-a922-442c-985b-fe7f94647d7a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.156979 Jul 14 10:08:12.817158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 880/1752] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:12 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:12.837968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:12.847392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:12.848921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:12.850081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-090088a6-59c0-428b-a2ae-31dab056215c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089208 Jul 14 10:08:12.850668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 873/1753] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:13.689791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-605bec47-a0ce-4368-af77-bf0dbdf55cc3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:13.690388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-605bec47-a0ce-4368-af77-bf0dbdf55cc3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:13.696893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-605bec47-a0ce-4368-af77-bf0dbdf55cc3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:13.697332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-605bec47-a0ce-4368-af77-bf0dbdf55cc3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:13.698087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-605bec47-a0ce-4368-af77-bf0dbdf55cc3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:13.698563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-605bec47-a0ce-4368-af77-bf0dbdf55cc3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:13.761838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-605bec47-a0ce-4368-af77-bf0dbdf55cc3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:13.770208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-605bec47-a0ce-4368-af77-bf0dbdf55cc3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084317 Jul 14 10:08:13.770837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 881/1754] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:13 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:13.833745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2b28e371-d812-4fb1-afcd-7a38cefa67b4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:13.834480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2b28e371-d812-4fb1-afcd-7a38cefa67b4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:13.841502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2b28e371-d812-4fb1-afcd-7a38cefa67b4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:13.841943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2b28e371-d812-4fb1-afcd-7a38cefa67b4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:13.842727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2b28e371-d812-4fb1-afcd-7a38cefa67b4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:13.843201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2b28e371-d812-4fb1-afcd-7a38cefa67b4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:13.869869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:13.870510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:13.876793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:13.877243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:13.878036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:13.878490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:13.971153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:13.980427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:13.981934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:13.983132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3fb3e32d-67a0-4c11-8a59-720ed32180fa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.117420 Jul 14 10:08:13.983705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 882/1755] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:14.016839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2b28e371-d812-4fb1-afcd-7a38cefa67b4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:14.025242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2b28e371-d812-4fb1-afcd-7a38cefa67b4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.195631 Jul 14 10:08:14.025805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 874/1756] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:13 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:14.786574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-982a7088-3076-418f-8fd5-5d53df87698d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:14.787218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-982a7088-3076-418f-8fd5-5d53df87698d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:14.794000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-982a7088-3076-418f-8fd5-5d53df87698d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:14.794468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-982a7088-3076-418f-8fd5-5d53df87698d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:14.795219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-982a7088-3076-418f-8fd5-5d53df87698d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:14.795644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-982a7088-3076-418f-8fd5-5d53df87698d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:14.858487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-982a7088-3076-418f-8fd5-5d53df87698d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:14.868144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-982a7088-3076-418f-8fd5-5d53df87698d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085455 Jul 14 10:08:14.868891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 883/1757] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:14 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:15.001798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:15.003094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:15.010369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:15.010966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:15.011746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:15.012188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:15.045162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-331be980-f241-40e6-8d18-d03bd527791d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:15.046490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-331be980-f241-40e6-8d18-d03bd527791d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:15.050045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:15.056889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-331be980-f241-40e6-8d18-d03bd527791d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:15.057333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-331be980-f241-40e6-8d18-d03bd527791d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:15.058115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-331be980-f241-40e6-8d18-d03bd527791d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:15.058571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-331be980-f241-40e6-8d18-d03bd527791d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:15.083770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:15.092472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:15.093975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:15.095165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cf3d6642-5195-490c-84e5-6ac25840fa58 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.097716 Jul 14 10:08:15.096244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 875/1758] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:15.189849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-331be980-f241-40e6-8d18-d03bd527791d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:15.198166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-331be980-f241-40e6-8d18-d03bd527791d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.158830 Jul 14 10:08:15.198744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 884/1759] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:15 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:15.887625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fd1b5c66-bbd9-4226-9eb7-ae22184c0b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:15.888154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fd1b5c66-bbd9-4226-9eb7-ae22184c0b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:15.894279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd1b5c66-bbd9-4226-9eb7-ae22184c0b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:15.894743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd1b5c66-bbd9-4226-9eb7-ae22184c0b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:15.895517 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd1b5c66-bbd9-4226-9eb7-ae22184c0b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:15.895969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd1b5c66-bbd9-4226-9eb7-ae22184c0b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:15.957865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fd1b5c66-bbd9-4226-9eb7-ae22184c0b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:15.966317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fd1b5c66-bbd9-4226-9eb7-ae22184c0b49 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082636 Jul 14 10:08:15.966879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 876/1760] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:15 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:16.116043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:16.116787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:16.123634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:16.124080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:16.124969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:16.125446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:16.186635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:16.194895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:16.196387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:16.197497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2cec48f0-9983-48aa-8467-d40790abbe45 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086293 Jul 14 10:08:16.198045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 885/1761] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:16.214766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b117a58e-e225-4001-b091-eb1533308575 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:16.215382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b117a58e-e225-4001-b091-eb1533308575 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:16.222436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b117a58e-e225-4001-b091-eb1533308575 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:16.222891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b117a58e-e225-4001-b091-eb1533308575 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:16.223657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b117a58e-e225-4001-b091-eb1533308575 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:16.224097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b117a58e-e225-4001-b091-eb1533308575 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:16.353034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b117a58e-e225-4001-b091-eb1533308575 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:16.361002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b117a58e-e225-4001-b091-eb1533308575 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150053 Jul 14 10:08:16.361573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 877/1762] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:16 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:16.983393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d2c57b66-0ed2-4258-8e4d-148113bacf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:16.984029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d2c57b66-0ed2-4258-8e4d-148113bacf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:16.990702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2c57b66-0ed2-4258-8e4d-148113bacf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:16.991144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2c57b66-0ed2-4258-8e4d-148113bacf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:16.991901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2c57b66-0ed2-4258-8e4d-148113bacf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:16.992334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2c57b66-0ed2-4258-8e4d-148113bacf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:17.055581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d2c57b66-0ed2-4258-8e4d-148113bacf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:17.063419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d2c57b66-0ed2-4258-8e4d-148113bacf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083968 Jul 14 10:08:17.063972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 886/1763] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:16 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:17.215927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:17.216563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:17.223184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:17.223631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:17.224384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:17.224818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:17.286476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:17.295257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:17.296778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:17.297929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1baf8165-7a4d-49ae-a930-172bac8964b2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085954 Jul 14 10:08:17.298521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 878/1764] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:17.377867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a496bdc5-0388-4306-954c-b85d2a1826c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:17.378500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a496bdc5-0388-4306-954c-b85d2a1826c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:17.384985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a496bdc5-0388-4306-954c-b85d2a1826c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:17.385436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a496bdc5-0388-4306-954c-b85d2a1826c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:17.386206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a496bdc5-0388-4306-954c-b85d2a1826c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:17.386644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a496bdc5-0388-4306-954c-b85d2a1826c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:17.515633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a496bdc5-0388-4306-954c-b85d2a1826c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:17.523811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a496bdc5-0388-4306-954c-b85d2a1826c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149776 Jul 14 10:08:17.524376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 887/1765] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:17 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:18.080961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7806d121-9ff0-4069-8db0-8b702636a80e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:18.082072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7806d121-9ff0-4069-8db0-8b702636a80e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:18.088096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7806d121-9ff0-4069-8db0-8b702636a80e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:18.088541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7806d121-9ff0-4069-8db0-8b702636a80e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:18.089288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7806d121-9ff0-4069-8db0-8b702636a80e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:18.089744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7806d121-9ff0-4069-8db0-8b702636a80e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:18.151819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7806d121-9ff0-4069-8db0-8b702636a80e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:18.159807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7806d121-9ff0-4069-8db0-8b702636a80e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082746 Jul 14 10:08:18.160502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 879/1766] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:18 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:18.317064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:18.317690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:18.323704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:18.324138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:18.324883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:18.325307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:18.385019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:18.394006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:18.395566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:18.396706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e48f2ec7-9780-4ac1-9254-052f9aecebae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084034 Jul 14 10:08:18.397264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 888/1767] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:18.540993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-01f072b4-2e87-4e09-bd3f-eaa099c288a3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:18.541594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-01f072b4-2e87-4e09-bd3f-eaa099c288a3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:18.544147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:18.550114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01f072b4-2e87-4e09-bd3f-eaa099c288a3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:18.550592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01f072b4-2e87-4e09-bd3f-eaa099c288a3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:18.551340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01f072b4-2e87-4e09-bd3f-eaa099c288a3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:18.551765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01f072b4-2e87-4e09-bd3f-eaa099c288a3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:18.685643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-01f072b4-2e87-4e09-bd3f-eaa099c288a3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:18.694273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-01f072b4-2e87-4e09-bd3f-eaa099c288a3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157122 Jul 14 10:08:18.694829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 880/1768] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:18 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:19.177839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-613ac24b-aafd-41a5-80fc-84a765a1428f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:19.178562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-613ac24b-aafd-41a5-80fc-84a765a1428f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:19.184767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-613ac24b-aafd-41a5-80fc-84a765a1428f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:19.185208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-613ac24b-aafd-41a5-80fc-84a765a1428f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:19.185989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-613ac24b-aafd-41a5-80fc-84a765a1428f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:19.186449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-613ac24b-aafd-41a5-80fc-84a765a1428f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:19.247246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-613ac24b-aafd-41a5-80fc-84a765a1428f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:19.255781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-613ac24b-aafd-41a5-80fc-84a765a1428f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082537 Jul 14 10:08:19.256342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 889/1769] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:19 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:19.415191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:19.415805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:19.422170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:19.422656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:19.423420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:19.423859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:19.483317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:19.491590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:19.493089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:19.494245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c9d6e749-d91f-4f5b-9f01-912b310c5559 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.082931 Jul 14 10:08:19.494796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 881/1770] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:19.711718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3352f5bc-add7-4105-b39c-1699460b60cb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:19.712351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3352f5bc-add7-4105-b39c-1699460b60cb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:19.718816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3352f5bc-add7-4105-b39c-1699460b60cb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:19.719254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3352f5bc-add7-4105-b39c-1699460b60cb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:19.720002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3352f5bc-add7-4105-b39c-1699460b60cb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:19.720428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3352f5bc-add7-4105-b39c-1699460b60cb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:19.850315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3352f5bc-add7-4105-b39c-1699460b60cb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:19.858314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3352f5bc-add7-4105-b39c-1699460b60cb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150429 Jul 14 10:08:19.858876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 890/1771] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:19 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:20.272728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-63b6e04a-5cdc-47a6-94ee-56ef26f6acd9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:20.273419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-63b6e04a-5cdc-47a6-94ee-56ef26f6acd9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:20.280187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63b6e04a-5cdc-47a6-94ee-56ef26f6acd9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:20.280630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63b6e04a-5cdc-47a6-94ee-56ef26f6acd9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:20.281400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63b6e04a-5cdc-47a6-94ee-56ef26f6acd9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:20.281836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63b6e04a-5cdc-47a6-94ee-56ef26f6acd9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:20.342330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-63b6e04a-5cdc-47a6-94ee-56ef26f6acd9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:20.350748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-63b6e04a-5cdc-47a6-94ee-56ef26f6acd9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081848 Jul 14 10:08:20.351312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 882/1772] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:20 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:20.512225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:20.512821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:20.519153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:20.519593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:20.520559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:20.520985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:20.584893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:20.593516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:20.595052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:20.596272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2a6af0e6-39d7-4a29-b148-716b199ab71d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088029 Jul 14 10:08:20.597354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 891/1773] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:20.875842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-794eafb8-dfc3-4d27-9ad2-d6691dab39ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:20.876363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-794eafb8-dfc3-4d27-9ad2-d6691dab39ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:20.883112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-794eafb8-dfc3-4d27-9ad2-d6691dab39ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:20.883555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-794eafb8-dfc3-4d27-9ad2-d6691dab39ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:20.884346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-794eafb8-dfc3-4d27-9ad2-d6691dab39ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:20.884752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-794eafb8-dfc3-4d27-9ad2-d6691dab39ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:21.012762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-794eafb8-dfc3-4d27-9ad2-d6691dab39ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:21.020780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-794eafb8-dfc3-4d27-9ad2-d6691dab39ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148915 Jul 14 10:08:21.021347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 883/1774] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:20 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:21.367620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-02de8aec-a364-446a-b155-8c11a2e6b2da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:21.368222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-02de8aec-a364-446a-b155-8c11a2e6b2da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:21.374705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02de8aec-a364-446a-b155-8c11a2e6b2da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:21.375141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02de8aec-a364-446a-b155-8c11a2e6b2da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:21.375890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02de8aec-a364-446a-b155-8c11a2e6b2da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:21.376317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02de8aec-a364-446a-b155-8c11a2e6b2da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:21.378968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:21.438019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-02de8aec-a364-446a-b155-8c11a2e6b2da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:21.446013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-02de8aec-a364-446a-b155-8c11a2e6b2da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082224 Jul 14 10:08:21.446596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 892/1775] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:21 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:21.614588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:21.615195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:21.621726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:21.622155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:21.622953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:21.623389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:21.683833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:21.692390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:21.693833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:21.695005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0b635b63-e122-404a-bcd1-bf5d5fca665f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084331 Jul 14 10:08:21.695563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 884/1776] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:22.037552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-496717b7-e67d-4cff-9f6b-46e57d24fb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:22.038166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-496717b7-e67d-4cff-9f6b-46e57d24fb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:22.044469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-496717b7-e67d-4cff-9f6b-46e57d24fb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:22.044907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-496717b7-e67d-4cff-9f6b-46e57d24fb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:22.045653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-496717b7-e67d-4cff-9f6b-46e57d24fb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:22.046079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-496717b7-e67d-4cff-9f6b-46e57d24fb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:22.176693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-496717b7-e67d-4cff-9f6b-46e57d24fb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:22.184800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-496717b7-e67d-4cff-9f6b-46e57d24fb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151054 Jul 14 10:08:22.185367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 893/1777] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:22 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:22.462867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4dbd4518-09a4-49c7-b49c-4ddf34a31128 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:22.463482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4dbd4518-09a4-49c7-b49c-4ddf34a31128 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:22.469812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4dbd4518-09a4-49c7-b49c-4ddf34a31128 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:22.470351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4dbd4518-09a4-49c7-b49c-4ddf34a31128 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:22.471171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4dbd4518-09a4-49c7-b49c-4ddf34a31128 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:22.471606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4dbd4518-09a4-49c7-b49c-4ddf34a31128 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:22.534585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4dbd4518-09a4-49c7-b49c-4ddf34a31128 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:22.542778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4dbd4518-09a4-49c7-b49c-4ddf34a31128 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083754 Jul 14 10:08:22.543591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 885/1778] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:22 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:22.713014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:22.713553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:22.720660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:22.721096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:22.722417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:22.722920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:22.785715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:22.794565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:22.796069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:22.797240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b96461dd-3fc5-4308-b84e-6db70db476af tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088217 Jul 14 10:08:22.797798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 894/1779] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:23.203221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-38f1c72b-32ad-4f6a-a1f9-eda426dee2e9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:23.203834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-38f1c72b-32ad-4f6a-a1f9-eda426dee2e9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:23.211043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38f1c72b-32ad-4f6a-a1f9-eda426dee2e9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:23.211489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38f1c72b-32ad-4f6a-a1f9-eda426dee2e9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:23.212243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38f1c72b-32ad-4f6a-a1f9-eda426dee2e9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:23.212668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38f1c72b-32ad-4f6a-a1f9-eda426dee2e9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:23.342613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-38f1c72b-32ad-4f6a-a1f9-eda426dee2e9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:23.351145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-38f1c72b-32ad-4f6a-a1f9-eda426dee2e9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.152406 Jul 14 10:08:23.351712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 886/1780] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:23 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:23.559957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-740d7076-0855-4a07-950b-083fba0658e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:23.560646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-740d7076-0855-4a07-950b-083fba0658e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:23.567440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-740d7076-0855-4a07-950b-083fba0658e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:23.567883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-740d7076-0855-4a07-950b-083fba0658e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:23.568654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-740d7076-0855-4a07-950b-083fba0658e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:23.569088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-740d7076-0855-4a07-950b-083fba0658e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:23.633382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-740d7076-0855-4a07-950b-083fba0658e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:23.641320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-740d7076-0855-4a07-950b-083fba0658e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085569 Jul 14 10:08:23.641874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 895/1781] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:23 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:23.815359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:23.815825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:23.822587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:23.823035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:23.823824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:23.824263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:23.885858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:23.894280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:23.895798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:23.896929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ada91d34-73dc-47aa-a38b-161a6b2dc6f8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085675 Jul 14 10:08:23.897486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 887/1782] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:24.369181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d78e1037-62c9-446f-8839-a7bf6d15ab69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.369787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d78e1037-62c9-446f-8839-a7bf6d15ab69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:24.376352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d78e1037-62c9-446f-8839-a7bf6d15ab69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:24.376790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d78e1037-62c9-446f-8839-a7bf6d15ab69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:24.377538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d78e1037-62c9-446f-8839-a7bf6d15ab69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:24.377966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d78e1037-62c9-446f-8839-a7bf6d15ab69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:24.503747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d78e1037-62c9-446f-8839-a7bf6d15ab69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:24.512131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d78e1037-62c9-446f-8839-a7bf6d15ab69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146867 Jul 14 10:08:24.512685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 896/1783] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:24.659126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6cc9938d-5cc1-43aa-b1fe-72d20acfcc37 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.659675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6cc9938d-5cc1-43aa-b1fe-72d20acfcc37 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:24.666122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6cc9938d-5cc1-43aa-b1fe-72d20acfcc37 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:24.666596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6cc9938d-5cc1-43aa-b1fe-72d20acfcc37 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:24.667351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6cc9938d-5cc1-43aa-b1fe-72d20acfcc37 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:24.667783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6cc9938d-5cc1-43aa-b1fe-72d20acfcc37 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:24.683149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:24.731506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6cc9938d-5cc1-43aa-b1fe-72d20acfcc37 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:24.739878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6cc9938d-5cc1-43aa-b1fe-72d20acfcc37 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084252 Jul 14 10:08:24.740432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 888/1784] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:24.914927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.915454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:24.921891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:24.922371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:24.923124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:24.923549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:24.984755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:24.993183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:24.994701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:24.995824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-42418ed6-ae39-4386-985e-b48f1bd15e43 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084903 Jul 14 10:08:24.996377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 897/1785] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:25.529113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b5e4d3f2-cb28-4a40-8026-cdff40997083 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:25.529718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b5e4d3f2-cb28-4a40-8026-cdff40997083 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:25.536433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5e4d3f2-cb28-4a40-8026-cdff40997083 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:25.536875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5e4d3f2-cb28-4a40-8026-cdff40997083 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:25.537624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5e4d3f2-cb28-4a40-8026-cdff40997083 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:25.538051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5e4d3f2-cb28-4a40-8026-cdff40997083 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:25.663541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b5e4d3f2-cb28-4a40-8026-cdff40997083 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:25.672154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b5e4d3f2-cb28-4a40-8026-cdff40997083 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146910 Jul 14 10:08:25.672723 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 889/1786] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:25 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:25.756649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b120a45e-82f3-45bf-aacf-acb9434ac289 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:25.757253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b120a45e-82f3-45bf-aacf-acb9434ac289 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:25.763674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b120a45e-82f3-45bf-aacf-acb9434ac289 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:25.764113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b120a45e-82f3-45bf-aacf-acb9434ac289 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:25.764858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b120a45e-82f3-45bf-aacf-acb9434ac289 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:25.765317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b120a45e-82f3-45bf-aacf-acb9434ac289 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:25.825563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b120a45e-82f3-45bf-aacf-acb9434ac289 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:25.833566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b120a45e-82f3-45bf-aacf-acb9434ac289 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.080861 Jul 14 10:08:25.834124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 898/1787] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:25 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:26.014557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:26.015162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:26.021662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:26.022120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:26.022903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:26.023346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:26.086662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:26.095665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:26.097269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:26.099104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7ec14f5c-d629-48f0-84b9-f8edca0f4ebe tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087776 Jul 14 10:08:26.099678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 890/1788] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:26.689734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-797239c6-9407-4f17-a381-2ce41ee84012 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:26.690376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-797239c6-9407-4f17-a381-2ce41ee84012 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:26.696371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-797239c6-9407-4f17-a381-2ce41ee84012 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:26.696809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-797239c6-9407-4f17-a381-2ce41ee84012 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:26.697557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-797239c6-9407-4f17-a381-2ce41ee84012 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:26.697981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-797239c6-9407-4f17-a381-2ce41ee84012 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:26.825059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-797239c6-9407-4f17-a381-2ce41ee84012 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:26.833465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-797239c6-9407-4f17-a381-2ce41ee84012 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147082 Jul 14 10:08:26.834018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 899/1789] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:26 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:26.850908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9f5797e2-cd59-4d4b-afde-5617e74cb280 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:26.851512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9f5797e2-cd59-4d4b-afde-5617e74cb280 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:26.857946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f5797e2-cd59-4d4b-afde-5617e74cb280 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:26.858431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f5797e2-cd59-4d4b-afde-5617e74cb280 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:26.859187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f5797e2-cd59-4d4b-afde-5617e74cb280 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:26.859617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f5797e2-cd59-4d4b-afde-5617e74cb280 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:26.920685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9f5797e2-cd59-4d4b-afde-5617e74cb280 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:26.928600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9f5797e2-cd59-4d4b-afde-5617e74cb280 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082237 Jul 14 10:08:26.929156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 891/1790] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:26 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:27.117245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:27.117767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:27.124040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:27.124482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:27.125231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:27.125658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:27.186963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:27.195886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:27.197405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:27.198570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1660f52e-12bb-4e0c-81cf-fb64ad0781e9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085368 Jul 14 10:08:27.199137 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 900/1791] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:27.850237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3f33765b-64ba-4a42-bb28-d691e61f9720 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:27.850815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3f33765b-64ba-4a42-bb28-d691e61f9720 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:27.856996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f33765b-64ba-4a42-bb28-d691e61f9720 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:27.857542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f33765b-64ba-4a42-bb28-d691e61f9720 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:27.858211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f33765b-64ba-4a42-bb28-d691e61f9720 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:27.858666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f33765b-64ba-4a42-bb28-d691e61f9720 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:27.944851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c11fad51-0d8d-4e94-9140-f3baddd0d317 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:27.945565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c11fad51-0d8d-4e94-9140-f3baddd0d317 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:27.952221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c11fad51-0d8d-4e94-9140-f3baddd0d317 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:27.952660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c11fad51-0d8d-4e94-9140-f3baddd0d317 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:27.953419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c11fad51-0d8d-4e94-9140-f3baddd0d317 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:27.953847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c11fad51-0d8d-4e94-9140-f3baddd0d317 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:27.990064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3f33765b-64ba-4a42-bb28-d691e61f9720 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:27.998110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3f33765b-64ba-4a42-bb28-d691e61f9720 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.152297 Jul 14 10:08:27.998717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 892/1792] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:27 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:28.018917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c11fad51-0d8d-4e94-9140-f3baddd0d317 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:28.027939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c11fad51-0d8d-4e94-9140-f3baddd0d317 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087004 Jul 14 10:08:28.028508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 901/1793] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:27 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:28.216857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:28.217498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:28.223631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:28.224071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:28.224825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:28.225251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:28.284765 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:28.293112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:28.294910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:28.296039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e23e0bae-5061-43de-8b1e-618130673560 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.083137 Jul 14 10:08:28.296595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 893/1794] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:29.015470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2d87cb73-adc5-482e-8964-a33a8a34d2ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:29.016078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2d87cb73-adc5-482e-8964-a33a8a34d2ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:29.023215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d87cb73-adc5-482e-8964-a33a8a34d2ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:29.023653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d87cb73-adc5-482e-8964-a33a8a34d2ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:29.024403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d87cb73-adc5-482e-8964-a33a8a34d2ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:29.024831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d87cb73-adc5-482e-8964-a33a8a34d2ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:29.045019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5d927cf0-9227-4a61-9646-5ebfdc27533a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:29.045716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5d927cf0-9227-4a61-9646-5ebfdc27533a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:29.052166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d927cf0-9227-4a61-9646-5ebfdc27533a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:29.052614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d927cf0-9227-4a61-9646-5ebfdc27533a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:29.053374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d927cf0-9227-4a61-9646-5ebfdc27533a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:29.053809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d927cf0-9227-4a61-9646-5ebfdc27533a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:29.123489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5d927cf0-9227-4a61-9646-5ebfdc27533a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:29.134659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5d927cf0-9227-4a61-9646-5ebfdc27533a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.093578 Jul 14 10:08:29.135242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 894/1795] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:29 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:29.182462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2d87cb73-adc5-482e-8964-a33a8a34d2ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:29.190362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2d87cb73-adc5-482e-8964-a33a8a34d2ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.178736 Jul 14 10:08:29.190919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 902/1796] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:29 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:29.317766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:29.318313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:29.324283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:29.324722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:29.325468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:29.325894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:29.387073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:29.395985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:29.397494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:29.398678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-308cce42-e982-47b7-8079-050b3e0f6aeb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085773 Jul 14 10:08:29.399238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 895/1797] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:30.151434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-892c971c-fea2-430d-9eb4-3537d9a60f9c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:30.152047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-892c971c-fea2-430d-9eb4-3537d9a60f9c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:30.158642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-892c971c-fea2-430d-9eb4-3537d9a60f9c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:30.159090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-892c971c-fea2-430d-9eb4-3537d9a60f9c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:30.159850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-892c971c-fea2-430d-9eb4-3537d9a60f9c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:30.160285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-892c971c-fea2-430d-9eb4-3537d9a60f9c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:30.207225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e9d9ac4f-a97a-402a-97ba-13698fbb7051 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:30.207933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e9d9ac4f-a97a-402a-97ba-13698fbb7051 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:30.214591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e9d9ac4f-a97a-402a-97ba-13698fbb7051 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:30.215045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e9d9ac4f-a97a-402a-97ba-13698fbb7051 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:30.215815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e9d9ac4f-a97a-402a-97ba-13698fbb7051 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:30.216251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e9d9ac4f-a97a-402a-97ba-13698fbb7051 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:30.225275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-892c971c-fea2-430d-9eb4-3537d9a60f9c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:30.233247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-892c971c-fea2-430d-9eb4-3537d9a60f9c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085746 Jul 14 10:08:30.233810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 903/1798] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:30 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:30.341757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e9d9ac4f-a97a-402a-97ba-13698fbb7051 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:30.350349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e9d9ac4f-a97a-402a-97ba-13698fbb7051 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146960 Jul 14 10:08:30.350917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 896/1799] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:30 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:30.417201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:30.417726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:30.424016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:30.424451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:30.425204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:30.425630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:30.486024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:30.494410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:30.495897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:30.497014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b5db3a09-a357-4349-a789-47e98dd3143f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.083793 Jul 14 10:08:30.497685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 904/1800] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:31.250941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f5d1fcd7-be6a-4afa-b2b7-84c47ee45a25 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:31.251538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f5d1fcd7-be6a-4afa-b2b7-84c47ee45a25 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:31.258063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f5d1fcd7-be6a-4afa-b2b7-84c47ee45a25 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:31.258541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f5d1fcd7-be6a-4afa-b2b7-84c47ee45a25 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:31.259297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f5d1fcd7-be6a-4afa-b2b7-84c47ee45a25 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:31.259733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f5d1fcd7-be6a-4afa-b2b7-84c47ee45a25 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:31.320448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f5d1fcd7-be6a-4afa-b2b7-84c47ee45a25 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:31.328310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f5d1fcd7-be6a-4afa-b2b7-84c47ee45a25 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081229 Jul 14 10:08:31.328866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 897/1801] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:31 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:31.367645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-07fe4a0f-657f-4c7c-b7ae-48330406276e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:31.368245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-07fe4a0f-657f-4c7c-b7ae-48330406276e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:31.374349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07fe4a0f-657f-4c7c-b7ae-48330406276e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:31.374792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07fe4a0f-657f-4c7c-b7ae-48330406276e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:31.375544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07fe4a0f-657f-4c7c-b7ae-48330406276e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:31.375970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07fe4a0f-657f-4c7c-b7ae-48330406276e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:31.503938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-07fe4a0f-657f-4c7c-b7ae-48330406276e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:31.512484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-07fe4a0f-657f-4c7c-b7ae-48330406276e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148939 Jul 14 10:08:31.513046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 905/1802] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:31 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:31.514895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:31.515506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:31.522509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:31.522965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:31.523730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:31.524168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:31.584870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:31.593151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:31.594743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:31.595949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5c0818ed-66c2-4a47-889e-ec9d7126e163 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084852 Jul 14 10:08:31.596525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 898/1803] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:32.345043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-54cc82b1-6650-4e13-988e-9688daa6fec1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:32.345665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-54cc82b1-6650-4e13-988e-9688daa6fec1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:32.352164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54cc82b1-6650-4e13-988e-9688daa6fec1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:32.352602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54cc82b1-6650-4e13-988e-9688daa6fec1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:32.353345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54cc82b1-6650-4e13-988e-9688daa6fec1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:32.353772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54cc82b1-6650-4e13-988e-9688daa6fec1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:32.415647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-54cc82b1-6650-4e13-988e-9688daa6fec1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:32.423833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-54cc82b1-6650-4e13-988e-9688daa6fec1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082644 Jul 14 10:08:32.424387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 906/1804] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:32 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:32.530243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2eeba392-ac68-4b69-a938-91d8e25605bb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:32.530856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2eeba392-ac68-4b69-a938-91d8e25605bb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:32.537941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2eeba392-ac68-4b69-a938-91d8e25605bb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:32.538418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2eeba392-ac68-4b69-a938-91d8e25605bb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:32.539183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2eeba392-ac68-4b69-a938-91d8e25605bb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:32.539618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2eeba392-ac68-4b69-a938-91d8e25605bb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:32.614107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:32.615218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:32.621198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:32.621650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:32.622435 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:32.622867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:32.694711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:32.698337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2eeba392-ac68-4b69-a938-91d8e25605bb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:32.703219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:32.704719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:32.705854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7346b5fc-2479-4a69-960d-e460aac8f14e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.095794 Jul 14 10:08:32.706454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 907/1805] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:32.706622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2eeba392-ac68-4b69-a938-91d8e25605bb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.180169 Jul 14 10:08:32.707246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 899/1806] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:32 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:33.440927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-490fe6e9-5ea9-4da9-95d9-1162911429bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:33.441523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-490fe6e9-5ea9-4da9-95d9-1162911429bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:33.448630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-490fe6e9-5ea9-4da9-95d9-1162911429bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:33.449074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-490fe6e9-5ea9-4da9-95d9-1162911429bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:33.449826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-490fe6e9-5ea9-4da9-95d9-1162911429bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:33.450283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-490fe6e9-5ea9-4da9-95d9-1162911429bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:33.511100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-490fe6e9-5ea9-4da9-95d9-1162911429bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:33.513227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:33.520138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-490fe6e9-5ea9-4da9-95d9-1162911429bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083094 Jul 14 10:08:33.520697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 908/1807] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:33 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:33.724675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-62abe759-38d2-4b39-8370-b9bb03ed60ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:33.725229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:33.725335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-62abe759-38d2-4b39-8370-b9bb03ed60ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:33.725641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:33.731908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62abe759-38d2-4b39-8370-b9bb03ed60ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:33.732081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:33.732349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:33.732454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62abe759-38d2-4b39-8370-b9bb03ed60ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:33.733106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:33.733207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62abe759-38d2-4b39-8370-b9bb03ed60ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:33.733538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:33.733648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62abe759-38d2-4b39-8370-b9bb03ed60ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:33.819724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:33.828194 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:33.829702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:33.830928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4eefc579-b633-488a-b6c1-b1892bbbacd5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.110296 Jul 14 10:08:33.831480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 909/1808] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:33.885183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-62abe759-38d2-4b39-8370-b9bb03ed60ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:33.893086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-62abe759-38d2-4b39-8370-b9bb03ed60ff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.172860 Jul 14 10:08:33.893646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 900/1809] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:33 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:34.537784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4e1f8faa-d941-41ac-a8c5-d4b0a7ca60ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:34.538494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4e1f8faa-d941-41ac-a8c5-d4b0a7ca60ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:34.545398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e1f8faa-d941-41ac-a8c5-d4b0a7ca60ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:34.545837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e1f8faa-d941-41ac-a8c5-d4b0a7ca60ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:34.546616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e1f8faa-d941-41ac-a8c5-d4b0a7ca60ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:34.547048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4e1f8faa-d941-41ac-a8c5-d4b0a7ca60ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:34.608357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4e1f8faa-d941-41ac-a8c5-d4b0a7ca60ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:34.616847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4e1f8faa-d941-41ac-a8c5-d4b0a7ca60ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083495 Jul 14 10:08:34.617412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 910/1810] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:34 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:34.848975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:34.849582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:34.856164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:34.856606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:34.857362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:34.857795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:34.910022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d2c9c8d6-670b-46c6-9a6f-9cfceafd6cff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:34.910713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d2c9c8d6-670b-46c6-9a6f-9cfceafd6cff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:34.916884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2c9c8d6-670b-46c6-9a6f-9cfceafd6cff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:34.917326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2c9c8d6-670b-46c6-9a6f-9cfceafd6cff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:34.918083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2c9c8d6-670b-46c6-9a6f-9cfceafd6cff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:34.918380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:34.918788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d2c9c8d6-670b-46c6-9a6f-9cfceafd6cff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:34.927757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:34.929321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:34.930482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fc950d54-56dd-42b8-a27f-117eff53524b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085472 Jul 14 10:08:34.931045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 901/1811] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:35.045281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d2c9c8d6-670b-46c6-9a6f-9cfceafd6cff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:35.053676 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d2c9c8d6-670b-46c6-9a6f-9cfceafd6cff tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147470 Jul 14 10:08:35.054262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 911/1812] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:34 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:35.633008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5416e789-0221-4126-bb2b-6d79c684ac41 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:35.633610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5416e789-0221-4126-bb2b-6d79c684ac41 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:35.639601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5416e789-0221-4126-bb2b-6d79c684ac41 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:35.640046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5416e789-0221-4126-bb2b-6d79c684ac41 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:35.640797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5416e789-0221-4126-bb2b-6d79c684ac41 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:35.641227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5416e789-0221-4126-bb2b-6d79c684ac41 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:35.702745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5416e789-0221-4126-bb2b-6d79c684ac41 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:35.711130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5416e789-0221-4126-bb2b-6d79c684ac41 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082125 Jul 14 10:08:35.711688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 902/1813] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:35 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:35.948624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:35.949212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:35.955719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:35.956163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:35.956924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:35.957357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:36.018617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:36.027694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:36.029195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:36.030356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0509c4fc-187f-4f98-9c0f-a80b77129f9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085678 Jul 14 10:08:36.030914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 912/1814] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:36.070524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9729495f-ab93-4a5f-b617-f71501aae337 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:36.071133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9729495f-ab93-4a5f-b617-f71501aae337 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:36.077530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9729495f-ab93-4a5f-b617-f71501aae337 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:36.077976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9729495f-ab93-4a5f-b617-f71501aae337 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:36.078774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9729495f-ab93-4a5f-b617-f71501aae337 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:36.079207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9729495f-ab93-4a5f-b617-f71501aae337 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:36.209630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9729495f-ab93-4a5f-b617-f71501aae337 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:36.217721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9729495f-ab93-4a5f-b617-f71501aae337 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151551 Jul 14 10:08:36.218316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 903/1815] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:36 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:36.728809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-332fae48-353b-490f-9528-5d61c2d4c993 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:36.729416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-332fae48-353b-490f-9528-5d61c2d4c993 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:36.735922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-332fae48-353b-490f-9528-5d61c2d4c993 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:36.736360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-332fae48-353b-490f-9528-5d61c2d4c993 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:36.737118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-332fae48-353b-490f-9528-5d61c2d4c993 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:36.737544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-332fae48-353b-490f-9528-5d61c2d4c993 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:36.798894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-332fae48-353b-490f-9528-5d61c2d4c993 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:36.807298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-332fae48-353b-490f-9528-5d61c2d4c993 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082654 Jul 14 10:08:36.807853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 913/1816] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:36 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:37.047589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:37.048186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:37.055174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:37.055620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:37.056384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:37.056816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:37.121174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:37.129770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:37.131329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:37.132490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8f8e51ff-584c-41f3-912e-f4888a45c7e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089064 Jul 14 10:08:37.133045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 904/1817] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:37.234925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-22d207a9-8b2f-4a09-9e0a-c116bd4ce4e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:37.235505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-22d207a9-8b2f-4a09-9e0a-c116bd4ce4e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:37.242125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22d207a9-8b2f-4a09-9e0a-c116bd4ce4e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:37.242593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22d207a9-8b2f-4a09-9e0a-c116bd4ce4e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:37.243360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22d207a9-8b2f-4a09-9e0a-c116bd4ce4e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:37.243810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22d207a9-8b2f-4a09-9e0a-c116bd4ce4e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:37.376770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-22d207a9-8b2f-4a09-9e0a-c116bd4ce4e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:37.384959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-22d207a9-8b2f-4a09-9e0a-c116bd4ce4e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153850 Jul 14 10:08:37.385517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 914/1818] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:37 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:37.824324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3609a728-1b4b-4378-bb36-e0064a89e2b0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:37.824946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3609a728-1b4b-4378-bb36-e0064a89e2b0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:37.831065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3609a728-1b4b-4378-bb36-e0064a89e2b0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:37.831508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3609a728-1b4b-4378-bb36-e0064a89e2b0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:37.832272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3609a728-1b4b-4378-bb36-e0064a89e2b0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:37.832706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3609a728-1b4b-4378-bb36-e0064a89e2b0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:37.837199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:37.894757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3609a728-1b4b-4378-bb36-e0064a89e2b0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:37.902746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3609a728-1b4b-4378-bb36-e0064a89e2b0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082367 Jul 14 10:08:37.903313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 905/1819] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:37 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:38.151379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:38.151902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:38.158072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:38.158556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:38.159327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:38.159764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:38.222928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:38.232263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:38.233752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:38.234929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-98d80877-fd4e-4ba5-9d67-4f352c28bf9c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087634 Jul 14 10:08:38.235490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 915/1820] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:38.402804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9efe9cb3-75b7-45a5-be1e-56f788cd4653 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:38.403356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9efe9cb3-75b7-45a5-be1e-56f788cd4653 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:38.409828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9efe9cb3-75b7-45a5-be1e-56f788cd4653 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:38.410283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9efe9cb3-75b7-45a5-be1e-56f788cd4653 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:38.411036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9efe9cb3-75b7-45a5-be1e-56f788cd4653 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:38.411549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9efe9cb3-75b7-45a5-be1e-56f788cd4653 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:38.797866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9efe9cb3-75b7-45a5-be1e-56f788cd4653 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:38.806425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9efe9cb3-75b7-45a5-be1e-56f788cd4653 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.407566 Jul 14 10:08:38.806999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 906/1821] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:38 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:38.919535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-57516e68-fbb8-4b00-8468-cd82e5c1f6d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:38.920190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-57516e68-fbb8-4b00-8468-cd82e5c1f6d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:38.927291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-57516e68-fbb8-4b00-8468-cd82e5c1f6d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:38.927753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-57516e68-fbb8-4b00-8468-cd82e5c1f6d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:38.928525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-57516e68-fbb8-4b00-8468-cd82e5c1f6d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:38.928954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-57516e68-fbb8-4b00-8468-cd82e5c1f6d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:38.991492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-57516e68-fbb8-4b00-8468-cd82e5c1f6d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:38.999761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-57516e68-fbb8-4b00-8468-cd82e5c1f6d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084537 Jul 14 10:08:39.000537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 916/1822] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:38 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:39.253099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:39.253743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:39.260088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:39.260538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:39.261307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:39.261743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:39.325503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:39.334001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:39.335532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:39.336660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a9134dac-7c00-49ca-bd26-14f86fca0a7b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087606 Jul 14 10:08:39.337221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 907/1823] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:39.824402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-99341fa0-2a54-4aea-b79b-87e060bae6c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:39.824950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-99341fa0-2a54-4aea-b79b-87e060bae6c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:39.830972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-99341fa0-2a54-4aea-b79b-87e060bae6c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:39.831411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-99341fa0-2a54-4aea-b79b-87e060bae6c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:39.832233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-99341fa0-2a54-4aea-b79b-87e060bae6c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:39.832656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-99341fa0-2a54-4aea-b79b-87e060bae6c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:39.963760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-99341fa0-2a54-4aea-b79b-87e060bae6c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:39.971663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-99341fa0-2a54-4aea-b79b-87e060bae6c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151245 Jul 14 10:08:39.972223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 917/1824] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:39 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:40.017159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e915d0af-2972-4dd5-a692-a58e7e129eef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:40.017772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e915d0af-2972-4dd5-a692-a58e7e129eef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:40.025032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e915d0af-2972-4dd5-a692-a58e7e129eef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:40.025484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e915d0af-2972-4dd5-a692-a58e7e129eef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:40.026303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e915d0af-2972-4dd5-a692-a58e7e129eef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:40.026746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e915d0af-2972-4dd5-a692-a58e7e129eef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:40.092265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e915d0af-2972-4dd5-a692-a58e7e129eef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:40.104592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e915d0af-2972-4dd5-a692-a58e7e129eef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091100 Jul 14 10:08:40.105397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 908/1825] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:40 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:40.354824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:40.355345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:40.361423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:40.361863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:40.362665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:40.363097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:40.425339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:40.435439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:40.436930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:40.438057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-90a9fb71-b37b-4797-b4d8-45df8850738d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087219 Jul 14 10:08:40.438632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 918/1826] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:40.988915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b6a1f863-de42-41db-ab39-5a69995b791f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:40.990023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b6a1f863-de42-41db-ab39-5a69995b791f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:40.996124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b6a1f863-de42-41db-ab39-5a69995b791f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:40.996570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b6a1f863-de42-41db-ab39-5a69995b791f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:40.997326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b6a1f863-de42-41db-ab39-5a69995b791f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:40.997753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b6a1f863-de42-41db-ab39-5a69995b791f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:41.124382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48469739-dc99-4280-9172-ffcbba8f875e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:41.125131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-48469739-dc99-4280-9172-ffcbba8f875e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:41.131474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b6a1f863-de42-41db-ab39-5a69995b791f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:41.132505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48469739-dc99-4280-9172-ffcbba8f875e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:41.132945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48469739-dc99-4280-9172-ffcbba8f875e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:41.133707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48469739-dc99-4280-9172-ffcbba8f875e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:41.134135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48469739-dc99-4280-9172-ffcbba8f875e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:41.139926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b6a1f863-de42-41db-ab39-5a69995b791f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154970 Jul 14 10:08:41.140569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 909/1827] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:40 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:41.195517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-48469739-dc99-4280-9172-ffcbba8f875e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:41.203336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-48469739-dc99-4280-9172-ffcbba8f875e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085196 Jul 14 10:08:41.203886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 919/1828] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:41.455863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:41.456469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:41.462777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:41.463222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:41.464005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:41.464436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:41.527290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:41.535865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:41.537856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:41.539025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-37f83ea0-10d6-4a71-8d6d-5482e3d9fa04 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087093 Jul 14 10:08:41.539582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 910/1829] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:42.157141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-498b491b-94e7-4243-9f84-370fe6471a0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:42.157784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-498b491b-94e7-4243-9f84-370fe6471a0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:42.164275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-498b491b-94e7-4243-9f84-370fe6471a0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:42.164715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-498b491b-94e7-4243-9f84-370fe6471a0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:42.165470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-498b491b-94e7-4243-9f84-370fe6471a0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:42.165898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-498b491b-94e7-4243-9f84-370fe6471a0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:42.220558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a5808ca0-2471-487d-bcad-e5613f79eb62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:42.221169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a5808ca0-2471-487d-bcad-e5613f79eb62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:42.227695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5808ca0-2471-487d-bcad-e5613f79eb62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:42.228133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5808ca0-2471-487d-bcad-e5613f79eb62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:42.228895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5808ca0-2471-487d-bcad-e5613f79eb62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:42.229318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5808ca0-2471-487d-bcad-e5613f79eb62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:42.299060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a5808ca0-2471-487d-bcad-e5613f79eb62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:42.307432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a5808ca0-2471-487d-bcad-e5613f79eb62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091284 Jul 14 10:08:42.308008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 911/1830] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:42 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:42.322072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-498b491b-94e7-4243-9f84-370fe6471a0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:42.329934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-498b491b-94e7-4243-9f84-370fe6471a0b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.176686 Jul 14 10:08:42.330585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 920/1831] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:42 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:42.557896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:42.558457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:42.564508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:42.564963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:42.565732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:42.566163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:42.626839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:42.635819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:42.637334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:42.638505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7956a095-4997-45c9-9632-80cb789914b0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084637 Jul 14 10:08:42.639063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 912/1832] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:43.324406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-53642b00-1d95-4a0d-b36f-5ed49205d09a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:43.325013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-53642b00-1d95-4a0d-b36f-5ed49205d09a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:43.331542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-53642b00-1d95-4a0d-b36f-5ed49205d09a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:43.331987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-53642b00-1d95-4a0d-b36f-5ed49205d09a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:43.332740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-53642b00-1d95-4a0d-b36f-5ed49205d09a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:43.333679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-53642b00-1d95-4a0d-b36f-5ed49205d09a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:43.347376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ba2f30c8-e2cf-4b76-9ee0-46780d799f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:43.347976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ba2f30c8-e2cf-4b76-9ee0-46780d799f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:43.355088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba2f30c8-e2cf-4b76-9ee0-46780d799f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:43.355532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba2f30c8-e2cf-4b76-9ee0-46780d799f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:43.356294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba2f30c8-e2cf-4b76-9ee0-46780d799f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:43.356724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba2f30c8-e2cf-4b76-9ee0-46780d799f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:43.405274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-53642b00-1d95-4a0d-b36f-5ed49205d09a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:43.414127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-53642b00-1d95-4a0d-b36f-5ed49205d09a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.093534 Jul 14 10:08:43.421798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 921/1833] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:43.490743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ba2f30c8-e2cf-4b76-9ee0-46780d799f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:43.498602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ba2f30c8-e2cf-4b76-9ee0-46780d799f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155015 Jul 14 10:08:43.499160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 913/1834] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:43 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:43.656634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:43.657178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:43.663195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:43.663638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:43.664397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:43.664824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:43.727284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:43.735754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:43.737499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:43.738678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-58ed4b18-d1da-4250-a8c1-cb85c33dc09b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086041 Jul 14 10:08:43.739242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 922/1835] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:44.431994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5d24c585-f734-4616-af00-97f7cefe5d58 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:44.432598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5d24c585-f734-4616-af00-97f7cefe5d58 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:44.439284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d24c585-f734-4616-af00-97f7cefe5d58 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.439812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d24c585-f734-4616-af00-97f7cefe5d58 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.440575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d24c585-f734-4616-af00-97f7cefe5d58 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.441001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5d24c585-f734-4616-af00-97f7cefe5d58 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.509230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5d24c585-f734-4616-af00-97f7cefe5d58 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:44.517338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e471df1d-20d4-47d3-bac7-62267ab8e8e6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:44.517812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e471df1d-20d4-47d3-bac7-62267ab8e8e6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:44.519705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5d24c585-f734-4616-af00-97f7cefe5d58 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091535 Jul 14 10:08:44.530244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 914/1836] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:44 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:44.530596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e471df1d-20d4-47d3-bac7-62267ab8e8e6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.530596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e471df1d-20d4-47d3-bac7-62267ab8e8e6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.530794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e471df1d-20d4-47d3-bac7-62267ab8e8e6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.531475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e471df1d-20d4-47d3-bac7-62267ab8e8e6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.534008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-129212a5-0537-4c7f-9aa7-f2e0eafaf306 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:44.534541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-129212a5-0537-4c7f-9aa7-f2e0eafaf306 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:44.542642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-129212a5-0537-4c7f-9aa7-f2e0eafaf306 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.543095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-129212a5-0537-4c7f-9aa7-f2e0eafaf306 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.544141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-129212a5-0537-4c7f-9aa7-f2e0eafaf306 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.544581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-129212a5-0537-4c7f-9aa7-f2e0eafaf306 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.575487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-129212a5-0537-4c7f-9aa7-f2e0eafaf306 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:08:44.672085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-129212a5-0537-4c7f-9aa7-f2e0eafaf306 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 204 len: 0 microversion: 2.1 time: 0.141738 Jul 14 10:08:44.672647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 915/1837] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:08:44 2022] DELETE /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:08:44.681268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b33952d9-2c03-4dff-9218-28e5e64dcb53 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:44.682248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b33952d9-2c03-4dff-9218-28e5e64dcb53 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:44.688228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b33952d9-2c03-4dff-9218-28e5e64dcb53 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.688677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b33952d9-2c03-4dff-9218-28e5e64dcb53 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.689597 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b33952d9-2c03-4dff-9218-28e5e64dcb53 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.690038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b33952d9-2c03-4dff-9218-28e5e64dcb53 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.705057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e471df1d-20d4-47d3-bac7-62267ab8e8e6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:44.718428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e471df1d-20d4-47d3-bac7-62267ab8e8e6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.205846 Jul 14 10:08:44.727639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 923/1838] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:44 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:44.759371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:44.760087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:44.768311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.768850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.770268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:44.771807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:44.847649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:44.859346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:44.860971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:44.862095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b33952d9-2c03-4dff-9218-28e5e64dcb53 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:44.862368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eb5fff8f-58e4-40d3-aa45-4fbfc3875e76 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.109356 Jul 14 10:08:44.863121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 924/1839] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:44.871774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b33952d9-2c03-4dff-9218-28e5e64dcb53 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.194760 Jul 14 10:08:44.872590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 916/1840] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:45.536752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e6f60aa3-9c73-46f8-8f0c-a2b6af823629 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:45.537352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e6f60aa3-9c73-46f8-8f0c-a2b6af823629 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:45.539708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=82 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:45.545396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6f60aa3-9c73-46f8-8f0c-a2b6af823629 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:45.545833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6f60aa3-9c73-46f8-8f0c-a2b6af823629 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:45.546620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6f60aa3-9c73-46f8-8f0c-a2b6af823629 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:45.547046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6f60aa3-9c73-46f8-8f0c-a2b6af823629 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:45.562607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:45.612025 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e6f60aa3-9c73-46f8-8f0c-a2b6af823629 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:45.620387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e6f60aa3-9c73-46f8-8f0c-a2b6af823629 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087559 Jul 14 10:08:45.620940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 925/1841] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:45 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:45.735865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e40bd8ee-98b3-44e7-b13a-2b69277a5f01 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:45.736559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e40bd8ee-98b3-44e7-b13a-2b69277a5f01 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:45.743770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e40bd8ee-98b3-44e7-b13a-2b69277a5f01 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:45.744214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e40bd8ee-98b3-44e7-b13a-2b69277a5f01 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:45.744967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e40bd8ee-98b3-44e7-b13a-2b69277a5f01 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:45.745397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e40bd8ee-98b3-44e7-b13a-2b69277a5f01 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:45.871388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e40bd8ee-98b3-44e7-b13a-2b69277a5f01 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:45.879259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e40bd8ee-98b3-44e7-b13a-2b69277a5f01 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147161 Jul 14 10:08:45.879822 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 917/1842] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:45 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:45.882272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:45.882877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:45.888429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-de5b59c0-794d-46b0-b498-d0a6a962bf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:45.888957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:45.889082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-de5b59c0-794d-46b0-b498-d0a6a962bf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:45.889398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:45.890151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:45.890602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:45.894856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de5b59c0-794d-46b0-b498-d0a6a962bf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:45.895303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de5b59c0-794d-46b0-b498-d0a6a962bf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:45.896090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de5b59c0-794d-46b0-b498-d0a6a962bf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:45.896546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de5b59c0-794d-46b0-b498-d0a6a962bf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:45.972522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:45.981350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:45.982889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:45.984020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f7aa1606-a2cf-4dd2-82a4-f759e4afc3e0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.105777 Jul 14 10:08:45.984569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 926/1843] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:46.040560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-de5b59c0-794d-46b0-b498-d0a6a962bf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:46.048666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-de5b59c0-794d-46b0-b498-d0a6a962bf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.163761 Jul 14 10:08:46.049148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 918/1844] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:45 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:46.637138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-86f2d797-f84e-4cde-b995-43ae990464c0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:46.637747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-86f2d797-f84e-4cde-b995-43ae990464c0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:46.644466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-86f2d797-f84e-4cde-b995-43ae990464c0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:46.644913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-86f2d797-f84e-4cde-b995-43ae990464c0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:46.646319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-86f2d797-f84e-4cde-b995-43ae990464c0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:46.646758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-86f2d797-f84e-4cde-b995-43ae990464c0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:46.706827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-86f2d797-f84e-4cde-b995-43ae990464c0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:46.715448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-86f2d797-f84e-4cde-b995-43ae990464c0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082215 Jul 14 10:08:46.716019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 927/1845] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:46 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:46.896289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9b786c40-5a10-41cf-a6c0-7b559f360276 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:46.896832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9b786c40-5a10-41cf-a6c0-7b559f360276 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:46.903301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b786c40-5a10-41cf-a6c0-7b559f360276 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:46.903752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b786c40-5a10-41cf-a6c0-7b559f360276 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:46.904507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b786c40-5a10-41cf-a6c0-7b559f360276 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:46.904942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b786c40-5a10-41cf-a6c0-7b559f360276 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:47.001892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:47.002740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:47.009377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:47.009825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:47.010623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:47.011047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:47.034494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9b786c40-5a10-41cf-a6c0-7b559f360276 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:47.042608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9b786c40-5a10-41cf-a6c0-7b559f360276 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150200 Jul 14 10:08:47.043180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 919/1846] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:46 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:47.071631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4851ea0e-2684-4193-96ef-870c29d6f9b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:47.072430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4851ea0e-2684-4193-96ef-870c29d6f9b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:47.076487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:47.079701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4851ea0e-2684-4193-96ef-870c29d6f9b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:47.080152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4851ea0e-2684-4193-96ef-870c29d6f9b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:47.080923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4851ea0e-2684-4193-96ef-870c29d6f9b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:47.081348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4851ea0e-2684-4193-96ef-870c29d6f9b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:47.086775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:47.086987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:47.087162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:47.088430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cf0bc95f-932f-4506-ac53-f8d4d8473c48 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090440 Jul 14 10:08:47.089201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 928/1847] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:47.212766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4851ea0e-2684-4193-96ef-870c29d6f9b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:47.220700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4851ea0e-2684-4193-96ef-870c29d6f9b4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155018 Jul 14 10:08:47.221262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 920/1848] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:47.732771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-34c4bf45-8783-411d-b443-d3001cab6dd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:47.733379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-34c4bf45-8783-411d-b443-d3001cab6dd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:47.742722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-34c4bf45-8783-411d-b443-d3001cab6dd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:47.743171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-34c4bf45-8783-411d-b443-d3001cab6dd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:47.746099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-34c4bf45-8783-411d-b443-d3001cab6dd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:47.746689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-34c4bf45-8783-411d-b443-d3001cab6dd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:47.813807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-34c4bf45-8783-411d-b443-d3001cab6dd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:47.822599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-34c4bf45-8783-411d-b443-d3001cab6dd4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.093638 Jul 14 10:08:47.823176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 929/1849] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:48.060636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-20cc2b8c-873d-4a7d-aa40-a58a190b674d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:48.061235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-20cc2b8c-873d-4a7d-aa40-a58a190b674d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:48.068098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20cc2b8c-873d-4a7d-aa40-a58a190b674d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:48.068550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20cc2b8c-873d-4a7d-aa40-a58a190b674d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:48.069401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20cc2b8c-873d-4a7d-aa40-a58a190b674d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:48.069814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20cc2b8c-873d-4a7d-aa40-a58a190b674d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:48.107959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:48.108558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:48.117231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:48.117675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:48.118497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:48.118934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:48.192530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:48.202295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:48.203733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:48.204907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-284f09a3-5a02-4157-958c-4036daa51324 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.101022 Jul 14 10:08:48.205548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 930/1850] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:48.229553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-20cc2b8c-873d-4a7d-aa40-a58a190b674d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:48.238004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-20cc2b8c-873d-4a7d-aa40-a58a190b674d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.181143 Jul 14 10:08:48.238424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d4be05c3-e2ad-4a72-9569-61cf69a35363 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:48.248179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 921/1851] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:48 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:48.248388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d4be05c3-e2ad-4a72-9569-61cf69a35363 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:48.248388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d4be05c3-e2ad-4a72-9569-61cf69a35363 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:48.248388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d4be05c3-e2ad-4a72-9569-61cf69a35363 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:48.248388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d4be05c3-e2ad-4a72-9569-61cf69a35363 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:48.248796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d4be05c3-e2ad-4a72-9569-61cf69a35363 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:48.381323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d4be05c3-e2ad-4a72-9569-61cf69a35363 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:48.389541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d4be05c3-e2ad-4a72-9569-61cf69a35363 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155229 Jul 14 10:08:48.390108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 931/1852] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:48.840224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-68696e3e-927d-4255-bc4f-549b4c3925c3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:48.840839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-68696e3e-927d-4255-bc4f-549b4c3925c3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:48.842942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:48.849030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68696e3e-927d-4255-bc4f-549b4c3925c3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:48.849483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68696e3e-927d-4255-bc4f-549b4c3925c3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:48.850293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68696e3e-927d-4255-bc4f-549b4c3925c3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:48.850732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68696e3e-927d-4255-bc4f-549b4c3925c3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:48.915576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-68696e3e-927d-4255-bc4f-549b4c3925c3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:48.924711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-68696e3e-927d-4255-bc4f-549b4c3925c3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089044 Jul 14 10:08:48.925273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 922/1853] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:48 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:49.223024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:49.223625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:49.230518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:49.230964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:49.231722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:49.232155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:49.256468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a64b7b57-464d-4ca1-8e87-333d3d46f8d9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:49.257085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a64b7b57-464d-4ca1-8e87-333d3d46f8d9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:49.264219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a64b7b57-464d-4ca1-8e87-333d3d46f8d9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:49.264672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a64b7b57-464d-4ca1-8e87-333d3d46f8d9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:49.265447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a64b7b57-464d-4ca1-8e87-333d3d46f8d9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:49.265890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a64b7b57-464d-4ca1-8e87-333d3d46f8d9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:49.296861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:49.306219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:49.307742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:49.308895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b8cbe829-6f25-4fb0-bd52-f777c7b3e12c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089811 Jul 14 10:08:49.309455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 932/1854] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:49 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:49.395128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a64b7b57-464d-4ca1-8e87-333d3d46f8d9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:49.403037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a64b7b57-464d-4ca1-8e87-333d3d46f8d9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151044 Jul 14 10:08:49.403602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 923/1855] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:49 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:49.407174 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7d8d2952-d1ec-4c27-be15-8fad91b816b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:49.407782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7d8d2952-d1ec-4c27-be15-8fad91b816b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:49.414652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d8d2952-d1ec-4c27-be15-8fad91b816b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:49.415091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d8d2952-d1ec-4c27-be15-8fad91b816b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:49.415854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d8d2952-d1ec-4c27-be15-8fad91b816b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:49.416507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d8d2952-d1ec-4c27-be15-8fad91b816b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:49.547788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7d8d2952-d1ec-4c27-be15-8fad91b816b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:49.556514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7d8d2952-d1ec-4c27-be15-8fad91b816b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153296 Jul 14 10:08:49.557098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 933/1856] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:49.941661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2f548e52-2051-4d96-b2dc-32390a8884a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:49.942424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2f548e52-2051-4d96-b2dc-32390a8884a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:49.948403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2f548e52-2051-4d96-b2dc-32390a8884a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:49.948845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2f548e52-2051-4d96-b2dc-32390a8884a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:49.949593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2f548e52-2051-4d96-b2dc-32390a8884a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:49.950022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2f548e52-2051-4d96-b2dc-32390a8884a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:50.011298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2f548e52-2051-4d96-b2dc-32390a8884a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:50.019258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2f548e52-2051-4d96-b2dc-32390a8884a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081686 Jul 14 10:08:50.019830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 924/1857] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:49 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:50.327689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:50.328369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:50.335448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:50.335887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:50.336637 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:50.337089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:50.398062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:50.406451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:50.407944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:50.409067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a0b654a5-49a7-4d00-99ac-a8f8132d974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085365 Jul 14 10:08:50.409612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 934/1858] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:50.419248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6fa40771-e236-443a-9685-c5f570af4258 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:50.419859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6fa40771-e236-443a-9685-c5f570af4258 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:50.426622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6fa40771-e236-443a-9685-c5f570af4258 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:50.427074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6fa40771-e236-443a-9685-c5f570af4258 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:50.427888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6fa40771-e236-443a-9685-c5f570af4258 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:50.428323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6fa40771-e236-443a-9685-c5f570af4258 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:50.557187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6fa40771-e236-443a-9685-c5f570af4258 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:50.572937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6fa40771-e236-443a-9685-c5f570af4258 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157629 Jul 14 10:08:50.573518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 925/1859] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:50 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:50.575728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c6f49bd6-5c81-4802-b575-5e98ec02777a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:50.576327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c6f49bd6-5c81-4802-b575-5e98ec02777a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:50.582485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6f49bd6-5c81-4802-b575-5e98ec02777a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:50.582882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6f49bd6-5c81-4802-b575-5e98ec02777a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:50.584258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6f49bd6-5c81-4802-b575-5e98ec02777a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:50.584688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6f49bd6-5c81-4802-b575-5e98ec02777a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:50.712537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c6f49bd6-5c81-4802-b575-5e98ec02777a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:50.720358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c6f49bd6-5c81-4802-b575-5e98ec02777a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148650 Jul 14 10:08:50.720932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 935/1860] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:51.036825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fa1a2eeb-8aa9-4234-b164-ec6aae1672cd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:51.037440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fa1a2eeb-8aa9-4234-b164-ec6aae1672cd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:51.044215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa1a2eeb-8aa9-4234-b164-ec6aae1672cd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:51.044659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa1a2eeb-8aa9-4234-b164-ec6aae1672cd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:51.045419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa1a2eeb-8aa9-4234-b164-ec6aae1672cd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:51.045847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fa1a2eeb-8aa9-4234-b164-ec6aae1672cd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:51.105931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fa1a2eeb-8aa9-4234-b164-ec6aae1672cd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:51.113947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fa1a2eeb-8aa9-4234-b164-ec6aae1672cd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081040 Jul 14 10:08:51.114530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 926/1861] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:51 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:51.428042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:51.428644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:51.435360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:51.435798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:51.436555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:51.436984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:51.501558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:51.510726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:51.512248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:51.513385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b6aefe0b-20c4-45d8-9ed3-e21db7c67876 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089891 Jul 14 10:08:51.513935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 936/1862] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:51.588907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1e50ca63-c1f7-401f-a05b-81f81b4a52c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:51.589513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1e50ca63-c1f7-401f-a05b-81f81b4a52c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:51.596278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e50ca63-c1f7-401f-a05b-81f81b4a52c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:51.596725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e50ca63-c1f7-401f-a05b-81f81b4a52c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:51.597492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e50ca63-c1f7-401f-a05b-81f81b4a52c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:51.597929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e50ca63-c1f7-401f-a05b-81f81b4a52c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:51.729082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1e50ca63-c1f7-401f-a05b-81f81b4a52c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:51.736823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-485aa382-868d-4911-bb4e-995293e97fd0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:51.737138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1e50ca63-c1f7-401f-a05b-81f81b4a52c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.152205 Jul 14 10:08:51.737555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-485aa382-868d-4911-bb4e-995293e97fd0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:51.737987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 927/1863] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:51 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:51.744430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-485aa382-868d-4911-bb4e-995293e97fd0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:51.744873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-485aa382-868d-4911-bb4e-995293e97fd0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:51.745644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-485aa382-868d-4911-bb4e-995293e97fd0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:51.746071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-485aa382-868d-4911-bb4e-995293e97fd0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:51.879226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-485aa382-868d-4911-bb4e-995293e97fd0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:51.887163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-485aa382-868d-4911-bb4e-995293e97fd0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.154256 Jul 14 10:08:51.887726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 937/1864] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:52.131548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-36884312-d189-410d-8a2a-cddb69357ff2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:52.132180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-36884312-d189-410d-8a2a-cddb69357ff2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:52.138181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36884312-d189-410d-8a2a-cddb69357ff2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:52.138649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36884312-d189-410d-8a2a-cddb69357ff2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:52.139410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36884312-d189-410d-8a2a-cddb69357ff2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:52.139835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36884312-d189-410d-8a2a-cddb69357ff2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:52.200577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-36884312-d189-410d-8a2a-cddb69357ff2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:52.208579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-36884312-d189-410d-8a2a-cddb69357ff2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081513 Jul 14 10:08:52.209128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 928/1865] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:52 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:52.531561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:52.532172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:52.539343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:52.539823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:52.540589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:52.541019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:52.610430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:52.620055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:52.621407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:52.622573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2e4848ff-990e-4399-90e0-64eb26ffe677 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.095070 Jul 14 10:08:52.623129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 938/1866] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:52.755611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-26fd814c-5c6a-4ce0-b47d-2ff8eeaad372 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:52.756285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-26fd814c-5c6a-4ce0-b47d-2ff8eeaad372 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:52.765264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26fd814c-5c6a-4ce0-b47d-2ff8eeaad372 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:52.765722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26fd814c-5c6a-4ce0-b47d-2ff8eeaad372 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:52.766539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26fd814c-5c6a-4ce0-b47d-2ff8eeaad372 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:52.766979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26fd814c-5c6a-4ce0-b47d-2ff8eeaad372 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:52.900660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-26fd814c-5c6a-4ce0-b47d-2ff8eeaad372 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:52.904113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-81fcbff6-a6fb-4465-833a-5dfa7cc20569 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:52.904846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-81fcbff6-a6fb-4465-833a-5dfa7cc20569 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:52.908860 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-26fd814c-5c6a-4ce0-b47d-2ff8eeaad372 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157716 Jul 14 10:08:52.909599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 929/1867] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:52 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:52.910983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81fcbff6-a6fb-4465-833a-5dfa7cc20569 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:52.911430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81fcbff6-a6fb-4465-833a-5dfa7cc20569 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:52.912193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81fcbff6-a6fb-4465-833a-5dfa7cc20569 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:52.912624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81fcbff6-a6fb-4465-833a-5dfa7cc20569 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:53.044053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-81fcbff6-a6fb-4465-833a-5dfa7cc20569 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:53.052458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-81fcbff6-a6fb-4465-833a-5dfa7cc20569 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151663 Jul 14 10:08:53.053015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 939/1868] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:53.225567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-08a9ffd3-4337-4950-a202-fe98c8406f30 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:53.226173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-08a9ffd3-4337-4950-a202-fe98c8406f30 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:53.232196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08a9ffd3-4337-4950-a202-fe98c8406f30 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:53.232643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08a9ffd3-4337-4950-a202-fe98c8406f30 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:53.233401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08a9ffd3-4337-4950-a202-fe98c8406f30 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:53.233840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08a9ffd3-4337-4950-a202-fe98c8406f30 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:53.295115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-08a9ffd3-4337-4950-a202-fe98c8406f30 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:53.303102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-08a9ffd3-4337-4950-a202-fe98c8406f30 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082035 Jul 14 10:08:53.303669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 930/1869] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:53 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:53.641457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:53.642052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:53.649365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:53.649809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:53.650628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:53.651059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:53.715271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:53.729550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:53.732277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:53.733666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-181bc91b-9fcf-4eee-8b04-eca520575faa tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.096264 Jul 14 10:08:53.734376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 940/1870] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:08:53.926070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7869fd69-a873-4d9a-89b5-1abae0877589 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:53.926754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7869fd69-a873-4d9a-89b5-1abae0877589 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:53.933393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7869fd69-a873-4d9a-89b5-1abae0877589 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:53.933837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7869fd69-a873-4d9a-89b5-1abae0877589 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:53.934629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7869fd69-a873-4d9a-89b5-1abae0877589 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:53.935067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7869fd69-a873-4d9a-89b5-1abae0877589 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:54.068288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7869fd69-a873-4d9a-89b5-1abae0877589 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:54.069727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0a40da95-e29f-4ff7-9af0-e60cab54cb7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:54.070379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0a40da95-e29f-4ff7-9af0-e60cab54cb7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:54.076925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7869fd69-a873-4d9a-89b5-1abae0877589 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154763 Jul 14 10:08:54.077140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a40da95-e29f-4ff7-9af0-e60cab54cb7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:54.077421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a40da95-e29f-4ff7-9af0-e60cab54cb7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:54.077527 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 931/1871] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:53 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:54.078268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a40da95-e29f-4ff7-9af0-e60cab54cb7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:54.078639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a40da95-e29f-4ff7-9af0-e60cab54cb7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:54.213857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0a40da95-e29f-4ff7-9af0-e60cab54cb7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:54.222015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0a40da95-e29f-4ff7-9af0-e60cab54cb7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.156916 Jul 14 10:08:54.222671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 941/1872] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:54.320551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-604f11aa-72ad-4db9-819c-5ba03f0fabf7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:54.321154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-604f11aa-72ad-4db9-819c-5ba03f0fabf7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:54.327190 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-604f11aa-72ad-4db9-819c-5ba03f0fabf7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:54.327635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-604f11aa-72ad-4db9-819c-5ba03f0fabf7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:54.328502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-604f11aa-72ad-4db9-819c-5ba03f0fabf7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:54.328934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-604f11aa-72ad-4db9-819c-5ba03f0fabf7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:54.389613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-604f11aa-72ad-4db9-819c-5ba03f0fabf7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:54.397615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-604f11aa-72ad-4db9-819c-5ba03f0fabf7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081424 Jul 14 10:08:54.398164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 932/1873] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:54 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:54.753000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:54.753585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:54.760553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:54.760991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:54.761765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:54.762179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:54.766316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:54.824404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:54.833009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:54.834543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:54.835684 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-55d7ce5f-5e7e-4800-b2f5-0a597742bbec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086751 Jul 14 10:08:54.836240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 942/1874] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:55.094801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e61e1fa3-f842-43f8-9f1a-f903168f1bd7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:55.095338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e61e1fa3-f842-43f8-9f1a-f903168f1bd7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:55.102491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e61e1fa3-f842-43f8-9f1a-f903168f1bd7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:55.102936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e61e1fa3-f842-43f8-9f1a-f903168f1bd7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:55.103688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e61e1fa3-f842-43f8-9f1a-f903168f1bd7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:55.104119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e61e1fa3-f842-43f8-9f1a-f903168f1bd7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:55.238077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d27e43b5-80e3-4b05-aa83-ffa694049a3f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:55.238795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d27e43b5-80e3-4b05-aa83-ffa694049a3f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:55.240527 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e61e1fa3-f842-43f8-9f1a-f903168f1bd7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:55.244917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d27e43b5-80e3-4b05-aa83-ffa694049a3f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:55.245364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d27e43b5-80e3-4b05-aa83-ffa694049a3f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:55.246130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d27e43b5-80e3-4b05-aa83-ffa694049a3f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:55.246592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d27e43b5-80e3-4b05-aa83-ffa694049a3f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:55.248476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e61e1fa3-f842-43f8-9f1a-f903168f1bd7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157572 Jul 14 10:08:55.249037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 933/1875] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:55 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:55.372606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d27e43b5-80e3-4b05-aa83-ffa694049a3f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:55.380574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d27e43b5-80e3-4b05-aa83-ffa694049a3f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.146321 Jul 14 10:08:55.381129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 943/1876] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:55.415336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6abdd60d-fc3a-40b5-8ab5-1cb1e21229a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:55.416091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6abdd60d-fc3a-40b5-8ab5-1cb1e21229a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:55.422357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6abdd60d-fc3a-40b5-8ab5-1cb1e21229a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:55.422803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6abdd60d-fc3a-40b5-8ab5-1cb1e21229a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:55.423552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6abdd60d-fc3a-40b5-8ab5-1cb1e21229a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:55.423984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6abdd60d-fc3a-40b5-8ab5-1cb1e21229a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:55.484986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6abdd60d-fc3a-40b5-8ab5-1cb1e21229a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:55.493260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6abdd60d-fc3a-40b5-8ab5-1cb1e21229a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082839 Jul 14 10:08:55.493827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 934/1877] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:55 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:55.853008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:55.853614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:55.860216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:55.860659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:55.861494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:55.861842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:55.925631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:55.934522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:55.936027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:55.937154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9a83d4f9-3e98-40ab-a0ba-38a9c62fb454 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088064 Jul 14 10:08:55.937702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 944/1878] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:56.265752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b2ace135-e600-415e-aeef-164e4f64fbe7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:56.266391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b2ace135-e600-415e-aeef-164e4f64fbe7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:56.273465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2ace135-e600-415e-aeef-164e4f64fbe7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:56.273909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2ace135-e600-415e-aeef-164e4f64fbe7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:56.274689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2ace135-e600-415e-aeef-164e4f64fbe7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:56.275120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2ace135-e600-415e-aeef-164e4f64fbe7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:56.397729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-21349c55-3b3b-4d86-b6a3-37606bb29c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:56.398372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-21349c55-3b3b-4d86-b6a3-37606bb29c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:56.401598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b2ace135-e600-415e-aeef-164e4f64fbe7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:56.404506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21349c55-3b3b-4d86-b6a3-37606bb29c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:56.404956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21349c55-3b3b-4d86-b6a3-37606bb29c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:56.405722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21349c55-3b3b-4d86-b6a3-37606bb29c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:56.406158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-21349c55-3b3b-4d86-b6a3-37606bb29c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:56.409732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b2ace135-e600-415e-aeef-164e4f64fbe7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147845 Jul 14 10:08:56.410316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 935/1879] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:56 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:56.510254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9a78c292-027e-4ee1-b5bd-6ff95e65233a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:56.510867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9a78c292-027e-4ee1-b5bd-6ff95e65233a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:56.517088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a78c292-027e-4ee1-b5bd-6ff95e65233a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:56.517479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a78c292-027e-4ee1-b5bd-6ff95e65233a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:56.518254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a78c292-027e-4ee1-b5bd-6ff95e65233a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:56.518693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a78c292-027e-4ee1-b5bd-6ff95e65233a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:56.537288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-21349c55-3b3b-4d86-b6a3-37606bb29c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:56.545694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-21349c55-3b3b-4d86-b6a3-37606bb29c63 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151887 Jul 14 10:08:56.546282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 945/1880] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:56.582286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9a78c292-027e-4ee1-b5bd-6ff95e65233a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:56.584467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:56.591829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9a78c292-027e-4ee1-b5bd-6ff95e65233a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085429 Jul 14 10:08:56.592394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 936/1881] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:56 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:56.955954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:56.956568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:56.963613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:56.964060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:56.964818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:56.965248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:57.028049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:57.036348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:57.037851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:57.039022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-77b8f88c-89a8-4181-89bc-3507145a5c66 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087024 Jul 14 10:08:57.039575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 946/1882] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:57.428275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-85c4cbe3-efc5-46dc-969d-195e70147d37 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:57.428880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-85c4cbe3-efc5-46dc-969d-195e70147d37 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:57.435413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85c4cbe3-efc5-46dc-969d-195e70147d37 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:57.435854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85c4cbe3-efc5-46dc-969d-195e70147d37 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:57.436601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85c4cbe3-efc5-46dc-969d-195e70147d37 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:57.437029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85c4cbe3-efc5-46dc-969d-195e70147d37 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:57.563260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-45254771-401e-40f3-8ca4-8645df15ff7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:57.563873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-45254771-401e-40f3-8ca4-8645df15ff7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:57.564828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-85c4cbe3-efc5-46dc-969d-195e70147d37 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:57.570453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45254771-401e-40f3-8ca4-8645df15ff7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:57.570895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45254771-401e-40f3-8ca4-8645df15ff7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:57.571698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45254771-401e-40f3-8ca4-8645df15ff7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:57.572128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45254771-401e-40f3-8ca4-8645df15ff7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:57.573592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-85c4cbe3-efc5-46dc-969d-195e70147d37 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149728 Jul 14 10:08:57.574167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 937/1883] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:57 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:57.608735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f123b1a4-e5d9-428c-8282-a64196ced983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:57.609347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f123b1a4-e5d9-428c-8282-a64196ced983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:57.616294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f123b1a4-e5d9-428c-8282-a64196ced983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:57.616745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f123b1a4-e5d9-428c-8282-a64196ced983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:57.617511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f123b1a4-e5d9-428c-8282-a64196ced983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:57.617948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f123b1a4-e5d9-428c-8282-a64196ced983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:57.695580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f123b1a4-e5d9-428c-8282-a64196ced983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:57.703755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f123b1a4-e5d9-428c-8282-a64196ced983 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.098765 Jul 14 10:08:57.704338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 938/1884] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:57 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:57.725918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-45254771-401e-40f3-8ca4-8645df15ff7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:57.734169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-45254771-401e-40f3-8ca4-8645df15ff7f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.174758 Jul 14 10:08:57.734774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 947/1885] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:58.056990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:58.057517 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:58.063603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:58.064051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:58.064808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:58.065243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:58.127244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:58.135880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:58.137378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:58.138542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d92ddc72-bf4c-4551-a9d7-5bf7b278a97a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085536 Jul 14 10:08:58.139107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 939/1886] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:58 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:58.590747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7acefe36-a5bd-4cc8-9d45-c9d66ac22406 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:58.591362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7acefe36-a5bd-4cc8-9d45-c9d66ac22406 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:58.597969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7acefe36-a5bd-4cc8-9d45-c9d66ac22406 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:58.598447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7acefe36-a5bd-4cc8-9d45-c9d66ac22406 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:58.599221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7acefe36-a5bd-4cc8-9d45-c9d66ac22406 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:58.599651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7acefe36-a5bd-4cc8-9d45-c9d66ac22406 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:58.720625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-68cedffe-e0fe-4e5e-bf18-35f0e237af59 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:58.721446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-68cedffe-e0fe-4e5e-bf18-35f0e237af59 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:58.728098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68cedffe-e0fe-4e5e-bf18-35f0e237af59 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:58.728549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68cedffe-e0fe-4e5e-bf18-35f0e237af59 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:58.728982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7acefe36-a5bd-4cc8-9d45-c9d66ac22406 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:58.729321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68cedffe-e0fe-4e5e-bf18-35f0e237af59 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:58.729761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68cedffe-e0fe-4e5e-bf18-35f0e237af59 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:58.737112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7acefe36-a5bd-4cc8-9d45-c9d66ac22406 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150189 Jul 14 10:08:58.737669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 948/1887] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:58 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:58.752157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b4c8ab5c-b8a0-4238-8273-404bf9b2781a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:58.752757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b4c8ab5c-b8a0-4238-8273-404bf9b2781a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:58.759284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4c8ab5c-b8a0-4238-8273-404bf9b2781a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:58.759728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4c8ab5c-b8a0-4238-8273-404bf9b2781a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:58.760511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4c8ab5c-b8a0-4238-8273-404bf9b2781a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:58.760945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4c8ab5c-b8a0-4238-8273-404bf9b2781a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:58.795602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-68cedffe-e0fe-4e5e-bf18-35f0e237af59 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:58.804183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-68cedffe-e0fe-4e5e-bf18-35f0e237af59 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087418 Jul 14 10:08:58.806643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 940/1888] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:58 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:58.901768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b4c8ab5c-b8a0-4238-8273-404bf9b2781a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:58.910031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b4c8ab5c-b8a0-4238-8273-404bf9b2781a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.161507 Jul 14 10:08:58.910628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 949/1889] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:59.157800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:59.158363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:59.164429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:59.164874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:59.165628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:59.166087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:59.231266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:59.240594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:59.242106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:59.243282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5c908dcc-97db-4ecd-9f9f-203f7389fdcd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089489 Jul 14 10:08:59.243851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 941/1890] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:08:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:59.754338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ad467aad-98ce-44f9-8718-e3fa06ed9bd6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:59.755012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ad467aad-98ce-44f9-8718-e3fa06ed9bd6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:59.761458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad467aad-98ce-44f9-8718-e3fa06ed9bd6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:59.761905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad467aad-98ce-44f9-8718-e3fa06ed9bd6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:59.762692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad467aad-98ce-44f9-8718-e3fa06ed9bd6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:59.763124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad467aad-98ce-44f9-8718-e3fa06ed9bd6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:59.821162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3628c0f6-ea1f-4116-a46b-7e717a7b180e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:59.821710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3628c0f6-ea1f-4116-a46b-7e717a7b180e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:59.828399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3628c0f6-ea1f-4116-a46b-7e717a7b180e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:59.828843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3628c0f6-ea1f-4116-a46b-7e717a7b180e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:59.829754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3628c0f6-ea1f-4116-a46b-7e717a7b180e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:59.830211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3628c0f6-ea1f-4116-a46b-7e717a7b180e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:59.900795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3628c0f6-ea1f-4116-a46b-7e717a7b180e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:59.908722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3628c0f6-ea1f-4116-a46b-7e717a7b180e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091481 Jul 14 10:08:59.909292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 942/1891] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:59 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:59.923319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ad467aad-98ce-44f9-8718-e3fa06ed9bd6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:08:59.930734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-85a3dadd-cc63-4959-af61-c51ba9ed436a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:59.931347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-85a3dadd-cc63-4959-af61-c51ba9ed436a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:08:59.931472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ad467aad-98ce-44f9-8718-e3fa06ed9bd6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.181156 Jul 14 10:08:59.932005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 950/1892] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:59 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:59.937381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85a3dadd-cc63-4959-af61-c51ba9ed436a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:59.937836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85a3dadd-cc63-4959-af61-c51ba9ed436a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:08:59.938628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85a3dadd-cc63-4959-af61-c51ba9ed436a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:08:59.939106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-85a3dadd-cc63-4959-af61-c51ba9ed436a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:00.073139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-85a3dadd-cc63-4959-af61-c51ba9ed436a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:00.080986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-85a3dadd-cc63-4959-af61-c51ba9ed436a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.154152 Jul 14 10:09:00.081550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 943/1893] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:08:59 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:00.261538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:00.262172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:00.268346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:00.268796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:00.269561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:00.269995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:00.338894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:00.347344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:00.348824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:00.349952 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-af513abe-bb4f-4ff9-80ab-2174b7af8787 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092362 Jul 14 10:09:00.350548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 951/1894] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:00.928384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0aa42fd7-1cd4-42ec-a4d8-7da567dfb3d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:00.928981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0aa42fd7-1cd4-42ec-a4d8-7da567dfb3d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:00.935159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0aa42fd7-1cd4-42ec-a4d8-7da567dfb3d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:00.935604 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0aa42fd7-1cd4-42ec-a4d8-7da567dfb3d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:00.936368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0aa42fd7-1cd4-42ec-a4d8-7da567dfb3d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:00.936807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0aa42fd7-1cd4-42ec-a4d8-7da567dfb3d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:00.950016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-54dda90f-63a9-408c-85fb-7f357446e8b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:00.950660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-54dda90f-63a9-408c-85fb-7f357446e8b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:00.956776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54dda90f-63a9-408c-85fb-7f357446e8b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:00.957224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54dda90f-63a9-408c-85fb-7f357446e8b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:00.958019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54dda90f-63a9-408c-85fb-7f357446e8b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:00.958617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54dda90f-63a9-408c-85fb-7f357446e8b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:01.014823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0aa42fd7-1cd4-42ec-a4d8-7da567dfb3d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:01.023256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0aa42fd7-1cd4-42ec-a4d8-7da567dfb3d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.099991 Jul 14 10:09:01.023951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 944/1895] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:00 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:01.098307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a6e4a68c-5258-4757-8a16-701e7857c211 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:01.099542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a6e4a68c-5258-4757-8a16-701e7857c211 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:01.105648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6e4a68c-5258-4757-8a16-701e7857c211 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:01.106102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6e4a68c-5258-4757-8a16-701e7857c211 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:01.106912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6e4a68c-5258-4757-8a16-701e7857c211 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:01.107360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a6e4a68c-5258-4757-8a16-701e7857c211 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:01.112969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-54dda90f-63a9-408c-85fb-7f357446e8b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:01.120869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-54dda90f-63a9-408c-85fb-7f357446e8b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.175851 Jul 14 10:09:01.121641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 952/1896] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:00 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:01.233803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a6e4a68c-5258-4757-8a16-701e7857c211 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:01.242076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a6e4a68c-5258-4757-8a16-701e7857c211 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147684 Jul 14 10:09:01.242663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 945/1897] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:01.367785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:01.368392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:01.374607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:01.375052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:01.375806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:01.376238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:01.436598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:01.445057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:01.446603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:01.447757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9a471ee6-0033-4910-988e-945468239cbb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.083933 Jul 14 10:09:01.448306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 953/1898] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:02.040413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-be457d8b-3388-4529-abea-ca1261381935 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:02.041027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-be457d8b-3388-4529-abea-ca1261381935 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:02.047770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be457d8b-3388-4529-abea-ca1261381935 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:02.048264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be457d8b-3388-4529-abea-ca1261381935 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:02.049035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be457d8b-3388-4529-abea-ca1261381935 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:02.049472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be457d8b-3388-4529-abea-ca1261381935 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:02.113302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-be457d8b-3388-4529-abea-ca1261381935 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:02.121887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-be457d8b-3388-4529-abea-ca1261381935 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085396 Jul 14 10:09:02.122490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 946/1899] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:02 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:02.137016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8db4e1e7-d877-49b8-8fa5-7ca99545f4a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:02.137632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8db4e1e7-d877-49b8-8fa5-7ca99545f4a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:02.143787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8db4e1e7-d877-49b8-8fa5-7ca99545f4a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:02.144235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8db4e1e7-d877-49b8-8fa5-7ca99545f4a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:02.145000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8db4e1e7-d877-49b8-8fa5-7ca99545f4a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:02.145436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8db4e1e7-d877-49b8-8fa5-7ca99545f4a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:02.259491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ee0a7792-49ba-40c9-9754-3b631a1fb62d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:02.260209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ee0a7792-49ba-40c9-9754-3b631a1fb62d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:02.266244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee0a7792-49ba-40c9-9754-3b631a1fb62d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:02.266759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee0a7792-49ba-40c9-9754-3b631a1fb62d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:02.267634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee0a7792-49ba-40c9-9754-3b631a1fb62d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:02.268131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee0a7792-49ba-40c9-9754-3b631a1fb62d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:02.271588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8db4e1e7-d877-49b8-8fa5-7ca99545f4a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:02.279501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8db4e1e7-d877-49b8-8fa5-7ca99545f4a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146324 Jul 14 10:09:02.280065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 954/1900] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:02 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:02.395361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ee0a7792-49ba-40c9-9754-3b631a1fb62d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:02.403361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ee0a7792-49ba-40c9-9754-3b631a1fb62d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147766 Jul 14 10:09:02.403926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 947/1901] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:02 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:02.464720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:02.465320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:02.471720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:02.472168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:02.472984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:02.473416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:02.540145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:02.548913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:02.550459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:02.551596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-76823147-66be-4bcc-970d-287ab67d1291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090734 Jul 14 10:09:02.552792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 955/1902] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:03.139126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fcf8fab7-7c38-4f82-a5d2-72a74c8aadaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:03.139677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fcf8fab7-7c38-4f82-a5d2-72a74c8aadaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:03.146402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcf8fab7-7c38-4f82-a5d2-72a74c8aadaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:03.146760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcf8fab7-7c38-4f82-a5d2-72a74c8aadaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:03.147522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcf8fab7-7c38-4f82-a5d2-72a74c8aadaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:03.148522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fcf8fab7-7c38-4f82-a5d2-72a74c8aadaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:03.210940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fcf8fab7-7c38-4f82-a5d2-72a74c8aadaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:03.218843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fcf8fab7-7c38-4f82-a5d2-72a74c8aadaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083778 Jul 14 10:09:03.219404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 948/1903] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:03 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:03.297094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-018d8f8e-54a0-4c01-a46a-6e32138945d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:03.297735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-018d8f8e-54a0-4c01-a46a-6e32138945d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:03.304490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-018d8f8e-54a0-4c01-a46a-6e32138945d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:03.304938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-018d8f8e-54a0-4c01-a46a-6e32138945d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:03.305693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-018d8f8e-54a0-4c01-a46a-6e32138945d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:03.306123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-018d8f8e-54a0-4c01-a46a-6e32138945d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:03.421177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b5ec9767-98e8-4d7a-a354-8c9448b804f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:03.421696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b5ec9767-98e8-4d7a-a354-8c9448b804f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:03.427790 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5ec9767-98e8-4d7a-a354-8c9448b804f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:03.428235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5ec9767-98e8-4d7a-a354-8c9448b804f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:03.428994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5ec9767-98e8-4d7a-a354-8c9448b804f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:03.429421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5ec9767-98e8-4d7a-a354-8c9448b804f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:03.433659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-018d8f8e-54a0-4c01-a46a-6e32138945d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:03.441612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-018d8f8e-54a0-4c01-a46a-6e32138945d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148649 Jul 14 10:09:03.442278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 956/1904] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:03 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:03.561465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b5ec9767-98e8-4d7a-a354-8c9448b804f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:03.569717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b5ec9767-98e8-4d7a-a354-8c9448b804f2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152716 Jul 14 10:09:03.570271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:03.570444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 949/1905] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:03 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:03.570885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:03.577346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:03.577793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:03.578653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:03.579016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:03.640714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:03.649574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:03.651087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:03.652206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f43034ca-648d-4c8b-b735-1f80bd47eb30 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085907 Jul 14 10:09:03.652753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 957/1906] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:04.236153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6bfdbe2c-5326-4fb7-9bac-28897c53c159 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:04.236748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6bfdbe2c-5326-4fb7-9bac-28897c53c159 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:04.243432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bfdbe2c-5326-4fb7-9bac-28897c53c159 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:04.243887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bfdbe2c-5326-4fb7-9bac-28897c53c159 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:04.244653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bfdbe2c-5326-4fb7-9bac-28897c53c159 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:04.245093 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bfdbe2c-5326-4fb7-9bac-28897c53c159 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:04.306393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6bfdbe2c-5326-4fb7-9bac-28897c53c159 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:04.314330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6bfdbe2c-5326-4fb7-9bac-28897c53c159 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082181 Jul 14 10:09:04.314903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 950/1907] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:04 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:04.459167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c1ed3de4-eff6-4b80-9647-6773b6698f70 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:04.459798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c1ed3de4-eff6-4b80-9647-6773b6698f70 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:04.465806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1ed3de4-eff6-4b80-9647-6773b6698f70 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:04.466283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1ed3de4-eff6-4b80-9647-6773b6698f70 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:04.467035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1ed3de4-eff6-4b80-9647-6773b6698f70 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:04.467461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c1ed3de4-eff6-4b80-9647-6773b6698f70 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:04.587464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7af67abe-d8d6-44b8-bbac-b4f77e27ac84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:04.588173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7af67abe-d8d6-44b8-bbac-b4f77e27ac84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:04.594257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7af67abe-d8d6-44b8-bbac-b4f77e27ac84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:04.594706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7af67abe-d8d6-44b8-bbac-b4f77e27ac84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:04.595473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7af67abe-d8d6-44b8-bbac-b4f77e27ac84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:04.595808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c1ed3de4-eff6-4b80-9647-6773b6698f70 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:04.596027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7af67abe-d8d6-44b8-bbac-b4f77e27ac84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:04.597973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:04.604984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c1ed3de4-eff6-4b80-9647-6773b6698f70 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150153 Jul 14 10:09:04.605547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 958/1908] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:04 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:04.670633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:04.671372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:04.677587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:04.678031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:04.678825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:04.679258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:04.747271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:04.750907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7af67abe-d8d6-44b8-bbac-b4f77e27ac84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:04.756412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:04.757923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:04.759087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-55b0bf56-fa5f-4a67-a848-be76b16ed675 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092721 Jul 14 10:09:04.759584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7af67abe-d8d6-44b8-bbac-b4f77e27ac84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.176429 Jul 14 10:09:04.759721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 959/1909] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:04.760141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 951/1910] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:05.331277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-75a9cec2-1bc3-4c7e-a84e-6686d3ea5f08 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:05.331854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-75a9cec2-1bc3-4c7e-a84e-6686d3ea5f08 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:05.338034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75a9cec2-1bc3-4c7e-a84e-6686d3ea5f08 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:05.338531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75a9cec2-1bc3-4c7e-a84e-6686d3ea5f08 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:05.339291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75a9cec2-1bc3-4c7e-a84e-6686d3ea5f08 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:05.339727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75a9cec2-1bc3-4c7e-a84e-6686d3ea5f08 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:05.403419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-75a9cec2-1bc3-4c7e-a84e-6686d3ea5f08 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:05.412912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-75a9cec2-1bc3-4c7e-a84e-6686d3ea5f08 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085551 Jul 14 10:09:05.413473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 960/1911] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:05 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:05.622261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-82d3fdee-bfa7-4a97-a25c-9eeac0ec4025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:05.622884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-82d3fdee-bfa7-4a97-a25c-9eeac0ec4025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:05.629545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-82d3fdee-bfa7-4a97-a25c-9eeac0ec4025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:05.629999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-82d3fdee-bfa7-4a97-a25c-9eeac0ec4025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:05.630803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-82d3fdee-bfa7-4a97-a25c-9eeac0ec4025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:05.631244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-82d3fdee-bfa7-4a97-a25c-9eeac0ec4025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:05.763684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-82d3fdee-bfa7-4a97-a25c-9eeac0ec4025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:05.772321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-82d3fdee-bfa7-4a97-a25c-9eeac0ec4025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154029 Jul 14 10:09:05.778239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 952/1912] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:05 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:05.778239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:05.778519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c0c0cb36-921f-4c7b-bffd-59f866603ff5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:05.778941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:05.779026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c0c0cb36-921f-4c7b-bffd-59f866603ff5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:05.783936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:05.784390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:05.784589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0c0cb36-921f-4c7b-bffd-59f866603ff5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:05.785033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0c0cb36-921f-4c7b-bffd-59f866603ff5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:05.785219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:05.785630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:05.787118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0c0cb36-921f-4c7b-bffd-59f866603ff5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:05.788017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c0c0cb36-921f-4c7b-bffd-59f866603ff5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:05.801531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:05.870314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:05.878974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:05.880499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:05.881637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fc495ac4-7823-47fa-a786-74ac5c7aefe4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.107850 Jul 14 10:09:05.882210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 953/1913] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:05.937065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c0c0cb36-921f-4c7b-bffd-59f866603ff5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:05.945235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c0c0cb36-921f-4c7b-bffd-59f866603ff5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.171805 Jul 14 10:09:05.945791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 961/1914] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:06.431896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e53e3295-0c27-4134-8c60-e31b58039975 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:06.432515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e53e3295-0c27-4134-8c60-e31b58039975 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:06.438680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e53e3295-0c27-4134-8c60-e31b58039975 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:06.439138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e53e3295-0c27-4134-8c60-e31b58039975 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:06.439904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e53e3295-0c27-4134-8c60-e31b58039975 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:06.440343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e53e3295-0c27-4134-8c60-e31b58039975 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:06.503192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e53e3295-0c27-4134-8c60-e31b58039975 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:06.511874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e53e3295-0c27-4134-8c60-e31b58039975 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083817 Jul 14 10:09:06.512435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 954/1915] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:06 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:06.789507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b256c0c8-c9e1-4359-b3bd-d142a4098882 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:06.790057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b256c0c8-c9e1-4359-b3bd-d142a4098882 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:06.796906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b256c0c8-c9e1-4359-b3bd-d142a4098882 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:06.797352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b256c0c8-c9e1-4359-b3bd-d142a4098882 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:06.798117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b256c0c8-c9e1-4359-b3bd-d142a4098882 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:06.798585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b256c0c8-c9e1-4359-b3bd-d142a4098882 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:06.899696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:06.900336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:06.906703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:06.907153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:06.907909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:06.908343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:06.931690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b256c0c8-c9e1-4359-b3bd-d142a4098882 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:06.939754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b256c0c8-c9e1-4359-b3bd-d142a4098882 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154754 Jul 14 10:09:06.940314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 962/1916] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:06 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:06.963556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f94cba6e-d3d2-4437-9a61-303cd7bd8cae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:06.964160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f94cba6e-d3d2-4437-9a61-303cd7bd8cae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:06.970173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f94cba6e-d3d2-4437-9a61-303cd7bd8cae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:06.970643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f94cba6e-d3d2-4437-9a61-303cd7bd8cae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:06.971400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f94cba6e-d3d2-4437-9a61-303cd7bd8cae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:06.971825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f94cba6e-d3d2-4437-9a61-303cd7bd8cae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:06.983454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:06.993788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:06.995324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:06.996464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8b393bde-9a33-45c1-a133-56d1242b015f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.100680 Jul 14 10:09:06.997015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 955/1917] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:07.107563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f94cba6e-d3d2-4437-9a61-303cd7bd8cae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:07.115423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f94cba6e-d3d2-4437-9a61-303cd7bd8cae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155792 Jul 14 10:09:07.115985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 963/1918] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:06 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:07.528761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9d639099-4142-4ef4-b446-d6f73794129f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:07.529368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9d639099-4142-4ef4-b446-d6f73794129f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:07.535777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d639099-4142-4ef4-b446-d6f73794129f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:07.536737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d639099-4142-4ef4-b446-d6f73794129f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:07.537500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d639099-4142-4ef4-b446-d6f73794129f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:07.537932 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d639099-4142-4ef4-b446-d6f73794129f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:07.601963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9d639099-4142-4ef4-b446-d6f73794129f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:07.610149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9d639099-4142-4ef4-b446-d6f73794129f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085267 Jul 14 10:09:07.610737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 956/1919] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:07 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:07.957693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cd1a32d9-3488-4ce4-9ede-ecb84c626eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:07.958947 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cd1a32d9-3488-4ce4-9ede-ecb84c626eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:07.965698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd1a32d9-3488-4ce4-9ede-ecb84c626eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:07.966138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd1a32d9-3488-4ce4-9ede-ecb84c626eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:07.967007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd1a32d9-3488-4ce4-9ede-ecb84c626eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:07.967441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd1a32d9-3488-4ce4-9ede-ecb84c626eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:08.014847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:08.015566 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:08.023306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:08.024078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:08.025274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:08.025730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:08.107618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:08.116229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:08.117735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:08.118921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3e036b0e-bc43-4f12-841c-1c569bc607f7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.108314 Jul 14 10:09:08.119479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 957/1920] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:08.133125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cd1a32d9-3488-4ce4-9ede-ecb84c626eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:08.135686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c74a8c1-9ea2-426d-91d8-832e2f62c0d6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:08.136708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3c74a8c1-9ea2-426d-91d8-832e2f62c0d6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:08.146645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c74a8c1-9ea2-426d-91d8-832e2f62c0d6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:08.146934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cd1a32d9-3488-4ce4-9ede-ecb84c626eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.192938 Jul 14 10:09:08.147381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c74a8c1-9ea2-426d-91d8-832e2f62c0d6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:08.147883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 964/1921] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:07 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:08.148440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c74a8c1-9ea2-426d-91d8-832e2f62c0d6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:08.148947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c74a8c1-9ea2-426d-91d8-832e2f62c0d6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:08.279113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3c74a8c1-9ea2-426d-91d8-832e2f62c0d6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:08.286908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3c74a8c1-9ea2-426d-91d8-832e2f62c0d6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.157878 Jul 14 10:09:08.287465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 958/1922] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:08.629497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-756befb1-381c-4017-800c-efd76fc8efa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:08.630793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-756befb1-381c-4017-800c-efd76fc8efa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:08.636938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-756befb1-381c-4017-800c-efd76fc8efa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:08.637386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-756befb1-381c-4017-800c-efd76fc8efa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:08.638147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-756befb1-381c-4017-800c-efd76fc8efa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:08.638617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-756befb1-381c-4017-800c-efd76fc8efa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:08.698697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-756befb1-381c-4017-800c-efd76fc8efa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:08.706736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-756befb1-381c-4017-800c-efd76fc8efa0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081130 Jul 14 10:09:08.707301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 965/1923] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:08 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:09.136998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:09.137613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:09.144168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:09.144611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:09.145405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:09.145847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:09.165075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8ae1bcba-a586-47f9-9842-34165116188d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:09.165713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8ae1bcba-a586-47f9-9842-34165116188d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:09.172356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ae1bcba-a586-47f9-9842-34165116188d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:09.172797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ae1bcba-a586-47f9-9842-34165116188d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:09.173552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ae1bcba-a586-47f9-9842-34165116188d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:09.173979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ae1bcba-a586-47f9-9842-34165116188d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:09.207066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:09.216809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:09.218331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:09.219474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e4a7ee98-041f-4db5-874f-c8dd88fa434c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086418 Jul 14 10:09:09.220027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 959/1924] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:09 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:09.304471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9635f81b-8b09-4cbc-a601-28aa52119f4e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:09.304873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8ae1bcba-a586-47f9-9842-34165116188d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:09.305342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9635f81b-8b09-4cbc-a601-28aa52119f4e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:09.312532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9635f81b-8b09-4cbc-a601-28aa52119f4e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:09.312975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9635f81b-8b09-4cbc-a601-28aa52119f4e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:09.313734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9635f81b-8b09-4cbc-a601-28aa52119f4e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:09.313906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8ae1bcba-a586-47f9-9842-34165116188d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153157 Jul 14 10:09:09.314162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9635f81b-8b09-4cbc-a601-28aa52119f4e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:09.314511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 966/1925] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:09 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:09.443734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9635f81b-8b09-4cbc-a601-28aa52119f4e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:09.451825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9635f81b-8b09-4cbc-a601-28aa52119f4e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151564 Jul 14 10:09:09.452402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 960/1926] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:09.724228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-029931e0-5028-433f-98bf-2541bcd4bef3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:09.724939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-029931e0-5028-433f-98bf-2541bcd4bef3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:09.731009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-029931e0-5028-433f-98bf-2541bcd4bef3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:09.731459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-029931e0-5028-433f-98bf-2541bcd4bef3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:09.732224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-029931e0-5028-433f-98bf-2541bcd4bef3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:09.732657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-029931e0-5028-433f-98bf-2541bcd4bef3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:09.796367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-029931e0-5028-433f-98bf-2541bcd4bef3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:09.804284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-029931e0-5028-433f-98bf-2541bcd4bef3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084520 Jul 14 10:09:09.804848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 967/1927] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:09 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:10.238055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:10.238700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:10.247230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:10.247682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:10.248451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:10.248886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:10.310145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:10.319250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:10.320763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:10.321908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f2579166-215b-4018-89c9-d45bdaf89f21 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087798 Jul 14 10:09:10.322512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 961/1928] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:10.330832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3b9d0047-82e6-4377-ae9c-2d8f870d8c8c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:10.331470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3b9d0047-82e6-4377-ae9c-2d8f870d8c8c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:10.337903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b9d0047-82e6-4377-ae9c-2d8f870d8c8c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:10.338398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b9d0047-82e6-4377-ae9c-2d8f870d8c8c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:10.339163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b9d0047-82e6-4377-ae9c-2d8f870d8c8c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:10.339599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3b9d0047-82e6-4377-ae9c-2d8f870d8c8c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:10.472931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0f5a87dd-5fd5-4cd3-964f-585faf86d76a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:10.474876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0f5a87dd-5fd5-4cd3-964f-585faf86d76a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:10.480463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3b9d0047-82e6-4377-ae9c-2d8f870d8c8c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:10.485837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f5a87dd-5fd5-4cd3-964f-585faf86d76a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:10.486751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f5a87dd-5fd5-4cd3-964f-585faf86d76a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:10.488172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f5a87dd-5fd5-4cd3-964f-585faf86d76a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:10.488569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3b9d0047-82e6-4377-ae9c-2d8f870d8c8c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.161500 Jul 14 10:09:10.489185 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f5a87dd-5fd5-4cd3-964f-585faf86d76a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:10.489863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 968/1929] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:10 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:10.626312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0f5a87dd-5fd5-4cd3-964f-585faf86d76a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:10.634196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0f5a87dd-5fd5-4cd3-964f-585faf86d76a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.168766 Jul 14 10:09:10.634763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 962/1930] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:10.821369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0483ad21-4338-4f0f-8ac4-592366933dcb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:10.821981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0483ad21-4338-4f0f-8ac4-592366933dcb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:10.828185 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0483ad21-4338-4f0f-8ac4-592366933dcb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:10.828632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0483ad21-4338-4f0f-8ac4-592366933dcb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:10.829395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0483ad21-4338-4f0f-8ac4-592366933dcb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:10.829831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0483ad21-4338-4f0f-8ac4-592366933dcb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:10.893989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0483ad21-4338-4f0f-8ac4-592366933dcb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:10.902954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0483ad21-4338-4f0f-8ac4-592366933dcb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085934 Jul 14 10:09:10.903521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 969/1931] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:10 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:11.340350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:11.340960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:11.347664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:11.348110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:11.348873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:11.349304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:11.413443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:11.422488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:11.424029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:11.425171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-08852015-c9a3-444c-a184-d4576a91824d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088717 Jul 14 10:09:11.425731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 963/1932] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:11.506584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bb95f66a-4b20-40f0-b265-195867591165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:11.507190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bb95f66a-4b20-40f0-b265-195867591165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:11.513777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb95f66a-4b20-40f0-b265-195867591165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:11.514248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb95f66a-4b20-40f0-b265-195867591165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:11.515016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb95f66a-4b20-40f0-b265-195867591165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:11.515444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb95f66a-4b20-40f0-b265-195867591165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:11.649691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bb95f66a-4b20-40f0-b265-195867591165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:11.651382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f39e3a70-f334-4d19-bd4e-4befbaf3d496 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:11.651988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f39e3a70-f334-4d19-bd4e-4befbaf3d496 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:11.658023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f39e3a70-f334-4d19-bd4e-4befbaf3d496 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:11.658499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bb95f66a-4b20-40f0-b265-195867591165 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.156277 Jul 14 10:09:11.658616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f39e3a70-f334-4d19-bd4e-4befbaf3d496 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:11.659227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 970/1933] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:11 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:11.659334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f39e3a70-f334-4d19-bd4e-4befbaf3d496 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:11.659692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f39e3a70-f334-4d19-bd4e-4befbaf3d496 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:11.925216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-50c1fd43-b8ee-4b0b-aa67-3df109c18397 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:11.925925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-50c1fd43-b8ee-4b0b-aa67-3df109c18397 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:11.932810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50c1fd43-b8ee-4b0b-aa67-3df109c18397 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:11.933249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50c1fd43-b8ee-4b0b-aa67-3df109c18397 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:11.934006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50c1fd43-b8ee-4b0b-aa67-3df109c18397 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:11.934454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50c1fd43-b8ee-4b0b-aa67-3df109c18397 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:11.941597 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f39e3a70-f334-4d19-bd4e-4befbaf3d496 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:11.950011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f39e3a70-f334-4d19-bd4e-4befbaf3d496 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.302425 Jul 14 10:09:11.950601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 964/1934] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:11 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:11.998112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-50c1fd43-b8ee-4b0b-aa67-3df109c18397 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:12.006178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-50c1fd43-b8ee-4b0b-aa67-3df109c18397 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085135 Jul 14 10:09:12.006768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 971/1935] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:11 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:12.443923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:12.444520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:12.451082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:12.451525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:12.452279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:12.452711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:12.515245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:12.526633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:12.529443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:12.530650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-858038a3-d6ec-4718-ae59-ffa42ac9940e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090622 Jul 14 10:09:12.531267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 965/1936] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:12.676152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bf89e855-4b5f-45fd-82f5-aedb417e4ae3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:12.676802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bf89e855-4b5f-45fd-82f5-aedb417e4ae3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:12.683365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf89e855-4b5f-45fd-82f5-aedb417e4ae3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:12.683800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf89e855-4b5f-45fd-82f5-aedb417e4ae3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:12.684544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf89e855-4b5f-45fd-82f5-aedb417e4ae3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:12.684970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf89e855-4b5f-45fd-82f5-aedb417e4ae3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:12.823413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bf89e855-4b5f-45fd-82f5-aedb417e4ae3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:12.831853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bf89e855-4b5f-45fd-82f5-aedb417e4ae3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.159546 Jul 14 10:09:12.832628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 972/1937] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:12 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:12.966919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-39c52c07-a044-4f82-99a7-142dfa3ccb41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:12.967622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-39c52c07-a044-4f82-99a7-142dfa3ccb41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:12.977497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39c52c07-a044-4f82-99a7-142dfa3ccb41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:12.977964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39c52c07-a044-4f82-99a7-142dfa3ccb41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:12.978757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39c52c07-a044-4f82-99a7-142dfa3ccb41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:12.979186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39c52c07-a044-4f82-99a7-142dfa3ccb41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:13.024342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fe171ffb-a24e-49f4-a3aa-0fafba557ba5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:13.024879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fe171ffb-a24e-49f4-a3aa-0fafba557ba5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:13.030918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe171ffb-a24e-49f4-a3aa-0fafba557ba5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:13.031356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe171ffb-a24e-49f4-a3aa-0fafba557ba5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:13.032122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe171ffb-a24e-49f4-a3aa-0fafba557ba5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:13.032629 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe171ffb-a24e-49f4-a3aa-0fafba557ba5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:13.103549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fe171ffb-a24e-49f4-a3aa-0fafba557ba5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:13.113237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fe171ffb-a24e-49f4-a3aa-0fafba557ba5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.093571 Jul 14 10:09:13.123677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 973/1938] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:13 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:13.141564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-39c52c07-a044-4f82-99a7-142dfa3ccb41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:13.150730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-39c52c07-a044-4f82-99a7-142dfa3ccb41 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.187624 Jul 14 10:09:13.151539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 966/1939] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:13.550157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:13.550800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:13.557492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:13.557940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:13.558752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:13.559190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:13.626461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:13.635014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:13.636491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:13.637616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-238927a4-7ed5-4f58-b08f-de569f17cbb5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091488 Jul 14 10:09:13.638169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 974/1940] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:13.850301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-298952de-b284-4dbd-b16d-cccc3c25880b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:13.850847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-298952de-b284-4dbd-b16d-cccc3c25880b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:13.857355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-298952de-b284-4dbd-b16d-cccc3c25880b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:13.857796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-298952de-b284-4dbd-b16d-cccc3c25880b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:13.858582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-298952de-b284-4dbd-b16d-cccc3c25880b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:13.859012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-298952de-b284-4dbd-b16d-cccc3c25880b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:13.993419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-298952de-b284-4dbd-b16d-cccc3c25880b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:14.001548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-298952de-b284-4dbd-b16d-cccc3c25880b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155800 Jul 14 10:09:14.002164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 967/1941] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:13 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:14.130869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3171e7be-6a02-4a02-b04b-d5a0481bd843 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:14.131416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3171e7be-6a02-4a02-b04b-d5a0481bd843 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:14.133691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:14.139392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3171e7be-6a02-4a02-b04b-d5a0481bd843 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:14.139835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3171e7be-6a02-4a02-b04b-d5a0481bd843 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:14.140602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3171e7be-6a02-4a02-b04b-d5a0481bd843 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:14.141030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3171e7be-6a02-4a02-b04b-d5a0481bd843 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:14.169398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:14.169812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-665c176d-0988-4811-a7e7-12765f3072a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:14.170548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-665c176d-0988-4811-a7e7-12765f3072a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:14.176619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-665c176d-0988-4811-a7e7-12765f3072a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:14.177072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-665c176d-0988-4811-a7e7-12765f3072a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:14.177852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-665c176d-0988-4811-a7e7-12765f3072a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:14.178328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-665c176d-0988-4811-a7e7-12765f3072a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:14.218019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3171e7be-6a02-4a02-b04b-d5a0481bd843 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:14.227022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3171e7be-6a02-4a02-b04b-d5a0481bd843 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.100059 Jul 14 10:09:14.227601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 975/1942] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:14 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:14.321485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-665c176d-0988-4811-a7e7-12765f3072a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:14.329552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-665c176d-0988-4811-a7e7-12765f3072a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.164494 Jul 14 10:09:14.330119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 968/1943] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:14.655670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:14.656262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:14.663171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:14.663621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:14.664378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:14.664817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:14.725339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:14.733702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:14.735241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:14.736386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ac3db041-b2ac-4586-a198-61db93a52d6f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084630 Jul 14 10:09:14.736937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 976/1944] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:15.018861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-aae2a798-db88-4597-bc6c-3d791d4f4804 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:15.019520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-aae2a798-db88-4597-bc6c-3d791d4f4804 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:15.026147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aae2a798-db88-4597-bc6c-3d791d4f4804 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:15.026645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aae2a798-db88-4597-bc6c-3d791d4f4804 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:15.027416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aae2a798-db88-4597-bc6c-3d791d4f4804 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:15.027858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-aae2a798-db88-4597-bc6c-3d791d4f4804 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:15.153666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-aae2a798-db88-4597-bc6c-3d791d4f4804 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:15.162274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-aae2a798-db88-4597-bc6c-3d791d4f4804 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147301 Jul 14 10:09:15.162832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 969/1945] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:15 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:15.243824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e6b8661c-b805-4ebc-84e8-4bcae448831b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:15.244416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e6b8661c-b805-4ebc-84e8-4bcae448831b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:15.251039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6b8661c-b805-4ebc-84e8-4bcae448831b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:15.251484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6b8661c-b805-4ebc-84e8-4bcae448831b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:15.252243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6b8661c-b805-4ebc-84e8-4bcae448831b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:15.252679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e6b8661c-b805-4ebc-84e8-4bcae448831b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:15.319545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e6b8661c-b805-4ebc-84e8-4bcae448831b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:15.327479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e6b8661c-b805-4ebc-84e8-4bcae448831b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087631 Jul 14 10:09:15.328035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 977/1946] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:15 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:15.347106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-21ae7119-927b-4c32-bf78-ed184cb16d10 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:15.348408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-21ae7119-927b-4c32-bf78-ed184cb16d10 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:15.354394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21ae7119-927b-4c32-bf78-ed184cb16d10 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:15.354838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21ae7119-927b-4c32-bf78-ed184cb16d10 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:15.355587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21ae7119-927b-4c32-bf78-ed184cb16d10 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:15.356017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-21ae7119-927b-4c32-bf78-ed184cb16d10 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:15.358508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:15.493970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-21ae7119-927b-4c32-bf78-ed184cb16d10 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:15.502844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-21ae7119-927b-4c32-bf78-ed184cb16d10 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.159507 Jul 14 10:09:15.503406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 970/1947] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:15.754940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:15.755545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:15.762217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:15.762671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:15.763430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:15.763859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:15.825859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:15.834432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:15.835930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:15.837058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fe97b43f-bb54-4d79-9641-c01d33f4bf40 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086146 Jul 14 10:09:15.837611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 978/1948] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:16.179782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-769167bb-77bd-4b81-8c6f-c7491bc27648 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:16.180388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-769167bb-77bd-4b81-8c6f-c7491bc27648 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:16.187084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-769167bb-77bd-4b81-8c6f-c7491bc27648 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:16.187534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-769167bb-77bd-4b81-8c6f-c7491bc27648 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:16.188298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-769167bb-77bd-4b81-8c6f-c7491bc27648 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:16.188731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-769167bb-77bd-4b81-8c6f-c7491bc27648 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:16.319279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-769167bb-77bd-4b81-8c6f-c7491bc27648 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:16.327287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-769167bb-77bd-4b81-8c6f-c7491bc27648 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151378 Jul 14 10:09:16.327843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 971/1949] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:16 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:16.344880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-57c16735-e161-4587-8412-1611c4da5f4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:16.345501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-57c16735-e161-4587-8412-1611c4da5f4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:16.353592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-57c16735-e161-4587-8412-1611c4da5f4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:16.354031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-57c16735-e161-4587-8412-1611c4da5f4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:16.354860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-57c16735-e161-4587-8412-1611c4da5f4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:16.355287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-57c16735-e161-4587-8412-1611c4da5f4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:16.419592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-57c16735-e161-4587-8412-1611c4da5f4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:16.427908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-57c16735-e161-4587-8412-1611c4da5f4b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086956 Jul 14 10:09:16.428471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 979/1950] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:16 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:16.521641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bf535325-d137-4f31-87b3-471eccdd0282 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:16.522168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bf535325-d137-4f31-87b3-471eccdd0282 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:16.524172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:16.530010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf535325-d137-4f31-87b3-471eccdd0282 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:16.530489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf535325-d137-4f31-87b3-471eccdd0282 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:16.531265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf535325-d137-4f31-87b3-471eccdd0282 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:16.531701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf535325-d137-4f31-87b3-471eccdd0282 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:16.663461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bf535325-d137-4f31-87b3-471eccdd0282 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:16.671803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bf535325-d137-4f31-87b3-471eccdd0282 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.154753 Jul 14 10:09:16.672374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 972/1951] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:16 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:16.855234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:16.855743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:16.861978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:16.862454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:16.863306 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:16.863733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:16.931399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:16.939972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:16.941489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:16.943332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2f81f65c-a18d-47aa-b95e-b38ab88ff31a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092138 Jul 14 10:09:16.943890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 980/1952] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:17.345139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e659449f-0bab-46e1-80f0-39373d511110 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:17.345941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e659449f-0bab-46e1-80f0-39373d511110 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:17.353335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e659449f-0bab-46e1-80f0-39373d511110 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:17.353781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e659449f-0bab-46e1-80f0-39373d511110 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:17.354569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e659449f-0bab-46e1-80f0-39373d511110 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:17.355003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e659449f-0bab-46e1-80f0-39373d511110 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:17.445220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e9805751-bc2e-45b5-ad04-36785179158f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:17.445822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e9805751-bc2e-45b5-ad04-36785179158f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:17.454428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9805751-bc2e-45b5-ad04-36785179158f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:17.454894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9805751-bc2e-45b5-ad04-36785179158f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:17.455700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9805751-bc2e-45b5-ad04-36785179158f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:17.456132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9805751-bc2e-45b5-ad04-36785179158f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:17.490077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e659449f-0bab-46e1-80f0-39373d511110 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:17.500081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e659449f-0bab-46e1-80f0-39373d511110 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.158593 Jul 14 10:09:17.500661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 973/1953] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:17 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:17.531214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e9805751-bc2e-45b5-ad04-36785179158f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:17.540068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e9805751-bc2e-45b5-ad04-36785179158f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.098572 Jul 14 10:09:17.540642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 981/1954] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:17 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:17.688883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b7bb3473-030c-4341-ad2d-2c854183fed1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:17.689491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b7bb3473-030c-4341-ad2d-2c854183fed1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:17.695634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7bb3473-030c-4341-ad2d-2c854183fed1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:17.696081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7bb3473-030c-4341-ad2d-2c854183fed1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:17.696830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7bb3473-030c-4341-ad2d-2c854183fed1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:17.697257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7bb3473-030c-4341-ad2d-2c854183fed1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:17.827033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b7bb3473-030c-4341-ad2d-2c854183fed1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:17.835487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b7bb3473-030c-4341-ad2d-2c854183fed1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150473 Jul 14 10:09:17.836035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 974/1955] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:17.961966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:17.962625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:17.968730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:17.969177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:17.969944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:17.970414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:18.032127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:18.040733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:18.042277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:18.043417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6cea5146-6953-43fd-a3b7-85d1c14e99a2 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085982 Jul 14 10:09:18.044229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 982/1956] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:18.516873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cb2e50ab-cc94-4a36-a320-9b6d9c650a0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:18.517486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cb2e50ab-cc94-4a36-a320-9b6d9c650a0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:18.525213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb2e50ab-cc94-4a36-a320-9b6d9c650a0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:18.525751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb2e50ab-cc94-4a36-a320-9b6d9c650a0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:18.526434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb2e50ab-cc94-4a36-a320-9b6d9c650a0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:18.527315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cb2e50ab-cc94-4a36-a320-9b6d9c650a0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:18.564034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-87f34747-37d2-4a2d-b9cd-5485a17361f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:18.568845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-87f34747-37d2-4a2d-b9cd-5485a17361f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:18.575119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87f34747-37d2-4a2d-b9cd-5485a17361f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:18.575608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87f34747-37d2-4a2d-b9cd-5485a17361f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:18.576362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87f34747-37d2-4a2d-b9cd-5485a17361f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:18.576792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87f34747-37d2-4a2d-b9cd-5485a17361f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:18.656259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-87f34747-37d2-4a2d-b9cd-5485a17361f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:18.664387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-87f34747-37d2-4a2d-b9cd-5485a17361f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.106492 Jul 14 10:09:18.664955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 983/1957] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:18 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:18.685484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cb2e50ab-cc94-4a36-a320-9b6d9c650a0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:18.694135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cb2e50ab-cc94-4a36-a320-9b6d9c650a0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.181100 Jul 14 10:09:18.694721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 975/1958] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:18 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:18.853040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b4547682-35ab-425a-bb3f-44640d0373d7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:18.853584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b4547682-35ab-425a-bb3f-44640d0373d7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:18.859655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4547682-35ab-425a-bb3f-44640d0373d7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:18.860102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4547682-35ab-425a-bb3f-44640d0373d7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:18.860853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4547682-35ab-425a-bb3f-44640d0373d7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:18.861282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4547682-35ab-425a-bb3f-44640d0373d7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:18.987681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b4547682-35ab-425a-bb3f-44640d0373d7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:18.996195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b4547682-35ab-425a-bb3f-44640d0373d7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147656 Jul 14 10:09:18.996754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 984/1959] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:18 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:19.060876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:19.061479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:19.067679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:19.068118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:19.068871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:19.069304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:19.131679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:19.140496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:19.141990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:19.143204 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e55b8f8b-9e38-4ad3-9101-7614e170e8b6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086240 Jul 14 10:09:19.143750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 976/1960] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:19 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:19.682501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a218862e-17b4-4f44-95a6-626ca5979d81 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:19.683666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a218862e-17b4-4f44-95a6-626ca5979d81 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:19.689775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a218862e-17b4-4f44-95a6-626ca5979d81 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:19.690251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a218862e-17b4-4f44-95a6-626ca5979d81 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:19.691033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a218862e-17b4-4f44-95a6-626ca5979d81 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:19.691469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a218862e-17b4-4f44-95a6-626ca5979d81 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:19.711055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4bf9065a-837a-4e72-a115-368e49a2efd0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:19.711661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4bf9065a-837a-4e72-a115-368e49a2efd0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:19.718154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4bf9065a-837a-4e72-a115-368e49a2efd0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:19.718629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4bf9065a-837a-4e72-a115-368e49a2efd0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:19.719389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4bf9065a-837a-4e72-a115-368e49a2efd0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:19.719871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4bf9065a-837a-4e72-a115-368e49a2efd0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:19.756805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a218862e-17b4-4f44-95a6-626ca5979d81 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:19.765456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a218862e-17b4-4f44-95a6-626ca5979d81 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086871 Jul 14 10:09:19.766037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 985/1961] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:19 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:19.854297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4bf9065a-837a-4e72-a115-368e49a2efd0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:19.862320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4bf9065a-837a-4e72-a115-368e49a2efd0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155096 Jul 14 10:09:19.862913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 977/1962] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:19 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:20.013330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-63ca012e-e46a-455a-a10a-7f20024c7f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:20.013989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-63ca012e-e46a-455a-a10a-7f20024c7f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:20.020923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63ca012e-e46a-455a-a10a-7f20024c7f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:20.021361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63ca012e-e46a-455a-a10a-7f20024c7f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:20.022250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63ca012e-e46a-455a-a10a-7f20024c7f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:20.022681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63ca012e-e46a-455a-a10a-7f20024c7f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:20.151965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-63ca012e-e46a-455a-a10a-7f20024c7f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:20.161627 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-63ca012e-e46a-455a-a10a-7f20024c7f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151526 Jul 14 10:09:20.161872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:20.162217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 986/1963] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:20.162398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:20.168512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:20.169206 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:20.169987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:20.170500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:20.235942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:20.249176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:20.250746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:20.251950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-26f16964-3698-4882-92de-543787adb0b1 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.094895 Jul 14 10:09:20.252430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 978/1964] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:20.782699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-00c72b0f-56de-4c37-8cd9-05b284b63bdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:20.783307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-00c72b0f-56de-4c37-8cd9-05b284b63bdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:20.790473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00c72b0f-56de-4c37-8cd9-05b284b63bdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:20.790913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00c72b0f-56de-4c37-8cd9-05b284b63bdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:20.791669 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00c72b0f-56de-4c37-8cd9-05b284b63bdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:20.792099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00c72b0f-56de-4c37-8cd9-05b284b63bdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:20.856157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-00c72b0f-56de-4c37-8cd9-05b284b63bdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:20.864154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-00c72b0f-56de-4c37-8cd9-05b284b63bdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085282 Jul 14 10:09:20.864716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 987/1965] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:20 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:20.879876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-89f1be85-14c6-4e51-bfb0-126ee4e7e7d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:20.880456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-89f1be85-14c6-4e51-bfb0-126ee4e7e7d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:20.886997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89f1be85-14c6-4e51-bfb0-126ee4e7e7d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:20.887444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89f1be85-14c6-4e51-bfb0-126ee4e7e7d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:20.888201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89f1be85-14c6-4e51-bfb0-126ee4e7e7d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:20.888634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-89f1be85-14c6-4e51-bfb0-126ee4e7e7d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:21.021118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-89f1be85-14c6-4e51-bfb0-126ee4e7e7d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:21.029425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-89f1be85-14c6-4e51-bfb0-126ee4e7e7d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153405 Jul 14 10:09:21.029981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 979/1966] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:20 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:21.180787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f527edc-ab63-441f-8b50-5cc30ea234f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:21.181881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f527edc-ab63-441f-8b50-5cc30ea234f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:21.191785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f527edc-ab63-441f-8b50-5cc30ea234f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:21.193080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f527edc-ab63-441f-8b50-5cc30ea234f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:21.194406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f527edc-ab63-441f-8b50-5cc30ea234f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:21.195139 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f527edc-ab63-441f-8b50-5cc30ea234f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:21.272070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:21.272839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:21.279195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:21.279646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:21.280415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:21.280850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:21.343006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9f527edc-ab63-441f-8b50-5cc30ea234f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:21.351143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f527edc-ab63-441f-8b50-5cc30ea234f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.176247 Jul 14 10:09:21.351717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 988/1967] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:21.359022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:21.368346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:21.369852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:21.371057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ee3c1a29-6008-4d9d-824f-964273e497e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.104447 Jul 14 10:09:21.371610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 980/1968] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:21.881226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ad49c3ec-d58f-4429-8fa8-e24cae42c06b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:21.881798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ad49c3ec-d58f-4429-8fa8-e24cae42c06b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:21.888536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad49c3ec-d58f-4429-8fa8-e24cae42c06b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:21.888974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad49c3ec-d58f-4429-8fa8-e24cae42c06b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:21.889733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad49c3ec-d58f-4429-8fa8-e24cae42c06b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:21.890166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad49c3ec-d58f-4429-8fa8-e24cae42c06b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:21.952550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ad49c3ec-d58f-4429-8fa8-e24cae42c06b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:21.960963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ad49c3ec-d58f-4429-8fa8-e24cae42c06b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083718 Jul 14 10:09:21.961536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 989/1969] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:21 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:22.046667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3123b2bb-2cde-4219-8969-c441e1c497dc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:22.047274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3123b2bb-2cde-4219-8969-c441e1c497dc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:22.054197 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3123b2bb-2cde-4219-8969-c441e1c497dc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:22.054663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3123b2bb-2cde-4219-8969-c441e1c497dc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:22.055414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3123b2bb-2cde-4219-8969-c441e1c497dc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:22.055845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3123b2bb-2cde-4219-8969-c441e1c497dc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:22.187569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3123b2bb-2cde-4219-8969-c441e1c497dc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:22.197090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3123b2bb-2cde-4219-8969-c441e1c497dc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154593 Jul 14 10:09:22.197657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 981/1970] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:22 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:22.367940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-263a6d9a-d750-4297-be29-c2b37ee52478 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:22.368548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-263a6d9a-d750-4297-be29-c2b37ee52478 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:22.374704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-263a6d9a-d750-4297-be29-c2b37ee52478 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:22.375166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-263a6d9a-d750-4297-be29-c2b37ee52478 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:22.375920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-263a6d9a-d750-4297-be29-c2b37ee52478 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:22.376348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-263a6d9a-d750-4297-be29-c2b37ee52478 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:22.389622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:22.390148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:22.396602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:22.397044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:22.397800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:22.398251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:22.478024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:22.486710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:22.488237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:22.489391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-48d4c043-3df1-40f6-ac7a-73174a78f02e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.103786 Jul 14 10:09:22.489954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 982/1971] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:22.536850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-263a6d9a-d750-4297-be29-c2b37ee52478 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:22.545894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-263a6d9a-d750-4297-be29-c2b37ee52478 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.181814 Jul 14 10:09:22.546495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 990/1972] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:22 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:22.978395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e4842155-2864-4e78-bfa6-d7c2b2ab15ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:22.978999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e4842155-2864-4e78-bfa6-d7c2b2ab15ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:22.984972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4842155-2864-4e78-bfa6-d7c2b2ab15ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:22.985417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4842155-2864-4e78-bfa6-d7c2b2ab15ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:22.986166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4842155-2864-4e78-bfa6-d7c2b2ab15ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:22.986617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e4842155-2864-4e78-bfa6-d7c2b2ab15ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:23.048148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e4842155-2864-4e78-bfa6-d7c2b2ab15ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:23.056578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e4842155-2864-4e78-bfa6-d7c2b2ab15ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082659 Jul 14 10:09:23.057143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 983/1973] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:22 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:23.214766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-005f478c-c688-41a5-ac6b-be90300711d7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:23.215562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-005f478c-c688-41a5-ac6b-be90300711d7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:23.222404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-005f478c-c688-41a5-ac6b-be90300711d7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:23.222799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-005f478c-c688-41a5-ac6b-be90300711d7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:23.223591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-005f478c-c688-41a5-ac6b-be90300711d7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:23.224086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-005f478c-c688-41a5-ac6b-be90300711d7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:23.362909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-005f478c-c688-41a5-ac6b-be90300711d7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:23.370896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-005f478c-c688-41a5-ac6b-be90300711d7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.160199 Jul 14 10:09:23.371451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 991/1974] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:23 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:23.508435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:23.508955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:23.515342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:23.515795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:23.516640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:23.517082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:23.566599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f9f2fb8b-c140-4c08-9946-b80de0e351a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:23.567075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f9f2fb8b-c140-4c08-9946-b80de0e351a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:23.575176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb8b-c140-4c08-9946-b80de0e351a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:23.575640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb8b-c140-4c08-9946-b80de0e351a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:23.576408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb8b-c140-4c08-9946-b80de0e351a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:23.576839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb8b-c140-4c08-9946-b80de0e351a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:23.579770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:23.581779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:23.591169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:23.592673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:23.594000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6804c829-4c8f-47e3-bac8-b8353b3e9618 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090372 Jul 14 10:09:23.594584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 984/1975] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:23.710652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f9f2fb8b-c140-4c08-9946-b80de0e351a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:23.720001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f9f2fb8b-c140-4c08-9946-b80de0e351a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.159904 Jul 14 10:09:23.720765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 992/1976] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:24.073897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-32e40ea6-b651-45b7-b741-8dcececc122e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:24.074560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-32e40ea6-b651-45b7-b741-8dcececc122e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:24.081495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32e40ea6-b651-45b7-b741-8dcececc122e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:24.081951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32e40ea6-b651-45b7-b741-8dcececc122e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:24.082740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32e40ea6-b651-45b7-b741-8dcececc122e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:24.083214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32e40ea6-b651-45b7-b741-8dcececc122e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:24.149267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-32e40ea6-b651-45b7-b741-8dcececc122e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:24.157591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-32e40ea6-b651-45b7-b741-8dcececc122e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087787 Jul 14 10:09:24.158162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 985/1977] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:24 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:24.388296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-31f57277-41c2-4d7f-a20e-214ee9ff899a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:24.388853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-31f57277-41c2-4d7f-a20e-214ee9ff899a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:24.395871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-31f57277-41c2-4d7f-a20e-214ee9ff899a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:24.396806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-31f57277-41c2-4d7f-a20e-214ee9ff899a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:24.397573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-31f57277-41c2-4d7f-a20e-214ee9ff899a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:24.398000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-31f57277-41c2-4d7f-a20e-214ee9ff899a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:24.529385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-31f57277-41c2-4d7f-a20e-214ee9ff899a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:24.538085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-31f57277-41c2-4d7f-a20e-214ee9ff899a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153731 Jul 14 10:09:24.538705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 993/1978] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:24 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:24.612151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:24.612744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:24.619214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:24.619665 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:24.620496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:24.620931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:24.682803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:24.684976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:24.692578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:24.694625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:24.695766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-522830ac-6b9a-4ac6-97ef-4ff66c693a64 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087617 Jul 14 10:09:24.696318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 986/1979] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:24.736921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cd01f8fe-3062-4fcc-a104-d44685071f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:24.737534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cd01f8fe-3062-4fcc-a104-d44685071f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:24.743800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd01f8fe-3062-4fcc-a104-d44685071f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:24.744252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd01f8fe-3062-4fcc-a104-d44685071f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:24.745047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd01f8fe-3062-4fcc-a104-d44685071f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:24.745456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd01f8fe-3062-4fcc-a104-d44685071f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:25.141680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cd01f8fe-3062-4fcc-a104-d44685071f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:25.150396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cd01f8fe-3062-4fcc-a104-d44685071f89 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.417296 Jul 14 10:09:25.151001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 994/1980] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:24 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:25.176171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bdfd3f13-5e96-40c6-98f6-38bae35ef99f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:25.176787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bdfd3f13-5e96-40c6-98f6-38bae35ef99f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:25.184023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bdfd3f13-5e96-40c6-98f6-38bae35ef99f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:25.184482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bdfd3f13-5e96-40c6-98f6-38bae35ef99f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:25.185285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bdfd3f13-5e96-40c6-98f6-38bae35ef99f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:25.185840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bdfd3f13-5e96-40c6-98f6-38bae35ef99f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:25.251216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bdfd3f13-5e96-40c6-98f6-38bae35ef99f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:25.259934 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bdfd3f13-5e96-40c6-98f6-38bae35ef99f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087953 Jul 14 10:09:25.260504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 987/1981] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:25 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:25.556188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d27072b8-36fe-4f66-8efb-8605b6694b9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:25.556810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d27072b8-36fe-4f66-8efb-8605b6694b9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:25.563397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d27072b8-36fe-4f66-8efb-8605b6694b9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:25.563841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d27072b8-36fe-4f66-8efb-8605b6694b9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:25.564610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d27072b8-36fe-4f66-8efb-8605b6694b9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:25.565050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d27072b8-36fe-4f66-8efb-8605b6694b9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:25.694557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d27072b8-36fe-4f66-8efb-8605b6694b9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:25.702610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d27072b8-36fe-4f66-8efb-8605b6694b9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151041 Jul 14 10:09:25.703169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 995/1982] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:25 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:25.712830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:25.713437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:25.719500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:25.720022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:25.720732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:25.721173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:25.785043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:25.794024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:25.795813 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:25.796945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8feecadf-199f-460e-9a74-9353ffc34837 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088059 Jul 14 10:09:25.797506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 988/1983] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:26.168982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-20cac7b7-c17f-427e-9f9d-380ec88a3217 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:26.169844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-20cac7b7-c17f-427e-9f9d-380ec88a3217 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:26.176030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-20cac7b7-c17f-427e-9f9d-380ec88a3217 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:26.176468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-20cac7b7-c17f-427e-9f9d-380ec88a3217 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:26.177222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-20cac7b7-c17f-427e-9f9d-380ec88a3217 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:26.177732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-20cac7b7-c17f-427e-9f9d-380ec88a3217 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:26.277377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3481f03e-d7a2-4b3b-8ff4-2a63a1c3c71a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:26.277988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3481f03e-d7a2-4b3b-8ff4-2a63a1c3c71a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:26.284769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3481f03e-d7a2-4b3b-8ff4-2a63a1c3c71a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:26.285219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3481f03e-d7a2-4b3b-8ff4-2a63a1c3c71a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:26.285995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3481f03e-d7a2-4b3b-8ff4-2a63a1c3c71a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:26.286458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3481f03e-d7a2-4b3b-8ff4-2a63a1c3c71a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:26.307184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-20cac7b7-c17f-427e-9f9d-380ec88a3217 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:26.318682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-20cac7b7-c17f-427e-9f9d-380ec88a3217 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152801 Jul 14 10:09:26.319276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 996/1984] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:26.356611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3481f03e-d7a2-4b3b-8ff4-2a63a1c3c71a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:26.364767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3481f03e-d7a2-4b3b-8ff4-2a63a1c3c71a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091238 Jul 14 10:09:26.366006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 989/1985] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:26 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:26.720462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4af6c94f-ca14-48a6-9132-e624fa571694 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:26.721064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4af6c94f-ca14-48a6-9132-e624fa571694 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:26.728214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4af6c94f-ca14-48a6-9132-e624fa571694 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:26.728651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4af6c94f-ca14-48a6-9132-e624fa571694 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:26.729400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4af6c94f-ca14-48a6-9132-e624fa571694 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:26.729859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4af6c94f-ca14-48a6-9132-e624fa571694 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:26.816501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:26.817195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:26.823433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:26.823876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:26.824637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:26.825068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:26.874425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4af6c94f-ca14-48a6-9132-e624fa571694 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:26.882708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4af6c94f-ca14-48a6-9132-e624fa571694 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.166187 Jul 14 10:09:26.883296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 997/1986] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:26 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:26.891100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:26.900112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:26.901599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:26.902771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d7957a2c-3a40-4232-acce-5879e71c2e5b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090847 Jul 14 10:09:26.903320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 990/1987] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:27.339744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6d270f96-9913-46e0-8992-8e245a1e8a05 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:27.340350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6d270f96-9913-46e0-8992-8e245a1e8a05 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:27.346586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6d270f96-9913-46e0-8992-8e245a1e8a05 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:27.347022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6d270f96-9913-46e0-8992-8e245a1e8a05 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:27.347789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6d270f96-9913-46e0-8992-8e245a1e8a05 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:27.348216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6d270f96-9913-46e0-8992-8e245a1e8a05 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:27.383019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-29f03e8e-da36-4980-8574-0d7a2f3c6607 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:27.383607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-29f03e8e-da36-4980-8574-0d7a2f3c6607 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:27.390528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-29f03e8e-da36-4980-8574-0d7a2f3c6607 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:27.390979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-29f03e8e-da36-4980-8574-0d7a2f3c6607 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:27.391768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-29f03e8e-da36-4980-8574-0d7a2f3c6607 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:27.392201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-29f03e8e-da36-4980-8574-0d7a2f3c6607 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:27.475339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-29f03e8e-da36-4980-8574-0d7a2f3c6607 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:27.483370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-29f03e8e-da36-4980-8574-0d7a2f3c6607 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.104863 Jul 14 10:09:27.483947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 991/1988] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:27 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:27.506957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6d270f96-9913-46e0-8992-8e245a1e8a05 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:27.514681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6d270f96-9913-46e0-8992-8e245a1e8a05 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.178874 Jul 14 10:09:27.515259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 998/1989] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:27.899794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-11ecd93b-a85b-4936-a7f1-cd5f6098247e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:27.900321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-11ecd93b-a85b-4936-a7f1-cd5f6098247e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:27.906748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-11ecd93b-a85b-4936-a7f1-cd5f6098247e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:27.907112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-11ecd93b-a85b-4936-a7f1-cd5f6098247e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:27.907868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-11ecd93b-a85b-4936-a7f1-cd5f6098247e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:27.908321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-11ecd93b-a85b-4936-a7f1-cd5f6098247e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:27.922101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:27.922763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:27.929657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:27.930094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:27.930888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:27.931313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:28.009913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:28.018382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:28.019873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:28.021006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-54b858b3-ccc8-4e12-8248-54a23861e126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.103547 Jul 14 10:09:28.022123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 999/1990] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:28.066966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-11ecd93b-a85b-4936-a7f1-cd5f6098247e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:28.075578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-11ecd93b-a85b-4936-a7f1-cd5f6098247e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.179739 Jul 14 10:09:28.076140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 992/1991] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:27 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:28.499930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7f4a42cc-83d3-4cab-b9c4-05c4f4dcacab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:28.500531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7f4a42cc-83d3-4cab-b9c4-05c4f4dcacab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:28.506748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f4a42cc-83d3-4cab-b9c4-05c4f4dcacab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:28.507193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f4a42cc-83d3-4cab-b9c4-05c4f4dcacab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:28.507949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f4a42cc-83d3-4cab-b9c4-05c4f4dcacab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:28.508378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f4a42cc-83d3-4cab-b9c4-05c4f4dcacab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:28.532115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0630ece2-a826-4a4f-89c5-609baf81c140 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:28.532780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0630ece2-a826-4a4f-89c5-609baf81c140 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:28.539957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0630ece2-a826-4a4f-89c5-609baf81c140 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:28.540556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0630ece2-a826-4a4f-89c5-609baf81c140 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:28.541441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0630ece2-a826-4a4f-89c5-609baf81c140 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:28.541880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0630ece2-a826-4a4f-89c5-609baf81c140 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:28.575075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7f4a42cc-83d3-4cab-b9c4-05c4f4dcacab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:28.583055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7f4a42cc-83d3-4cab-b9c4-05c4f4dcacab tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086943 Jul 14 10:09:28.583634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1000/1992] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:28 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:28.676537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0630ece2-a826-4a4f-89c5-609baf81c140 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:28.685155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0630ece2-a826-4a4f-89c5-609baf81c140 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.157312 Jul 14 10:09:28.685718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 993/1993] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:29.040529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:29.041082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:29.047745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:29.048241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:29.048932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:29.049357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:29.092859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5f126e5c-fa25-4e34-bd5e-ae07117a7fa8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:29.093470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5f126e5c-fa25-4e34-bd5e-ae07117a7fa8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:29.100271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f126e5c-fa25-4e34-bd5e-ae07117a7fa8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:29.100721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f126e5c-fa25-4e34-bd5e-ae07117a7fa8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:29.101491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f126e5c-fa25-4e34-bd5e-ae07117a7fa8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:29.101926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f126e5c-fa25-4e34-bd5e-ae07117a7fa8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:29.111905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:29.120635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:29.122132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:29.123298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-064f80a8-ff37-471f-a012-5c405d291020 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087501 Jul 14 10:09:29.123862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1001/1994] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:29.236360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5f126e5c-fa25-4e34-bd5e-ae07117a7fa8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:29.244438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5f126e5c-fa25-4e34-bd5e-ae07117a7fa8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155519 Jul 14 10:09:29.245000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 994/1995] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:29 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:29.601827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-88122258-c5dd-4a8d-8fc4-857e445faf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:29.601827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-88122258-c5dd-4a8d-8fc4-857e445faf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:29.607901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88122258-c5dd-4a8d-8fc4-857e445faf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:29.608344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88122258-c5dd-4a8d-8fc4-857e445faf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:29.609109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88122258-c5dd-4a8d-8fc4-857e445faf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:29.609538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88122258-c5dd-4a8d-8fc4-857e445faf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:29.676101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-88122258-c5dd-4a8d-8fc4-857e445faf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:29.685616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-88122258-c5dd-4a8d-8fc4-857e445faf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088219 Jul 14 10:09:29.686163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1002/1996] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:29 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:29.702147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0b609ac6-8b4a-41a8-b491-fd36b211bb76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:29.702798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0b609ac6-8b4a-41a8-b491-fd36b211bb76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:29.709417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b609ac6-8b4a-41a8-b491-fd36b211bb76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:29.709856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b609ac6-8b4a-41a8-b491-fd36b211bb76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:29.710704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b609ac6-8b4a-41a8-b491-fd36b211bb76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:29.711131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0b609ac6-8b4a-41a8-b491-fd36b211bb76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:29.842743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0b609ac6-8b4a-41a8-b491-fd36b211bb76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:29.850786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0b609ac6-8b4a-41a8-b491-fd36b211bb76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152515 Jul 14 10:09:29.851344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 995/1997] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:30.145973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:30.146538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:30.153194 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:30.153630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:30.154426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:30.154853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:30.225091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:30.233468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:30.234992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:30.236139 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4ff36a5b-983f-4864-979f-d17ffb3eed2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.094206 Jul 14 10:09:30.236696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1003/1998] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:30 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:30.260783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6df4d39a-8d1e-49ac-b7b8-8be4a70dc1c9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:30.261427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6df4d39a-8d1e-49ac-b7b8-8be4a70dc1c9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:30.267507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6df4d39a-8d1e-49ac-b7b8-8be4a70dc1c9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:30.267955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6df4d39a-8d1e-49ac-b7b8-8be4a70dc1c9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:30.268719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6df4d39a-8d1e-49ac-b7b8-8be4a70dc1c9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:30.269156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6df4d39a-8d1e-49ac-b7b8-8be4a70dc1c9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:30.406364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6df4d39a-8d1e-49ac-b7b8-8be4a70dc1c9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:30.418580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6df4d39a-8d1e-49ac-b7b8-8be4a70dc1c9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.161402 Jul 14 10:09:30.419696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 996/1999] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:30 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:30.703312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-687a43b0-5587-42c2-97f1-4e30bd2b0f33 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:30.703911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-687a43b0-5587-42c2-97f1-4e30bd2b0f33 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:30.710614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-687a43b0-5587-42c2-97f1-4e30bd2b0f33 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:30.711054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-687a43b0-5587-42c2-97f1-4e30bd2b0f33 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:30.711805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-687a43b0-5587-42c2-97f1-4e30bd2b0f33 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:30.712231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-687a43b0-5587-42c2-97f1-4e30bd2b0f33 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:30.773324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-687a43b0-5587-42c2-97f1-4e30bd2b0f33 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:30.781376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-687a43b0-5587-42c2-97f1-4e30bd2b0f33 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081980 Jul 14 10:09:30.781932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1004/2000] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:30 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:30.868203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-01f899d3-c30d-482d-aa6d-67bbcad6ce19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:30.868809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-01f899d3-c30d-482d-aa6d-67bbcad6ce19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:30.875253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01f899d3-c30d-482d-aa6d-67bbcad6ce19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:30.875700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01f899d3-c30d-482d-aa6d-67bbcad6ce19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:30.876461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01f899d3-c30d-482d-aa6d-67bbcad6ce19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:30.876929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-01f899d3-c30d-482d-aa6d-67bbcad6ce19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:31.015418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-01f899d3-c30d-482d-aa6d-67bbcad6ce19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:31.024412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-01f899d3-c30d-482d-aa6d-67bbcad6ce19 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.160018 Jul 14 10:09:31.024994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 997/2001] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:30 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:31.255575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:31.256709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:31.263239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:31.263689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:31.264456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:31.264889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:31.337881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:31.346916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:31.348505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:31.349706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-41bb7991-0f8a-4ea5-bd9c-655498377388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.098149 Jul 14 10:09:31.350289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1005/2002] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:31.440975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e580151a-3e41-425d-81de-bd722a08a9d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:31.441574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e580151a-3e41-425d-81de-bd722a08a9d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:31.448253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e580151a-3e41-425d-81de-bd722a08a9d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:31.448692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e580151a-3e41-425d-81de-bd722a08a9d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:31.449440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e580151a-3e41-425d-81de-bd722a08a9d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:31.449869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e580151a-3e41-425d-81de-bd722a08a9d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:31.579724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e580151a-3e41-425d-81de-bd722a08a9d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:31.587833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e580151a-3e41-425d-81de-bd722a08a9d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150701 Jul 14 10:09:31.588401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 998/2003] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:31 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:31.798986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-15df6e03-bd3e-480d-93d9-076d89c3055e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:31.799505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-15df6e03-bd3e-480d-93d9-076d89c3055e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:31.806218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15df6e03-bd3e-480d-93d9-076d89c3055e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:31.806659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15df6e03-bd3e-480d-93d9-076d89c3055e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:31.807415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15df6e03-bd3e-480d-93d9-076d89c3055e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:31.807838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15df6e03-bd3e-480d-93d9-076d89c3055e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:31.875307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-15df6e03-bd3e-480d-93d9-076d89c3055e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:31.883411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-15df6e03-bd3e-480d-93d9-076d89c3055e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088443 Jul 14 10:09:31.883995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1006/2004] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:31 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:32.042293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-db8ca8bf-c696-4e8c-a72d-6ee68f7ecbd5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:32.042872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-db8ca8bf-c696-4e8c-a72d-6ee68f7ecbd5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:32.049559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db8ca8bf-c696-4e8c-a72d-6ee68f7ecbd5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:32.049940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db8ca8bf-c696-4e8c-a72d-6ee68f7ecbd5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:32.050722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db8ca8bf-c696-4e8c-a72d-6ee68f7ecbd5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:32.051150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db8ca8bf-c696-4e8c-a72d-6ee68f7ecbd5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:32.182732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-db8ca8bf-c696-4e8c-a72d-6ee68f7ecbd5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:32.190961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-db8ca8bf-c696-4e8c-a72d-6ee68f7ecbd5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153219 Jul 14 10:09:32.191542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 999/2005] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:32.368918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:32.369478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:32.375989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:32.376434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:32.377195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:32.377623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:32.439715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:32.448167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:32.449649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:32.450810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c33fade0-99ba-4fbc-b854-2c5dd28f7d9e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087765 Jul 14 10:09:32.451370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1007/2006] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:32.605521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7997cc09-5a4a-404e-938f-4cb7567a5f7e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:32.606133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7997cc09-5a4a-404e-938f-4cb7567a5f7e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:32.613098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7997cc09-5a4a-404e-938f-4cb7567a5f7e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:32.613550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7997cc09-5a4a-404e-938f-4cb7567a5f7e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:32.614360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7997cc09-5a4a-404e-938f-4cb7567a5f7e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:32.614804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7997cc09-5a4a-404e-938f-4cb7567a5f7e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:32.751699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7997cc09-5a4a-404e-938f-4cb7567a5f7e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:32.763339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7997cc09-5a4a-404e-938f-4cb7567a5f7e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.161664 Jul 14 10:09:32.763993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1000/2007] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:32 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:32.901399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-baaab73d-f0ef-418d-91b7-a89ab114e246 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:32.902144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-baaab73d-f0ef-418d-91b7-a89ab114e246 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:32.908620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baaab73d-f0ef-418d-91b7-a89ab114e246 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:32.909068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baaab73d-f0ef-418d-91b7-a89ab114e246 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:32.909862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baaab73d-f0ef-418d-91b7-a89ab114e246 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:32.910328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-baaab73d-f0ef-418d-91b7-a89ab114e246 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:32.976045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-baaab73d-f0ef-418d-91b7-a89ab114e246 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:32.978439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:32.986352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-baaab73d-f0ef-418d-91b7-a89ab114e246 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089471 Jul 14 10:09:32.987000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1008/2008] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:32 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:33.208784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-698eeece-90b4-43fd-b044-654e031294af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:33.209433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-698eeece-90b4-43fd-b044-654e031294af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:33.218962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-698eeece-90b4-43fd-b044-654e031294af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:33.219421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-698eeece-90b4-43fd-b044-654e031294af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:33.220205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-698eeece-90b4-43fd-b044-654e031294af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:33.220647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-698eeece-90b4-43fd-b044-654e031294af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:33.361852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-698eeece-90b4-43fd-b044-654e031294af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:33.370434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-698eeece-90b4-43fd-b044-654e031294af tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.165482 Jul 14 10:09:33.371011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1001/2009] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:33.468696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:33.469485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:33.475968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:33.476402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:33.477147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:33.477576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:33.542168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:33.551032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:33.552563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:33.554347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2c2997fe-0674-429b-9e11-2d97bd13b95e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088925 Jul 14 10:09:33.554855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1009/2010] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:33.783127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f289feff-b31e-48eb-bc1e-7644c09019c4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:33.783762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f289feff-b31e-48eb-bc1e-7644c09019c4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:33.790473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f289feff-b31e-48eb-bc1e-7644c09019c4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:33.790925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f289feff-b31e-48eb-bc1e-7644c09019c4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:33.791687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f289feff-b31e-48eb-bc1e-7644c09019c4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:33.792121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f289feff-b31e-48eb-bc1e-7644c09019c4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:33.921910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f289feff-b31e-48eb-bc1e-7644c09019c4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:33.930559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f289feff-b31e-48eb-bc1e-7644c09019c4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151224 Jul 14 10:09:33.931132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1002/2011] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:33 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:34.004196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-226e5eaf-31d8-4eac-99a2-e978a58d1634 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:34.004795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-226e5eaf-31d8-4eac-99a2-e978a58d1634 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:34.011095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-226e5eaf-31d8-4eac-99a2-e978a58d1634 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:34.011534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-226e5eaf-31d8-4eac-99a2-e978a58d1634 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:34.012285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-226e5eaf-31d8-4eac-99a2-e978a58d1634 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:34.012710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-226e5eaf-31d8-4eac-99a2-e978a58d1634 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:34.074944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-226e5eaf-31d8-4eac-99a2-e978a58d1634 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:34.082966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-226e5eaf-31d8-4eac-99a2-e978a58d1634 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082776 Jul 14 10:09:34.083518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1010/2012] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:33 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:34.387768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8881bd2f-8ea9-4062-9a0a-4b8c6c6299d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:34.388360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8881bd2f-8ea9-4062-9a0a-4b8c6c6299d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:34.394877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8881bd2f-8ea9-4062-9a0a-4b8c6c6299d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:34.395325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8881bd2f-8ea9-4062-9a0a-4b8c6c6299d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:34.396091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8881bd2f-8ea9-4062-9a0a-4b8c6c6299d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:34.396511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8881bd2f-8ea9-4062-9a0a-4b8c6c6299d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:34.411639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:34.526252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8881bd2f-8ea9-4062-9a0a-4b8c6c6299d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:34.534390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8881bd2f-8ea9-4062-9a0a-4b8c6c6299d5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150439 Jul 14 10:09:34.534964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1003/2013] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:34.572870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:34.573467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:34.579934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:34.580376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:34.581123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:34.581553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:34.646238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:34.655204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:34.656693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:34.657820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2497349e-93e1-43df-bf76-83aae4a239cf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089367 Jul 14 10:09:34.658412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1011/2014] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:34.948380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-86f2392f-bd60-4d4c-a3d2-04293a43ec11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:34.948996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-86f2392f-bd60-4d4c-a3d2-04293a43ec11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:34.955104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-86f2392f-bd60-4d4c-a3d2-04293a43ec11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:34.955558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-86f2392f-bd60-4d4c-a3d2-04293a43ec11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:34.956322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-86f2392f-bd60-4d4c-a3d2-04293a43ec11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:34.956759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-86f2392f-bd60-4d4c-a3d2-04293a43ec11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:35.082594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-86f2392f-bd60-4d4c-a3d2-04293a43ec11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:35.090486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-86f2392f-bd60-4d4c-a3d2-04293a43ec11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146549 Jul 14 10:09:35.091048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1004/2015] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:34 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:35.100147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-87d9b283-86da-4647-a77d-eeaa61e64bfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:35.100841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-87d9b283-86da-4647-a77d-eeaa61e64bfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:35.106851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87d9b283-86da-4647-a77d-eeaa61e64bfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:35.107289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87d9b283-86da-4647-a77d-eeaa61e64bfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:35.108039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87d9b283-86da-4647-a77d-eeaa61e64bfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:35.108467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-87d9b283-86da-4647-a77d-eeaa61e64bfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:35.172891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-87d9b283-86da-4647-a77d-eeaa61e64bfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:35.181311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-87d9b283-86da-4647-a77d-eeaa61e64bfe tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085094 Jul 14 10:09:35.181863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1012/2016] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:35 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:35.551760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-694d9b0a-66a2-4d9e-a1e3-84ad3d7a39ac tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:35.552294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-694d9b0a-66a2-4d9e-a1e3-84ad3d7a39ac tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:35.560100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-694d9b0a-66a2-4d9e-a1e3-84ad3d7a39ac tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:35.560100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-694d9b0a-66a2-4d9e-a1e3-84ad3d7a39ac tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:35.560766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-694d9b0a-66a2-4d9e-a1e3-84ad3d7a39ac tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:35.561198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-694d9b0a-66a2-4d9e-a1e3-84ad3d7a39ac tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:35.676114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:35.676701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:35.683375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:35.683830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:35.684601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:35.685042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:35.693571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-694d9b0a-66a2-4d9e-a1e3-84ad3d7a39ac tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:35.701552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-694d9b0a-66a2-4d9e-a1e3-84ad3d7a39ac tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153819 Jul 14 10:09:35.702110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1005/2017] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:35 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:35.746963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:35.755349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:35.756856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:35.757990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-78522fcf-9a99-498e-a518-056412e67388 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085793 Jul 14 10:09:35.758585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1013/2018] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:36.107625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6a49925d-cb60-41b5-8334-61f5222dbb74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:36.108227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6a49925d-cb60-41b5-8334-61f5222dbb74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:36.114201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a49925d-cb60-41b5-8334-61f5222dbb74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:36.114663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a49925d-cb60-41b5-8334-61f5222dbb74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:36.115413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a49925d-cb60-41b5-8334-61f5222dbb74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:36.115845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a49925d-cb60-41b5-8334-61f5222dbb74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:36.198735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4d3bab7e-c4a2-40f6-9e08-c58038efb53c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:36.199343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4d3bab7e-c4a2-40f6-9e08-c58038efb53c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:36.205520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d3bab7e-c4a2-40f6-9e08-c58038efb53c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:36.205963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d3bab7e-c4a2-40f6-9e08-c58038efb53c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:36.206752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d3bab7e-c4a2-40f6-9e08-c58038efb53c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:36.207202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d3bab7e-c4a2-40f6-9e08-c58038efb53c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:36.258032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6a49925d-cb60-41b5-8334-61f5222dbb74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:36.265902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6a49925d-cb60-41b5-8334-61f5222dbb74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162100 Jul 14 10:09:36.266627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1006/2019] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:36 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:36.274668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4d3bab7e-c4a2-40f6-9e08-c58038efb53c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:36.282584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4d3bab7e-c4a2-40f6-9e08-c58038efb53c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088223 Jul 14 10:09:36.283134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1014/2020] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:36 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:36.719474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d7927959-a08b-427c-a925-2f03b93bec44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:36.720207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d7927959-a08b-427c-a925-2f03b93bec44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:36.727290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7927959-a08b-427c-a925-2f03b93bec44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:36.727739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7927959-a08b-427c-a925-2f03b93bec44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:36.728490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7927959-a08b-427c-a925-2f03b93bec44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:36.728922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d7927959-a08b-427c-a925-2f03b93bec44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:36.776023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:36.776727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:36.783309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:36.783751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:36.784507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:36.784936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:36.858032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:36.867130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:36.868656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:36.869798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-90aa373d-e31b-48d5-b139-f242f4088b4d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.097666 Jul 14 10:09:36.870382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1015/2021] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:36.881090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d7927959-a08b-427c-a925-2f03b93bec44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:36.889070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d7927959-a08b-427c-a925-2f03b93bec44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.173586 Jul 14 10:09:36.889627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1007/2022] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:37.283770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1a806a5e-53f2-4e2c-a0a0-c161f1bab2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:37.284406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1a806a5e-53f2-4e2c-a0a0-c161f1bab2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:37.291085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1a806a5e-53f2-4e2c-a0a0-c161f1bab2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:37.291531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1a806a5e-53f2-4e2c-a0a0-c161f1bab2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:37.292286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1a806a5e-53f2-4e2c-a0a0-c161f1bab2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:37.292717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1a806a5e-53f2-4e2c-a0a0-c161f1bab2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:37.299602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4c81984a-5b92-4345-838c-6ee4b0927f64 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:37.300203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4c81984a-5b92-4345-838c-6ee4b0927f64 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:37.306289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c81984a-5b92-4345-838c-6ee4b0927f64 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:37.306738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c81984a-5b92-4345-838c-6ee4b0927f64 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:37.307495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c81984a-5b92-4345-838c-6ee4b0927f64 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:37.307925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c81984a-5b92-4345-838c-6ee4b0927f64 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:37.391027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4c81984a-5b92-4345-838c-6ee4b0927f64 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:37.399601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4c81984a-5b92-4345-838c-6ee4b0927f64 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.103734 Jul 14 10:09:37.400174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1008/2023] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:37 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:37.448863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1a806a5e-53f2-4e2c-a0a0-c161f1bab2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:37.456689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1a806a5e-53f2-4e2c-a0a0-c161f1bab2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.176778 Jul 14 10:09:37.457242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1016/2024] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:37 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:37.889451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:37.890018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:37.896482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:37.896928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:37.897683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:37.898118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:37.905445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dc9f706f-6114-484d-b789-9b48ca5c207a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:37.906150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dc9f706f-6114-484d-b789-9b48ca5c207a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:37.913376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc9f706f-6114-484d-b789-9b48ca5c207a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:37.913822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc9f706f-6114-484d-b789-9b48ca5c207a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:37.914607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc9f706f-6114-484d-b789-9b48ca5c207a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:37.915063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc9f706f-6114-484d-b789-9b48ca5c207a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:37.962402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:37.971342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:37.972854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:37.974004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6dcf5d62-35f2-4578-b670-ff41b18065e4 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088552 Jul 14 10:09:37.974594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1009/2025] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:38.063286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dc9f706f-6114-484d-b789-9b48ca5c207a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:38.071282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dc9f706f-6114-484d-b789-9b48ca5c207a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.169715 Jul 14 10:09:38.071838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1017/2026] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:38.416274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-753da45d-0e91-4a7f-9775-26a2ad60d2e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:38.416883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-753da45d-0e91-4a7f-9775-26a2ad60d2e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:38.423257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-753da45d-0e91-4a7f-9775-26a2ad60d2e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:38.423705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-753da45d-0e91-4a7f-9775-26a2ad60d2e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:38.424463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-753da45d-0e91-4a7f-9775-26a2ad60d2e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:38.425025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-753da45d-0e91-4a7f-9775-26a2ad60d2e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:38.474474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-af718916-59e9-4c8c-ae69-79bad67a27d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:38.475088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af718916-59e9-4c8c-ae69-79bad67a27d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:38.481045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af718916-59e9-4c8c-ae69-79bad67a27d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:38.481490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af718916-59e9-4c8c-ae69-79bad67a27d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:38.482266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af718916-59e9-4c8c-ae69-79bad67a27d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:38.482698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af718916-59e9-4c8c-ae69-79bad67a27d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:38.487716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-753da45d-0e91-4a7f-9775-26a2ad60d2e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:38.495638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-753da45d-0e91-4a7f-9775-26a2ad60d2e6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083289 Jul 14 10:09:38.496193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1010/2027] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:38 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:38.611462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af718916-59e9-4c8c-ae69-79bad67a27d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:38.619839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-af718916-59e9-4c8c-ae69-79bad67a27d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149275 Jul 14 10:09:38.620395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1018/2028] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:38 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:38.992283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:38.992894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:38.999398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:38.999854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:39.000612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:39.001048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:39.064426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:39.073304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:39.074847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:39.075979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-322fb6fa-5315-4637-93a5-0e19e52bd5bc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087672 Jul 14 10:09:39.076536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1011/2029] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:39.088662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8681aa17-ddf5-4b42-b462-104fde31cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:39.089268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8681aa17-ddf5-4b42-b462-104fde31cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:39.096043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8681aa17-ddf5-4b42-b462-104fde31cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:39.096524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8681aa17-ddf5-4b42-b462-104fde31cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:39.097324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8681aa17-ddf5-4b42-b462-104fde31cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:39.097762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8681aa17-ddf5-4b42-b462-104fde31cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:39.225655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8681aa17-ddf5-4b42-b462-104fde31cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:39.233550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8681aa17-ddf5-4b42-b462-104fde31cd75 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.149272 Jul 14 10:09:39.234112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1019/2030] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:39.513491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5b02d162-35f0-4041-b120-a3c8ba39dcf1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:39.514083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5b02d162-35f0-4041-b120-a3c8ba39dcf1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:39.520429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b02d162-35f0-4041-b120-a3c8ba39dcf1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:39.520874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b02d162-35f0-4041-b120-a3c8ba39dcf1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:39.521671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b02d162-35f0-4041-b120-a3c8ba39dcf1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:39.522179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b02d162-35f0-4041-b120-a3c8ba39dcf1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:39.582747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5b02d162-35f0-4041-b120-a3c8ba39dcf1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:39.590584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5b02d162-35f0-4041-b120-a3c8ba39dcf1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081177 Jul 14 10:09:39.591133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1012/2031] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:39 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:39.637229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d942019c-4b64-41d8-9f6a-e757dde7f4f8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:39.637827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d942019c-4b64-41d8-9f6a-e757dde7f4f8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:39.643893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d942019c-4b64-41d8-9f6a-e757dde7f4f8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:39.644334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d942019c-4b64-41d8-9f6a-e757dde7f4f8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:39.645078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d942019c-4b64-41d8-9f6a-e757dde7f4f8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:39.645500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d942019c-4b64-41d8-9f6a-e757dde7f4f8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:39.772756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d942019c-4b64-41d8-9f6a-e757dde7f4f8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:39.780586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d942019c-4b64-41d8-9f6a-e757dde7f4f8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147192 Jul 14 10:09:39.781142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1020/2032] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:39 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:40.094849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:40.095393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:40.102746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:40.103201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:40.103970 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:40.104411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:40.166327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:40.175062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:40.176556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:40.177688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a492ffb7-64bc-457b-995e-b77d79cb6056 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086853 Jul 14 10:09:40.178244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1013/2033] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:40 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:40.250087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4775b53e-a71f-4cc5-9db2-92039e218a7d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:40.250740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4775b53e-a71f-4cc5-9db2-92039e218a7d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:40.257156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4775b53e-a71f-4cc5-9db2-92039e218a7d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:40.257595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4775b53e-a71f-4cc5-9db2-92039e218a7d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:40.258410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4775b53e-a71f-4cc5-9db2-92039e218a7d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:40.258837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4775b53e-a71f-4cc5-9db2-92039e218a7d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:40.384982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4775b53e-a71f-4cc5-9db2-92039e218a7d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:40.392770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4775b53e-a71f-4cc5-9db2-92039e218a7d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.146557 Jul 14 10:09:40.393319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1021/2034] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:40.607924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eaa2b0a0-1ae4-4ee9-ac34-8b2b32c4b944 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:40.608530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-eaa2b0a0-1ae4-4ee9-ac34-8b2b32c4b944 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:40.614642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eaa2b0a0-1ae4-4ee9-ac34-8b2b32c4b944 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:40.615088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eaa2b0a0-1ae4-4ee9-ac34-8b2b32c4b944 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:40.615874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eaa2b0a0-1ae4-4ee9-ac34-8b2b32c4b944 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:40.616303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eaa2b0a0-1ae4-4ee9-ac34-8b2b32c4b944 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:40.679366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-eaa2b0a0-1ae4-4ee9-ac34-8b2b32c4b944 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:40.689539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eaa2b0a0-1ae4-4ee9-ac34-8b2b32c4b944 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085948 Jul 14 10:09:40.690091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1014/2035] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:40 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:40.797635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-430a67bb-2ac9-4dc7-8ade-dbbcb8761df8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:40.798277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-430a67bb-2ac9-4dc7-8ade-dbbcb8761df8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:40.804303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-430a67bb-2ac9-4dc7-8ade-dbbcb8761df8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:40.805238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-430a67bb-2ac9-4dc7-8ade-dbbcb8761df8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:40.805996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-430a67bb-2ac9-4dc7-8ade-dbbcb8761df8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:40.806455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-430a67bb-2ac9-4dc7-8ade-dbbcb8761df8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:40.931481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-430a67bb-2ac9-4dc7-8ade-dbbcb8761df8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:40.939350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-430a67bb-2ac9-4dc7-8ade-dbbcb8761df8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.145797 Jul 14 10:09:40.940417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1022/2036] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:40 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:41.195816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:41.196332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:41.202381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:41.202836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:41.203589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:41.204023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:41.268127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:41.276608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:41.278132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:41.279292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1a050fb5-7691-48c4-8585-730da276378c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087578 Jul 14 10:09:41.279848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1015/2037] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:41.410817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b0e88f10-abcd-4ab7-8022-2319a62f84df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:41.411417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b0e88f10-abcd-4ab7-8022-2319a62f84df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:41.418500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0e88f10-abcd-4ab7-8022-2319a62f84df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:41.418937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0e88f10-abcd-4ab7-8022-2319a62f84df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:41.419969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0e88f10-abcd-4ab7-8022-2319a62f84df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:41.420394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0e88f10-abcd-4ab7-8022-2319a62f84df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:41.549093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b0e88f10-abcd-4ab7-8022-2319a62f84df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:41.557059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b0e88f10-abcd-4ab7-8022-2319a62f84df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150025 Jul 14 10:09:41.557589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1023/2038] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:41.706740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-32acec25-329a-4fb1-9fb2-aa484958b2a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:41.707344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-32acec25-329a-4fb1-9fb2-aa484958b2a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:41.714638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32acec25-329a-4fb1-9fb2-aa484958b2a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:41.715090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32acec25-329a-4fb1-9fb2-aa484958b2a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:41.715840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32acec25-329a-4fb1-9fb2-aa484958b2a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:41.716272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32acec25-329a-4fb1-9fb2-aa484958b2a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:41.777235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-32acec25-329a-4fb1-9fb2-aa484958b2a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:41.785083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-32acec25-329a-4fb1-9fb2-aa484958b2a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082185 Jul 14 10:09:41.785635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1016/2039] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:41.958300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7d0c3842-ae22-45b7-a975-8d62b5033639 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:41.958926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7d0c3842-ae22-45b7-a975-8d62b5033639 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:41.965605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d0c3842-ae22-45b7-a975-8d62b5033639 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:41.966042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d0c3842-ae22-45b7-a975-8d62b5033639 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:41.966830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d0c3842-ae22-45b7-a975-8d62b5033639 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:41.967257 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d0c3842-ae22-45b7-a975-8d62b5033639 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:42.100036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7d0c3842-ae22-45b7-a975-8d62b5033639 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:42.107977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7d0c3842-ae22-45b7-a975-8d62b5033639 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154011 Jul 14 10:09:42.108537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1024/2040] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:41 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:42.297994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:42.298677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:42.305189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:42.305631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:42.306424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:42.306860 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:42.369862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:42.378212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:42.379797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:42.380922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dcce3cbf-fb19-430c-a361-66fc2827144f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087073 Jul 14 10:09:42.381468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1017/2041] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:42.575104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1ae695d7-980f-4e54-8f57-0d2f3c3311df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:42.575708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ae695d7-980f-4e54-8f57-0d2f3c3311df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:42.578028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:42.583367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ae695d7-980f-4e54-8f57-0d2f3c3311df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:42.583810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ae695d7-980f-4e54-8f57-0d2f3c3311df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:42.584569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ae695d7-980f-4e54-8f57-0d2f3c3311df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:42.585001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ae695d7-980f-4e54-8f57-0d2f3c3311df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:42.600047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:42.711239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1ae695d7-980f-4e54-8f57-0d2f3c3311df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:42.719082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1ae695d7-980f-4e54-8f57-0d2f3c3311df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148739 Jul 14 10:09:42.719647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1025/2042] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:42 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:42.802243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-918f7841-7df1-4faf-878b-94b57de9b3ce tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:42.802877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-918f7841-7df1-4faf-878b-94b57de9b3ce tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:42.809937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-918f7841-7df1-4faf-878b-94b57de9b3ce tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:42.810363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-918f7841-7df1-4faf-878b-94b57de9b3ce tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:42.811114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-918f7841-7df1-4faf-878b-94b57de9b3ce tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:42.811544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-918f7841-7df1-4faf-878b-94b57de9b3ce tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:42.873010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-918f7841-7df1-4faf-878b-94b57de9b3ce tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:42.881087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-918f7841-7df1-4faf-878b-94b57de9b3ce tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082732 Jul 14 10:09:42.881638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1018/2043] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:42 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:43.124887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6b6f608c-75a7-4d2c-a99b-a92889a67d29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:43.125409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6b6f608c-75a7-4d2c-a99b-a92889a67d29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:43.131558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b6f608c-75a7-4d2c-a99b-a92889a67d29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:43.131995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b6f608c-75a7-4d2c-a99b-a92889a67d29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:43.132762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b6f608c-75a7-4d2c-a99b-a92889a67d29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:43.133187 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6b6f608c-75a7-4d2c-a99b-a92889a67d29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:43.261745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6b6f608c-75a7-4d2c-a99b-a92889a67d29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:43.269766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6b6f608c-75a7-4d2c-a99b-a92889a67d29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148832 Jul 14 10:09:43.270352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1026/2044] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:43 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:43.400084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:43.400609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:43.406662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:43.407106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:43.407866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:43.408299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:43.468240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:43.476593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:43.478092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:43.479250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-13b73c1b-69b7-4e25-8cdf-b0781844b0ae tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.083786 Jul 14 10:09:43.479805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1019/2045] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:43.737232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b08235e4-974b-4f0b-8919-9322c670c772 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:43.737832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b08235e4-974b-4f0b-8919-9322c670c772 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:43.744374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b08235e4-974b-4f0b-8919-9322c670c772 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:43.744808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b08235e4-974b-4f0b-8919-9322c670c772 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:43.745551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b08235e4-974b-4f0b-8919-9322c670c772 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:43.745974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b08235e4-974b-4f0b-8919-9322c670c772 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:43.874650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b08235e4-974b-4f0b-8919-9322c670c772 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:43.883272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b08235e4-974b-4f0b-8919-9322c670c772 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.149514 Jul 14 10:09:43.883819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1027/2046] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:43.898117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d411c0b1-a5e0-4b96-8805-d7afdb0138f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:43.898772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d411c0b1-a5e0-4b96-8805-d7afdb0138f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:43.905284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d411c0b1-a5e0-4b96-8805-d7afdb0138f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:43.905730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d411c0b1-a5e0-4b96-8805-d7afdb0138f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:43.906529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d411c0b1-a5e0-4b96-8805-d7afdb0138f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:43.906967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d411c0b1-a5e0-4b96-8805-d7afdb0138f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:43.910844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:43.972582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d411c0b1-a5e0-4b96-8805-d7afdb0138f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:43.981297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d411c0b1-a5e0-4b96-8805-d7afdb0138f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086996 Jul 14 10:09:43.981857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1020/2047] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:44.287418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-af881d4a-6bc3-4dad-a5b7-14bb7657609d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:44.287963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af881d4a-6bc3-4dad-a5b7-14bb7657609d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:44.294797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af881d4a-6bc3-4dad-a5b7-14bb7657609d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:44.295241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af881d4a-6bc3-4dad-a5b7-14bb7657609d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:44.295995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af881d4a-6bc3-4dad-a5b7-14bb7657609d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:44.296451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af881d4a-6bc3-4dad-a5b7-14bb7657609d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:44.422889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-af881d4a-6bc3-4dad-a5b7-14bb7657609d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:44.431431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-af881d4a-6bc3-4dad-a5b7-14bb7657609d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148005 Jul 14 10:09:44.431983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1028/2048] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:44 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:44.497437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:44.498049 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:44.504147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:44.504592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:44.505349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:44.505786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:44.565957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:44.574258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:44.575764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:44.576893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f5f5ec25-1407-44bd-94ad-95493d235076 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.083406 Jul 14 10:09:44.577440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1021/2049] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:44.901375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ae82dad2-f185-486f-8054-1f8ee1cb004b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:44.901911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ae82dad2-f185-486f-8054-1f8ee1cb004b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:44.908578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ae82dad2-f185-486f-8054-1f8ee1cb004b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:44.909021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ae82dad2-f185-486f-8054-1f8ee1cb004b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:44.909776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ae82dad2-f185-486f-8054-1f8ee1cb004b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:44.910237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ae82dad2-f185-486f-8054-1f8ee1cb004b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:44.998536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-36150162-979f-457f-9bcc-8eb31f45b78e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:44.999149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-36150162-979f-457f-9bcc-8eb31f45b78e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:45.001514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:45.006929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36150162-979f-457f-9bcc-8eb31f45b78e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:45.007382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36150162-979f-457f-9bcc-8eb31f45b78e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:45.008678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36150162-979f-457f-9bcc-8eb31f45b78e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:45.009114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-36150162-979f-457f-9bcc-8eb31f45b78e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:45.056590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ae82dad2-f185-486f-8054-1f8ee1cb004b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:45.064732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ae82dad2-f185-486f-8054-1f8ee1cb004b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.167964 Jul 14 10:09:45.065387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1029/2050] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:45.072667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-36150162-979f-457f-9bcc-8eb31f45b78e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:45.080756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-36150162-979f-457f-9bcc-8eb31f45b78e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086151 Jul 14 10:09:45.081311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1022/2051] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:44 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:45.449272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2d5eb396-691c-4071-9530-ab2f01dc2ce1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:45.449868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2d5eb396-691c-4071-9530-ab2f01dc2ce1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:45.455880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d5eb396-691c-4071-9530-ab2f01dc2ce1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:45.456318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d5eb396-691c-4071-9530-ab2f01dc2ce1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:45.457061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d5eb396-691c-4071-9530-ab2f01dc2ce1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:45.457496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2d5eb396-691c-4071-9530-ab2f01dc2ce1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:45.587495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2d5eb396-691c-4071-9530-ab2f01dc2ce1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:45.595228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:45.595912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2d5eb396-691c-4071-9530-ab2f01dc2ce1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150614 Jul 14 10:09:45.596034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:45.596495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1030/2052] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:45 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:45.602777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:45.603861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:45.603989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:45.604397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:45.669745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:45.678801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:45.680453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:45.681672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-22ba1e9b-9624-4611-b159-4df07bfa0283 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.090487 Jul 14 10:09:45.682240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1023/2053] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:46.082646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-10befbb3-67cc-4108-8d9c-7ae86477ba70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:46.083248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-10befbb3-67cc-4108-8d9c-7ae86477ba70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:46.090287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10befbb3-67cc-4108-8d9c-7ae86477ba70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:46.090730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10befbb3-67cc-4108-8d9c-7ae86477ba70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:46.091484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10befbb3-67cc-4108-8d9c-7ae86477ba70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:46.091914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10befbb3-67cc-4108-8d9c-7ae86477ba70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:46.098144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a5de53cc-74b1-4a99-aff8-a4f32f2ab62e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:46.098781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a5de53cc-74b1-4a99-aff8-a4f32f2ab62e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:46.106158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5de53cc-74b1-4a99-aff8-a4f32f2ab62e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:46.106641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5de53cc-74b1-4a99-aff8-a4f32f2ab62e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:46.107421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5de53cc-74b1-4a99-aff8-a4f32f2ab62e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:46.107856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5de53cc-74b1-4a99-aff8-a4f32f2ab62e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:46.189075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a5de53cc-74b1-4a99-aff8-a4f32f2ab62e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:46.197089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a5de53cc-74b1-4a99-aff8-a4f32f2ab62e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.102793 Jul 14 10:09:46.197661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1024/2054] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:46 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:46.245787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-10befbb3-67cc-4108-8d9c-7ae86477ba70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:46.253995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-10befbb3-67cc-4108-8d9c-7ae86477ba70 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.175281 Jul 14 10:09:46.254583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1031/2055] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:46.612811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-347f9ef1-3852-427b-9b1a-962aea678240 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:46.613422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-347f9ef1-3852-427b-9b1a-962aea678240 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:46.620090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-347f9ef1-3852-427b-9b1a-962aea678240 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:46.620536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-347f9ef1-3852-427b-9b1a-962aea678240 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:46.621302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-347f9ef1-3852-427b-9b1a-962aea678240 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:46.621737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-347f9ef1-3852-427b-9b1a-962aea678240 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:46.699525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:46.700134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:46.706126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:46.706599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:46.707360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:46.707789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:46.760104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-347f9ef1-3852-427b-9b1a-962aea678240 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:46.768300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-347f9ef1-3852-427b-9b1a-962aea678240 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.159346 Jul 14 10:09:46.768870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1025/2056] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:46 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:46.777235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:46.785745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:46.787295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:46.788428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2be3da65-263c-4e6c-a2a4-5b2561cdbfe6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.093004 Jul 14 10:09:46.789600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1032/2057] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:46 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:47.214456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b719d980-090c-4395-a286-ab12b3539ae4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:47.215090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b719d980-090c-4395-a286-ab12b3539ae4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:47.221647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b719d980-090c-4395-a286-ab12b3539ae4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:47.222095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b719d980-090c-4395-a286-ab12b3539ae4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:47.222885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b719d980-090c-4395-a286-ab12b3539ae4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:47.223322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b719d980-090c-4395-a286-ab12b3539ae4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:47.270087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-def7cab4-0071-4317-be9c-a4139116e952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:47.270726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-def7cab4-0071-4317-be9c-a4139116e952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:47.278015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-def7cab4-0071-4317-be9c-a4139116e952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:47.278483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-def7cab4-0071-4317-be9c-a4139116e952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:47.279269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-def7cab4-0071-4317-be9c-a4139116e952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:47.279695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-def7cab4-0071-4317-be9c-a4139116e952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:47.287320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b719d980-090c-4395-a286-ab12b3539ae4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:47.295902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b719d980-090c-4395-a286-ab12b3539ae4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085848 Jul 14 10:09:47.296464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1026/2058] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:47.406868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-def7cab4-0071-4317-be9c-a4139116e952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:47.414824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-def7cab4-0071-4317-be9c-a4139116e952 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148629 Jul 14 10:09:47.415389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1033/2059] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:47.786273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2636f5c6-3fa9-4ada-9043-42eeda5d8f62 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:47.786878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2636f5c6-3fa9-4ada-9043-42eeda5d8f62 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:47.792906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2636f5c6-3fa9-4ada-9043-42eeda5d8f62 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:47.793350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2636f5c6-3fa9-4ada-9043-42eeda5d8f62 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:47.794096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2636f5c6-3fa9-4ada-9043-42eeda5d8f62 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:47.794816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2636f5c6-3fa9-4ada-9043-42eeda5d8f62 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:47.806734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:47.807366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:47.813431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:47.813812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:47.814606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:47.815038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:47.893858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:47.902204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:47.903709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:47.904835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-be586109-25e6-4f05-8b0c-a1247febe0e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.102539 Jul 14 10:09:47.905401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1034/2060] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:47.950380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2636f5c6-3fa9-4ada-9043-42eeda5d8f62 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:47.958234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2636f5c6-3fa9-4ada-9043-42eeda5d8f62 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.175978 Jul 14 10:09:47.958781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1027/2061] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:47 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:48.260344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:09:48.260576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:09:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:09:48.312377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-472f68d9-400c-4648-8068-66b56fa3fc3d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:48.313016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-472f68d9-400c-4648-8068-66b56fa3fc3d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:48.319639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-472f68d9-400c-4648-8068-66b56fa3fc3d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:48.320082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-472f68d9-400c-4648-8068-66b56fa3fc3d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:48.320889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-472f68d9-400c-4648-8068-66b56fa3fc3d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:48.321322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-472f68d9-400c-4648-8068-66b56fa3fc3d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:48.382552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-472f68d9-400c-4648-8068-66b56fa3fc3d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:48.390323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-472f68d9-400c-4648-8068-66b56fa3fc3d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081676 Jul 14 10:09:48.390882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1035/2062] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:48 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:48.432242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c24f4451-4988-466c-b6b8-7c2966e52592 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:48.432845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c24f4451-4988-466c-b6b8-7c2966e52592 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:48.439419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c24f4451-4988-466c-b6b8-7c2966e52592 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:48.439861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c24f4451-4988-466c-b6b8-7c2966e52592 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:48.440609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c24f4451-4988-466c-b6b8-7c2966e52592 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:48.441042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c24f4451-4988-466c-b6b8-7c2966e52592 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:48.536501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:09:48.536720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:09:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d (ip 10.222.0.40) !!! Jul 14 10:09:48.571729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c24f4451-4988-466c-b6b8-7c2966e52592 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:48.579647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c24f4451-4988-466c-b6b8-7c2966e52592 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151296 Jul 14 10:09:48.580211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1028/2063] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:48.975064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5ca5c39a-bf20-4af5-b7e9-7259165636cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:48.975694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5ca5c39a-bf20-4af5-b7e9-7259165636cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:48.981917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ca5c39a-bf20-4af5-b7e9-7259165636cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:48.982417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ca5c39a-bf20-4af5-b7e9-7259165636cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:48.983219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ca5c39a-bf20-4af5-b7e9-7259165636cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:48.983658 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5ca5c39a-bf20-4af5-b7e9-7259165636cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:49.053379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:49.054014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:49.060665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:49.061112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:49.061865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:49.062326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:49.125581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5ca5c39a-bf20-4af5-b7e9-7259165636cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:49.134285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5ca5c39a-bf20-4af5-b7e9-7259165636cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.163036 Jul 14 10:09:49.134842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1029/2064] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:48 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:49.180856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:49.189404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:49.190929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:49.192054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cb8a57b2-5228-445d-9aa5-4133ecd7e058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.272472 Jul 14 10:09:49.192598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1036/2065] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:48 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:49.407938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a856a8cc-a812-4e5e-a461-70482cc96ed9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:49.408540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a856a8cc-a812-4e5e-a461-70482cc96ed9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:49.415289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a856a8cc-a812-4e5e-a461-70482cc96ed9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:49.415731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a856a8cc-a812-4e5e-a461-70482cc96ed9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:49.416479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a856a8cc-a812-4e5e-a461-70482cc96ed9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:49.416933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a856a8cc-a812-4e5e-a461-70482cc96ed9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:49.478085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a856a8cc-a812-4e5e-a461-70482cc96ed9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:49.486134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a856a8cc-a812-4e5e-a461-70482cc96ed9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082054 Jul 14 10:09:49.486715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1030/2066] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:49 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:49.597410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b1f13577-7337-4413-9cd2-833b36a62568 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:49.598042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b1f13577-7337-4413-9cd2-833b36a62568 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:49.604998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1f13577-7337-4413-9cd2-833b36a62568 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:49.605434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1f13577-7337-4413-9cd2-833b36a62568 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:49.606181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1f13577-7337-4413-9cd2-833b36a62568 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:49.606626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1f13577-7337-4413-9cd2-833b36a62568 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:49.735839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b1f13577-7337-4413-9cd2-833b36a62568 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:49.744405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b1f13577-7337-4413-9cd2-833b36a62568 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151050 Jul 14 10:09:49.744962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1037/2067] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:50.151908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-df651c5f-41f3-4ea5-b7b1-ad861c8eeb3c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:50.152526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-df651c5f-41f3-4ea5-b7b1-ad861c8eeb3c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:50.158721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df651c5f-41f3-4ea5-b7b1-ad861c8eeb3c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:50.159172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df651c5f-41f3-4ea5-b7b1-ad861c8eeb3c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:50.159929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df651c5f-41f3-4ea5-b7b1-ad861c8eeb3c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:50.160361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df651c5f-41f3-4ea5-b7b1-ad861c8eeb3c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:50.210285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:50.211663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:50.217554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:50.217995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:50.218791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:50.219218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:50.293577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:50.302170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:50.303681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:50.304811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e75355f1-45af-4ceb-8b1c-84ce639f29f9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.098429 Jul 14 10:09:50.305368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1038/2068] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:50 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:50.309603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-df651c5f-41f3-4ea5-b7b1-ad861c8eeb3c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:50.317540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-df651c5f-41f3-4ea5-b7b1-ad861c8eeb3c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.170132 Jul 14 10:09:50.318091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1031/2069] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:50 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:50.503815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c5291b63-639f-4ff9-8b00-f926eb210495 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:50.504416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c5291b63-639f-4ff9-8b00-f926eb210495 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:50.510514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c5291b63-639f-4ff9-8b00-f926eb210495 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:50.510954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c5291b63-639f-4ff9-8b00-f926eb210495 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:50.511704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c5291b63-639f-4ff9-8b00-f926eb210495 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:50.512126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c5291b63-639f-4ff9-8b00-f926eb210495 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:50.579120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c5291b63-639f-4ff9-8b00-f926eb210495 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:50.587562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c5291b63-639f-4ff9-8b00-f926eb210495 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087682 Jul 14 10:09:50.588115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1039/2070] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:50 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:50.760766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-02c2f29b-2269-4390-bed9-1b1db10a9d84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:50.761277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-02c2f29b-2269-4390-bed9-1b1db10a9d84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:50.767835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02c2f29b-2269-4390-bed9-1b1db10a9d84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:50.768276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02c2f29b-2269-4390-bed9-1b1db10a9d84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:50.769024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02c2f29b-2269-4390-bed9-1b1db10a9d84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:50.769453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02c2f29b-2269-4390-bed9-1b1db10a9d84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:50.897022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-02c2f29b-2269-4390-bed9-1b1db10a9d84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:50.905441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-02c2f29b-2269-4390-bed9-1b1db10a9d84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148670 Jul 14 10:09:50.905995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1032/2071] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:51.322982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:51.323580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:51.330970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:51.331422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:51.332191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:51.332621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:51.334746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b65a27d2-1709-4367-b0a5-d8a4a7daa6cd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:51.335395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b65a27d2-1709-4367-b0a5-d8a4a7daa6cd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:51.341228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b65a27d2-1709-4367-b0a5-d8a4a7daa6cd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:51.341673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b65a27d2-1709-4367-b0a5-d8a4a7daa6cd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:51.342454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b65a27d2-1709-4367-b0a5-d8a4a7daa6cd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:51.342891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b65a27d2-1709-4367-b0a5-d8a4a7daa6cd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:51.403809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:51.412749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:51.414263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:51.415406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-adc4b07d-9376-480b-91ac-7605ddaa8ac7 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.096387 Jul 14 10:09:51.422150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1040/2072] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:51 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:51.489417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b65a27d2-1709-4367-b0a5-d8a4a7daa6cd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:51.497950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b65a27d2-1709-4367-b0a5-d8a4a7daa6cd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.166905 Jul 14 10:09:51.498606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1033/2073] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:51 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:51.604376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c35b3b1c-e060-4c13-a141-c381a579aa20 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:51.604900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c35b3b1c-e060-4c13-a141-c381a579aa20 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:51.610971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c35b3b1c-e060-4c13-a141-c381a579aa20 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:51.611405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c35b3b1c-e060-4c13-a141-c381a579aa20 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:51.612160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c35b3b1c-e060-4c13-a141-c381a579aa20 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:51.612588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c35b3b1c-e060-4c13-a141-c381a579aa20 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:51.674235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c35b3b1c-e060-4c13-a141-c381a579aa20 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:51.683048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c35b3b1c-e060-4c13-a141-c381a579aa20 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082518 Jul 14 10:09:51.684048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1041/2074] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:51 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:51.923006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3f719d18-f9d8-4e85-9e53-4f7d0b9f8b93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:51.923521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3f719d18-f9d8-4e85-9e53-4f7d0b9f8b93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:51.930832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f719d18-f9d8-4e85-9e53-4f7d0b9f8b93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:51.931276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f719d18-f9d8-4e85-9e53-4f7d0b9f8b93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:51.932026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f719d18-f9d8-4e85-9e53-4f7d0b9f8b93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:51.932993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f719d18-f9d8-4e85-9e53-4f7d0b9f8b93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:52.064050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3f719d18-f9d8-4e85-9e53-4f7d0b9f8b93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:52.071940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3f719d18-f9d8-4e85-9e53-4f7d0b9f8b93 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153186 Jul 14 10:09:52.072490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1034/2075] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:52.432896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:52.433498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:52.440146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:52.440588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:52.441369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:52.441796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:52.444343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:52.505790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:52.514883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:52.515063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-20f9d3d1-3996-44c3-9487-00bb8da520f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:52.515609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-20f9d3d1-3996-44c3-9487-00bb8da520f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:52.516546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:52.517694 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-56ccc50c-5b5d-48a2-81e0-7bd7235db13c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088753 Jul 14 10:09:52.518427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1042/2076] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:52 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:52.521852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20f9d3d1-3996-44c3-9487-00bb8da520f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:52.522405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20f9d3d1-3996-44c3-9487-00bb8da520f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:52.523891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20f9d3d1-3996-44c3-9487-00bb8da520f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:52.524408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-20f9d3d1-3996-44c3-9487-00bb8da520f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:52.653943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-20f9d3d1-3996-44c3-9487-00bb8da520f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:52.661992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-20f9d3d1-3996-44c3-9487-00bb8da520f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150753 Jul 14 10:09:52.662589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1035/2077] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:52 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:52.701036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e57594f1-584c-4084-9a2e-5a2d5feea5b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:52.701569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e57594f1-584c-4084-9a2e-5a2d5feea5b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:52.707662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e57594f1-584c-4084-9a2e-5a2d5feea5b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:52.708110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e57594f1-584c-4084-9a2e-5a2d5feea5b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:52.708866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e57594f1-584c-4084-9a2e-5a2d5feea5b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:52.709302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e57594f1-584c-4084-9a2e-5a2d5feea5b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:52.771271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e57594f1-584c-4084-9a2e-5a2d5feea5b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:52.779977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e57594f1-584c-4084-9a2e-5a2d5feea5b9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082796 Jul 14 10:09:52.780548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1043/2078] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:52 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:53.089165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2d30edc3-58fe-4fed-8e2a-4311b584e06f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:53.089695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2d30edc3-58fe-4fed-8e2a-4311b584e06f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:53.096224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d30edc3-58fe-4fed-8e2a-4311b584e06f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:53.096674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d30edc3-58fe-4fed-8e2a-4311b584e06f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:53.097438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d30edc3-58fe-4fed-8e2a-4311b584e06f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:53.097874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d30edc3-58fe-4fed-8e2a-4311b584e06f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:53.228279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2d30edc3-58fe-4fed-8e2a-4311b584e06f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:53.230507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:09:53.237376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2d30edc3-58fe-4fed-8e2a-4311b584e06f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152190 Jul 14 10:09:53.237949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1036/2079] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:53 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:53.536465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:53.537076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:53.544006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:53.544453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:53.545464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:53.545929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:53.608063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:53.616510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:53.617997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:53.619160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8e0e6bf2-f87e-4c28-aa67-202138d6ec9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086649 Jul 14 10:09:53.619708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1044/2080] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:53 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:53.679351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e846f787-4103-4f97-82d9-6fc336f5f067 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:53.679979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e846f787-4103-4f97-82d9-6fc336f5f067 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:53.686115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e846f787-4103-4f97-82d9-6fc336f5f067 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:53.686583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e846f787-4103-4f97-82d9-6fc336f5f067 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:53.687360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e846f787-4103-4f97-82d9-6fc336f5f067 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:53.687792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e846f787-4103-4f97-82d9-6fc336f5f067 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:53.797072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c82d099e-f037-488f-969d-acc48f2a724a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:53.797682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c82d099e-f037-488f-969d-acc48f2a724a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:53.803759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82d099e-f037-488f-969d-acc48f2a724a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:53.804203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82d099e-f037-488f-969d-acc48f2a724a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:53.804963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82d099e-f037-488f-969d-acc48f2a724a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:53.805401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c82d099e-f037-488f-969d-acc48f2a724a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:53.814320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e846f787-4103-4f97-82d9-6fc336f5f067 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:53.822383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e846f787-4103-4f97-82d9-6fc336f5f067 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146797 Jul 14 10:09:53.823152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1037/2081] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:53 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:53.869566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c82d099e-f037-488f-969d-acc48f2a724a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:53.877472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c82d099e-f037-488f-969d-acc48f2a724a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084627 Jul 14 10:09:53.878032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1045/2082] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:53 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:54.255371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eddc21c3-3aa9-4fd4-bff1-75fb6c664f64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:54.255981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-eddc21c3-3aa9-4fd4-bff1-75fb6c664f64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:54.263016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eddc21c3-3aa9-4fd4-bff1-75fb6c664f64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:54.263465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eddc21c3-3aa9-4fd4-bff1-75fb6c664f64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:54.264223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eddc21c3-3aa9-4fd4-bff1-75fb6c664f64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:54.264657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eddc21c3-3aa9-4fd4-bff1-75fb6c664f64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:54.389761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-eddc21c3-3aa9-4fd4-bff1-75fb6c664f64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:54.397671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eddc21c3-3aa9-4fd4-bff1-75fb6c664f64 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.146134 Jul 14 10:09:54.398268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1038/2083] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:54.637734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:54.638366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:54.645383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:54.645821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:54.646608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:54.647165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:54.709833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:54.718120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:54.719625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:54.720738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5f051175-1b00-437e-abb5-f7a611ed3eff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086982 Jul 14 10:09:54.721292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1046/2084] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:54 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:54.839242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-291f3530-9c9a-41c6-a5cf-383454a499f2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:54.840008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-291f3530-9c9a-41c6-a5cf-383454a499f2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:54.846116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-291f3530-9c9a-41c6-a5cf-383454a499f2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:54.846596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-291f3530-9c9a-41c6-a5cf-383454a499f2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:54.847354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-291f3530-9c9a-41c6-a5cf-383454a499f2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:54.847814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-291f3530-9c9a-41c6-a5cf-383454a499f2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:54.894766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b88ea436-b059-4464-afe0-706c3c2b353d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:54.895505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b88ea436-b059-4464-afe0-706c3c2b353d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:54.901611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b88ea436-b059-4464-afe0-706c3c2b353d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:54.902128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b88ea436-b059-4464-afe0-706c3c2b353d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:54.902978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b88ea436-b059-4464-afe0-706c3c2b353d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:54.903477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b88ea436-b059-4464-afe0-706c3c2b353d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:54.979656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b88ea436-b059-4464-afe0-706c3c2b353d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:54.987587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b88ea436-b059-4464-afe0-706c3c2b353d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.096689 Jul 14 10:09:54.988153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1047/2085] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:54 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:55.000591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-291f3530-9c9a-41c6-a5cf-383454a499f2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:55.008563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-291f3530-9c9a-41c6-a5cf-383454a499f2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.173194 Jul 14 10:09:55.009157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1039/2086] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:54 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:55.414814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-be3f151c-46f2-41a1-8073-1e6fc8248c23 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:55.415337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-be3f151c-46f2-41a1-8073-1e6fc8248c23 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:55.422170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be3f151c-46f2-41a1-8073-1e6fc8248c23 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:55.422634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be3f151c-46f2-41a1-8073-1e6fc8248c23 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:55.423395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be3f151c-46f2-41a1-8073-1e6fc8248c23 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:55.423826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be3f151c-46f2-41a1-8073-1e6fc8248c23 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:55.550131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be3f151c-46f2-41a1-8073-1e6fc8248c23 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:55.558064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-be3f151c-46f2-41a1-8073-1e6fc8248c23 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147181 Jul 14 10:09:55.558655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1048/2087] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:55.739216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:55.739820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:55.746388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:55.746831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:55.747581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:55.748011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:55.808957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:55.817337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:55.818875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:55.820643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-87f983b6-53c3-4ae9-83f2-704d1a859447 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084750 Jul 14 10:09:55.821255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1040/2088] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:55 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:56.004950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fe3e5bf9-3592-40fa-979a-ced99d72c6fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:56.005475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fe3e5bf9-3592-40fa-979a-ced99d72c6fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:56.012678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe3e5bf9-3592-40fa-979a-ced99d72c6fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:56.013116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe3e5bf9-3592-40fa-979a-ced99d72c6fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:56.013863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe3e5bf9-3592-40fa-979a-ced99d72c6fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:56.014316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe3e5bf9-3592-40fa-979a-ced99d72c6fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:56.024538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72cb317d-98f9-4994-9606-68c5a0cfe91d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:56.025134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-72cb317d-98f9-4994-9606-68c5a0cfe91d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:56.031072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72cb317d-98f9-4994-9606-68c5a0cfe91d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:56.031512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72cb317d-98f9-4994-9606-68c5a0cfe91d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:56.032271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72cb317d-98f9-4994-9606-68c5a0cfe91d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:56.032699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72cb317d-98f9-4994-9606-68c5a0cfe91d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:56.089068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fe3e5bf9-3592-40fa-979a-ced99d72c6fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:56.101119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fe3e5bf9-3592-40fa-979a-ced99d72c6fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.099624 Jul 14 10:09:56.102120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1049/2089] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:55 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:56.174804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-72cb317d-98f9-4994-9606-68c5a0cfe91d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:56.183357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-72cb317d-98f9-4994-9606-68c5a0cfe91d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162533 Jul 14 10:09:56.183921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1041/2090] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:56 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:56.575060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-76d15876-0e8f-46e9-9dde-8ffc52754a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:56.575668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-76d15876-0e8f-46e9-9dde-8ffc52754a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:56.582019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76d15876-0e8f-46e9-9dde-8ffc52754a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:56.582502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76d15876-0e8f-46e9-9dde-8ffc52754a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:56.583255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76d15876-0e8f-46e9-9dde-8ffc52754a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:56.583686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76d15876-0e8f-46e9-9dde-8ffc52754a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:56.715339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-76d15876-0e8f-46e9-9dde-8ffc52754a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:56.723478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-76d15876-0e8f-46e9-9dde-8ffc52754a7e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152283 Jul 14 10:09:56.724034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1050/2091] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:56.839375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:56.839899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:56.846476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:56.846923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:56.847681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:56.848112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:56.909459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:56.917866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:56.919384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:56.920781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-af6dbd6a-7918-47ca-907a-339eba51c91d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085965 Jul 14 10:09:56.921349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1042/2092] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:56 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:57.118733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-864e1c97-b624-4765-97ed-0a75e68391b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:57.119278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-864e1c97-b624-4765-97ed-0a75e68391b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:57.125708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-864e1c97-b624-4765-97ed-0a75e68391b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:57.126168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-864e1c97-b624-4765-97ed-0a75e68391b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:57.126942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-864e1c97-b624-4765-97ed-0a75e68391b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:57.127364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-864e1c97-b624-4765-97ed-0a75e68391b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:57.190015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-864e1c97-b624-4765-97ed-0a75e68391b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:57.198426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-864e1c97-b624-4765-97ed-0a75e68391b2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083663 Jul 14 10:09:57.198979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1051/2093] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:57 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:57.201024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-af57ee25-fd72-41b9-b713-5e8b38d4e895 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:57.201645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-af57ee25-fd72-41b9-b713-5e8b38d4e895 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:57.207986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af57ee25-fd72-41b9-b713-5e8b38d4e895 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:57.208439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af57ee25-fd72-41b9-b713-5e8b38d4e895 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:57.209205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af57ee25-fd72-41b9-b713-5e8b38d4e895 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:57.209641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-af57ee25-fd72-41b9-b713-5e8b38d4e895 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:57.338479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-af57ee25-fd72-41b9-b713-5e8b38d4e895 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:57.346589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-af57ee25-fd72-41b9-b713-5e8b38d4e895 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149453 Jul 14 10:09:57.347150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1043/2094] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:57 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:09:57.740910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-82799511-29d4-487c-af6c-93ff015be219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:57.741513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-82799511-29d4-487c-af6c-93ff015be219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:57.748244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82799511-29d4-487c-af6c-93ff015be219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:57.748688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82799511-29d4-487c-af6c-93ff015be219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:57.749440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82799511-29d4-487c-af6c-93ff015be219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:57.749872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82799511-29d4-487c-af6c-93ff015be219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:57.876655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-82799511-29d4-487c-af6c-93ff015be219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:57.884534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-82799511-29d4-487c-af6c-93ff015be219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147524 Jul 14 10:09:57.885102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1052/2095] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:57.938780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:57.939392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:57.945921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:57.946408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:57.947175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:57.947614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:58.008078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:58.016437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:58.017983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:58.019155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-00f6fa9c-7475-4c3e-8bfb-c6ca68bb80cc tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084280 Jul 14 10:09:58.019702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1044/2096] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:57 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:09:58.215608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0c92733b-7a2e-46d5-9aa4-bf536872e9d5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:58.216242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0c92733b-7a2e-46d5-9aa4-bf536872e9d5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:58.222709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c92733b-7a2e-46d5-9aa4-bf536872e9d5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:58.223162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c92733b-7a2e-46d5-9aa4-bf536872e9d5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:58.223895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c92733b-7a2e-46d5-9aa4-bf536872e9d5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:58.224321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c92733b-7a2e-46d5-9aa4-bf536872e9d5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:58.285019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0c92733b-7a2e-46d5-9aa4-bf536872e9d5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:58.293589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0c92733b-7a2e-46d5-9aa4-bf536872e9d5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081779 Jul 14 10:09:58.294157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1053/2097] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:58 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:58.363515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a148d9e6-289e-4a55-bdf4-96f75acdffa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:58.364151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a148d9e6-289e-4a55-bdf4-96f75acdffa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:58.370153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a148d9e6-289e-4a55-bdf4-96f75acdffa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:58.370634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a148d9e6-289e-4a55-bdf4-96f75acdffa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:58.371392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a148d9e6-289e-4a55-bdf4-96f75acdffa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:58.371827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a148d9e6-289e-4a55-bdf4-96f75acdffa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:58.500374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a148d9e6-289e-4a55-bdf4-96f75acdffa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:58.508707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a148d9e6-289e-4a55-bdf4-96f75acdffa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149011 Jul 14 10:09:58.509265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1045/2098] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:58 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:58.900828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fe4a3f02-4878-456d-aa88-b56a2c29c650 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:58.901433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fe4a3f02-4878-456d-aa88-b56a2c29c650 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:58.907432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe4a3f02-4878-456d-aa88-b56a2c29c650 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:58.907874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe4a3f02-4878-456d-aa88-b56a2c29c650 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:58.908626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe4a3f02-4878-456d-aa88-b56a2c29c650 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:58.909060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe4a3f02-4878-456d-aa88-b56a2c29c650 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:59.036989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:59.037598 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:59.041816 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fe4a3f02-4878-456d-aa88-b56a2c29c650 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:59.044156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:59.044611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:59.045791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:59.046246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:59.050792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fe4a3f02-4878-456d-aa88-b56a2c29c650 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153825 Jul 14 10:09:59.051367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1054/2099] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:59.108641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:59.117677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:59.119227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:59.120369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-57386603-c1fd-4d29-957a-f38f7653c182 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087360 Jul 14 10:09:59.120922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1046/2100] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:09:59 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:09:59.311286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b13fa5bf-d0b4-4df0-801b-48188f184bca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:59.311890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b13fa5bf-d0b4-4df0-801b-48188f184bca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:59.318476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b13fa5bf-d0b4-4df0-801b-48188f184bca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:59.318922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b13fa5bf-d0b4-4df0-801b-48188f184bca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:59.319681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b13fa5bf-d0b4-4df0-801b-48188f184bca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:59.320161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b13fa5bf-d0b4-4df0-801b-48188f184bca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:59.389420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b13fa5bf-d0b4-4df0-801b-48188f184bca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:59.397747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b13fa5bf-d0b4-4df0-801b-48188f184bca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090235 Jul 14 10:09:59.398289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1055/2101] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:59 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:09:59.525281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-855b81ae-8c8b-4648-8a83-8b3557d08924 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:09:59.525902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-855b81ae-8c8b-4648-8a83-8b3557d08924 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:09:59.532217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-855b81ae-8c8b-4648-8a83-8b3557d08924 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:59.532669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-855b81ae-8c8b-4648-8a83-8b3557d08924 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:59.533438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-855b81ae-8c8b-4648-8a83-8b3557d08924 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:09:59.533904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-855b81ae-8c8b-4648-8a83-8b3557d08924 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:09:59.658779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-855b81ae-8c8b-4648-8a83-8b3557d08924 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:09:59.667281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-855b81ae-8c8b-4648-8a83-8b3557d08924 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146306 Jul 14 10:09:59.667839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1047/2102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:09:59 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:00.068530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e8f87e28-65d6-4cb6-916a-001d5228234e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:00.069163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e8f87e28-65d6-4cb6-916a-001d5228234e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:00.075774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8f87e28-65d6-4cb6-916a-001d5228234e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:00.076218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8f87e28-65d6-4cb6-916a-001d5228234e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:00.076970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8f87e28-65d6-4cb6-916a-001d5228234e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:00.077398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8f87e28-65d6-4cb6-916a-001d5228234e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:00.139173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:00.139791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:00.147004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:00.147457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:00.148854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:00.149285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:00.225800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:00.233031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e8f87e28-65d6-4cb6-916a-001d5228234e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:00.234425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:00.235950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:00.237105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4a80c790-e8a3-4770-b337-fac1468ebb84 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.102699 Jul 14 10:10:00.237661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1048/2103] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:00 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:00.241411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e8f87e28-65d6-4cb6-916a-001d5228234e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.176687 Jul 14 10:10:00.242001 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1056/2104] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:00 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:00.414729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-708f9981-d33a-4dd1-81be-37e13779fc6e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:00.415248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-708f9981-d33a-4dd1-81be-37e13779fc6e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:00.421699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-708f9981-d33a-4dd1-81be-37e13779fc6e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:00.422145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-708f9981-d33a-4dd1-81be-37e13779fc6e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:00.422930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-708f9981-d33a-4dd1-81be-37e13779fc6e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:00.423366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-708f9981-d33a-4dd1-81be-37e13779fc6e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:00.483789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-708f9981-d33a-4dd1-81be-37e13779fc6e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:00.491705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-708f9981-d33a-4dd1-81be-37e13779fc6e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.080944 Jul 14 10:10:00.492801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1049/2105] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:00 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:00.685365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4d6b154f-771a-49fa-b27b-a47a6bcc52f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:00.685968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4d6b154f-771a-49fa-b27b-a47a6bcc52f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:00.692463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d6b154f-771a-49fa-b27b-a47a6bcc52f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:00.692907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d6b154f-771a-49fa-b27b-a47a6bcc52f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:00.693660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d6b154f-771a-49fa-b27b-a47a6bcc52f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:00.694092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4d6b154f-771a-49fa-b27b-a47a6bcc52f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:00.821159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4d6b154f-771a-49fa-b27b-a47a6bcc52f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:00.829164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4d6b154f-771a-49fa-b27b-a47a6bcc52f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147701 Jul 14 10:10:00.829714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1057/2106] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:00 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:01.254706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:01.255317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:01.258333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7605ce8f-f712-4a69-bc50-14589fb47047 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:01.258981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7605ce8f-f712-4a69-bc50-14589fb47047 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:01.262214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:01.262684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:01.263446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:01.263878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:01.265070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7605ce8f-f712-4a69-bc50-14589fb47047 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:01.265513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7605ce8f-f712-4a69-bc50-14589fb47047 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:01.266292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7605ce8f-f712-4a69-bc50-14589fb47047 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:01.266727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7605ce8f-f712-4a69-bc50-14589fb47047 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:01.338072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:01.347220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:01.348731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:01.349886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-afce1638-8d7e-4592-8acf-0e3b137960bb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.099121 Jul 14 10:10:01.350491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1050/2107] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:01 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:01.426845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7605ce8f-f712-4a69-bc50-14589fb47047 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:01.429002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:01.436147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7605ce8f-f712-4a69-bc50-14589fb47047 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.181649 Jul 14 10:10:01.436720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1058/2108] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:01.509742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d1c76cab-cea7-40c6-8f42-b82196b05e38 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:01.510287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d1c76cab-cea7-40c6-8f42-b82196b05e38 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:01.516521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d1c76cab-cea7-40c6-8f42-b82196b05e38 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:01.516965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d1c76cab-cea7-40c6-8f42-b82196b05e38 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:01.517730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d1c76cab-cea7-40c6-8f42-b82196b05e38 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:01.518164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d1c76cab-cea7-40c6-8f42-b82196b05e38 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:01.581030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d1c76cab-cea7-40c6-8f42-b82196b05e38 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:01.589623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d1c76cab-cea7-40c6-8f42-b82196b05e38 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084329 Jul 14 10:10:01.590275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1051/2109] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:01 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:01.846245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3fea1358-f9a0-42b0-99d0-bea3bf18263e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:01.846774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3fea1358-f9a0-42b0-99d0-bea3bf18263e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:01.852826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3fea1358-f9a0-42b0-99d0-bea3bf18263e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:01.853261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3fea1358-f9a0-42b0-99d0-bea3bf18263e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:01.854002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3fea1358-f9a0-42b0-99d0-bea3bf18263e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:01.854453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3fea1358-f9a0-42b0-99d0-bea3bf18263e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:01.984023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3fea1358-f9a0-42b0-99d0-bea3bf18263e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:01.992585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3fea1358-f9a0-42b0-99d0-bea3bf18263e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149872 Jul 14 10:10:01.993145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1059/2110] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:01 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:02.369096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:02.369697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:02.376391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:02.376837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:02.377590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:02.378020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:02.439199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:02.447570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:02.449077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:02.450224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e01c6002-41ef-417e-ae7e-4519ace1211b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085620 Jul 14 10:10:02.450782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1052/2111] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:02 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:02.452697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-093bd058-1d69-4f59-b13c-50a199bdfc65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:02.453311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-093bd058-1d69-4f59-b13c-50a199bdfc65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:02.459867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-093bd058-1d69-4f59-b13c-50a199bdfc65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:02.460313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-093bd058-1d69-4f59-b13c-50a199bdfc65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:02.461076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-093bd058-1d69-4f59-b13c-50a199bdfc65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:02.461513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-093bd058-1d69-4f59-b13c-50a199bdfc65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:02.591095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-093bd058-1d69-4f59-b13c-50a199bdfc65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:02.599301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-093bd058-1d69-4f59-b13c-50a199bdfc65 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150402 Jul 14 10:10:02.599920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1060/2112] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:02 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:02.607292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-87bfe521-5751-4a20-ac30-183f88cc94db tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:02.607902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-87bfe521-5751-4a20-ac30-183f88cc94db tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:02.615452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87bfe521-5751-4a20-ac30-183f88cc94db tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:02.615897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87bfe521-5751-4a20-ac30-183f88cc94db tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:02.616749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87bfe521-5751-4a20-ac30-183f88cc94db tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:02.617136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87bfe521-5751-4a20-ac30-183f88cc94db tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:02.631754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:02.681723 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-87bfe521-5751-4a20-ac30-183f88cc94db tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:02.689639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-87bfe521-5751-4a20-ac30-183f88cc94db tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086091 Jul 14 10:10:02.690279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1053/2113] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:02 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:03.010124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f64d1a47-6c04-4669-a280-ac6c6e1dc2bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:03.010753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f64d1a47-6c04-4669-a280-ac6c6e1dc2bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:03.016787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f64d1a47-6c04-4669-a280-ac6c6e1dc2bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:03.017225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f64d1a47-6c04-4669-a280-ac6c6e1dc2bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:03.017966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f64d1a47-6c04-4669-a280-ac6c6e1dc2bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:03.018431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f64d1a47-6c04-4669-a280-ac6c6e1dc2bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:03.144427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f64d1a47-6c04-4669-a280-ac6c6e1dc2bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:03.152951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f64d1a47-6c04-4669-a280-ac6c6e1dc2bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147240 Jul 14 10:10:03.153510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1061/2114] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:03 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:03.468242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:03.468846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:03.475325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:03.475764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:03.476513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:03.476972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:03.537511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:03.546173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:03.547697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:03.548827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5f3fa175-be06-43f1-b8db-87278e744c73 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084512 Jul 14 10:10:03.549376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1054/2115] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:03 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:03.618241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-30c66b0f-dcea-4c29-a931-b91fc7946c01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:03.618848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-30c66b0f-dcea-4c29-a931-b91fc7946c01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:03.625293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-30c66b0f-dcea-4c29-a931-b91fc7946c01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:03.625871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-30c66b0f-dcea-4c29-a931-b91fc7946c01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:03.626563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-30c66b0f-dcea-4c29-a931-b91fc7946c01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:03.626915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-30c66b0f-dcea-4c29-a931-b91fc7946c01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:03.706699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eab37223-ba9c-4743-ab66-0cb4bc5d937a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:03.707313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-eab37223-ba9c-4743-ab66-0cb4bc5d937a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:03.713444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eab37223-ba9c-4743-ab66-0cb4bc5d937a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:03.713904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eab37223-ba9c-4743-ab66-0cb4bc5d937a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:03.714682 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eab37223-ba9c-4743-ab66-0cb4bc5d937a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:03.715126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eab37223-ba9c-4743-ab66-0cb4bc5d937a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:03.767108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-30c66b0f-dcea-4c29-a931-b91fc7946c01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:03.775161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-30c66b0f-dcea-4c29-a931-b91fc7946c01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.161344 Jul 14 10:10:03.784647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1062/2116] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:03 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:03.784986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-eab37223-ba9c-4743-ab66-0cb4bc5d937a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:03.791255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eab37223-ba9c-4743-ab66-0cb4bc5d937a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088429 Jul 14 10:10:03.791806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1055/2117] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:03 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:04.171289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8e85f3c8-5677-416c-bee2-70badd38ff94 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:04.171830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8e85f3c8-5677-416c-bee2-70badd38ff94 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:04.177759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e85f3c8-5677-416c-bee2-70badd38ff94 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:04.178256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e85f3c8-5677-416c-bee2-70badd38ff94 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:04.179000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e85f3c8-5677-416c-bee2-70badd38ff94 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:04.179425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e85f3c8-5677-416c-bee2-70badd38ff94 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:04.305014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8e85f3c8-5677-416c-bee2-70badd38ff94 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:04.312825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8e85f3c8-5677-416c-bee2-70badd38ff94 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.145820 Jul 14 10:10:04.313392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1063/2118] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:04 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:04.567585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:04.568182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:04.577253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:04.577698 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:04.578481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:04.579006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:04.639271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:04.647669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:04.649911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:04.651067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ae51ed70-5bfc-4ff1-a668-7902210e5195 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087661 Jul 14 10:10:04.651613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1056/2119] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:04 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:04.792461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-11a2217d-5c3e-4ba2-aad0-2ced5f532f36 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:04.793059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-11a2217d-5c3e-4ba2-aad0-2ced5f532f36 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:04.799986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11a2217d-5c3e-4ba2-aad0-2ced5f532f36 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:04.800422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11a2217d-5c3e-4ba2-aad0-2ced5f532f36 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:04.801171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11a2217d-5c3e-4ba2-aad0-2ced5f532f36 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:04.801601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11a2217d-5c3e-4ba2-aad0-2ced5f532f36 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:04.808701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-537778d9-b412-4eeb-b647-f4c4bce2b3a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:04.809470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-537778d9-b412-4eeb-b647-f4c4bce2b3a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:04.815577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-537778d9-b412-4eeb-b647-f4c4bce2b3a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:04.816032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-537778d9-b412-4eeb-b647-f4c4bce2b3a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:04.816794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-537778d9-b412-4eeb-b647-f4c4bce2b3a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:04.817234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-537778d9-b412-4eeb-b647-f4c4bce2b3a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:04.902247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-537778d9-b412-4eeb-b647-f4c4bce2b3a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:04.910351 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-537778d9-b412-4eeb-b647-f4c4bce2b3a8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.105896 Jul 14 10:10:04.910917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1057/2120] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:04 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:04.958960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-11a2217d-5c3e-4ba2-aad0-2ced5f532f36 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:04.966968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-11a2217d-5c3e-4ba2-aad0-2ced5f532f36 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.178418 Jul 14 10:10:04.967533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1064/2121] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:05.328686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5aae9d31-793e-44b5-bee2-77cb62af1638 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:05.329320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5aae9d31-793e-44b5-bee2-77cb62af1638 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:05.335370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5aae9d31-793e-44b5-bee2-77cb62af1638 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:05.335809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5aae9d31-793e-44b5-bee2-77cb62af1638 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:05.336554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5aae9d31-793e-44b5-bee2-77cb62af1638 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:05.336978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5aae9d31-793e-44b5-bee2-77cb62af1638 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:05.469844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5aae9d31-793e-44b5-bee2-77cb62af1638 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:05.478623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5aae9d31-793e-44b5-bee2-77cb62af1638 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153645 Jul 14 10:10:05.479405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1058/2122] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:05 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:05.670108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:05.670725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:05.677180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:05.677627 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:05.678424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:05.678858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:05.739467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:05.748344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:05.749840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:05.751127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-51112b57-35d6-4b58-a8cb-4b0e7ad7a06a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085295 Jul 14 10:10:05.751690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1065/2123] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:05 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:05.926674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5518f5a2-b9f2-4003-ba03-aaf872630694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:05.927293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5518f5a2-b9f2-4003-ba03-aaf872630694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:05.934591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5518f5a2-b9f2-4003-ba03-aaf872630694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:05.935046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5518f5a2-b9f2-4003-ba03-aaf872630694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:05.935809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5518f5a2-b9f2-4003-ba03-aaf872630694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:05.936246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5518f5a2-b9f2-4003-ba03-aaf872630694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:05.984149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-317348fd-4dd1-4b7b-83a9-60490da85370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:05.984784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-317348fd-4dd1-4b7b-83a9-60490da85370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:05.991222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-317348fd-4dd1-4b7b-83a9-60490da85370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:05.991670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-317348fd-4dd1-4b7b-83a9-60490da85370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:05.993020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-317348fd-4dd1-4b7b-83a9-60490da85370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:05.993445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-317348fd-4dd1-4b7b-83a9-60490da85370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:05.997350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5518f5a2-b9f2-4003-ba03-aaf872630694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:06.005249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5518f5a2-b9f2-4003-ba03-aaf872630694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082395 Jul 14 10:10:06.006202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1059/2124] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:05 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:06.129494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-317348fd-4dd1-4b7b-83a9-60490da85370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:06.137404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-317348fd-4dd1-4b7b-83a9-60490da85370 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.157063 Jul 14 10:10:06.137967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1066/2125] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:06.495810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6f5f65ba-2b40-45d8-b73d-6875b595d539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:06.496449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6f5f65ba-2b40-45d8-b73d-6875b595d539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:06.502519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f5f65ba-2b40-45d8-b73d-6875b595d539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:06.502962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f5f65ba-2b40-45d8-b73d-6875b595d539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:06.503717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f5f65ba-2b40-45d8-b73d-6875b595d539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:06.504142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f5f65ba-2b40-45d8-b73d-6875b595d539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:06.633734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6f5f65ba-2b40-45d8-b73d-6875b595d539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:06.641573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6f5f65ba-2b40-45d8-b73d-6875b595d539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149662 Jul 14 10:10:06.642127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1060/2126] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:06 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:06.769455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:06.769990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:06.776913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:06.777356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:06.778106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:06.778566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:06.839011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:06.847350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:06.848839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:06.849956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a28aeb1c-c5a9-4e92-8136-ba490d7cc058 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084591 Jul 14 10:10:06.850553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1067/2127] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:06 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:07.022012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-062abfd3-06e5-4e37-b767-529a9fd0036e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:07.022586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-062abfd3-06e5-4e37-b767-529a9fd0036e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:07.029231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-062abfd3-06e5-4e37-b767-529a9fd0036e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:07.029680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-062abfd3-06e5-4e37-b767-529a9fd0036e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:07.030469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-062abfd3-06e5-4e37-b767-529a9fd0036e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:07.030904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-062abfd3-06e5-4e37-b767-529a9fd0036e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:07.091481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-062abfd3-06e5-4e37-b767-529a9fd0036e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:07.099376 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-062abfd3-06e5-4e37-b767-529a9fd0036e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081346 Jul 14 10:10:07.099937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1061/2128] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:07 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:07.154742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ce1e1465-016b-4d8a-8472-5e3260139972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:07.155353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ce1e1465-016b-4d8a-8472-5e3260139972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:07.162232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce1e1465-016b-4d8a-8472-5e3260139972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:07.162680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce1e1465-016b-4d8a-8472-5e3260139972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:07.163433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce1e1465-016b-4d8a-8472-5e3260139972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:07.163864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce1e1465-016b-4d8a-8472-5e3260139972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:07.291270 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ce1e1465-016b-4d8a-8472-5e3260139972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:07.299431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ce1e1465-016b-4d8a-8472-5e3260139972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148438 Jul 14 10:10:07.299990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1068/2129] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:07.658289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c5b4ea2f-85b9-4a43-a8f3-62531320707f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:07.658906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c5b4ea2f-85b9-4a43-a8f3-62531320707f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:07.665502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5b4ea2f-85b9-4a43-a8f3-62531320707f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:07.665955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5b4ea2f-85b9-4a43-a8f3-62531320707f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:07.666740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5b4ea2f-85b9-4a43-a8f3-62531320707f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:07.667178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5b4ea2f-85b9-4a43-a8f3-62531320707f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:07.793608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c5b4ea2f-85b9-4a43-a8f3-62531320707f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:07.802438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c5b4ea2f-85b9-4a43-a8f3-62531320707f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148187 Jul 14 10:10:07.803001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1062/2130] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:07 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:07.868343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:07.868877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:07.874864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:07.875307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:07.876049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:07.876480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:07.936348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:07.944568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:07.946712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:07.947825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-44550eee-39c1-4a8f-b133-6c33bd92f9f3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.084020 Jul 14 10:10:07.948374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1069/2131] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:07 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:08.116471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-310baf7c-067a-4dca-9962-dc5d46ec6102 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:08.117080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-310baf7c-067a-4dca-9962-dc5d46ec6102 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:08.124170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-310baf7c-067a-4dca-9962-dc5d46ec6102 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:08.124557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-310baf7c-067a-4dca-9962-dc5d46ec6102 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:08.125313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-310baf7c-067a-4dca-9962-dc5d46ec6102 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:08.125902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-310baf7c-067a-4dca-9962-dc5d46ec6102 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:08.189998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-310baf7c-067a-4dca-9962-dc5d46ec6102 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:08.198003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-310baf7c-067a-4dca-9962-dc5d46ec6102 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085453 Jul 14 10:10:08.198603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1063/2132] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:08 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:08.316864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-10752e48-6681-48b6-9104-3f247e487da5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:08.317468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-10752e48-6681-48b6-9104-3f247e487da5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:08.324024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10752e48-6681-48b6-9104-3f247e487da5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:08.324487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10752e48-6681-48b6-9104-3f247e487da5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:08.325234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10752e48-6681-48b6-9104-3f247e487da5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:08.325660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-10752e48-6681-48b6-9104-3f247e487da5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:08.455421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-10752e48-6681-48b6-9104-3f247e487da5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:08.463721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-10752e48-6681-48b6-9104-3f247e487da5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150692 Jul 14 10:10:08.464284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1070/2133] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:08.819427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-944af044-e410-4d86-8a83-3439bc3d8b5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:08.820039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-944af044-e410-4d86-8a83-3439bc3d8b5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:08.828102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-944af044-e410-4d86-8a83-3439bc3d8b5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:08.828555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-944af044-e410-4d86-8a83-3439bc3d8b5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:08.829326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-944af044-e410-4d86-8a83-3439bc3d8b5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:08.829769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-944af044-e410-4d86-8a83-3439bc3d8b5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:08.966907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:08.967515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:08.968678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-944af044-e410-4d86-8a83-3439bc3d8b5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:08.973705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:08.974143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:08.974922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:08.975351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:08.978094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-944af044-e410-4d86-8a83-3439bc3d8b5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162511 Jul 14 10:10:08.978734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1064/2134] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:08 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:09.038765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:09.049335 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:09.050875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:09.052085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-03b321e6-f200-40d9-b2b1-1da3c0041154 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089045 Jul 14 10:10:09.052640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1071/2135] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:08 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:09.215268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8e3e60ad-31dd-460c-989d-90367e1dfbdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:09.215874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8e3e60ad-31dd-460c-989d-90367e1dfbdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:09.222560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e3e60ad-31dd-460c-989d-90367e1dfbdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:09.223003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e3e60ad-31dd-460c-989d-90367e1dfbdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:09.223761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e3e60ad-31dd-460c-989d-90367e1dfbdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:09.224192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e3e60ad-31dd-460c-989d-90367e1dfbdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:09.287424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8e3e60ad-31dd-460c-989d-90367e1dfbdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:09.295542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8e3e60ad-31dd-460c-989d-90367e1dfbdb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084584 Jul 14 10:10:09.296099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1065/2136] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:09 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:09.481172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-45dac4ba-4b21-4a51-8576-23fb2563f6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:09.481689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-45dac4ba-4b21-4a51-8576-23fb2563f6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:09.488454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45dac4ba-4b21-4a51-8576-23fb2563f6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:09.488894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45dac4ba-4b21-4a51-8576-23fb2563f6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:09.489645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45dac4ba-4b21-4a51-8576-23fb2563f6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:09.490070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45dac4ba-4b21-4a51-8576-23fb2563f6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:09.626297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-45dac4ba-4b21-4a51-8576-23fb2563f6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:09.635146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-45dac4ba-4b21-4a51-8576-23fb2563f6f5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.158022 Jul 14 10:10:09.635697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1072/2137] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:09.996239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e925f004-89e4-4355-b765-8d72d01c91c3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:09.996977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e925f004-89e4-4355-b765-8d72d01c91c3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:10.003203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e925f004-89e4-4355-b765-8d72d01c91c3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:10.003648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e925f004-89e4-4355-b765-8d72d01c91c3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:10.004401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e925f004-89e4-4355-b765-8d72d01c91c3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:10.004835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e925f004-89e4-4355-b765-8d72d01c91c3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:10.070161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:10.071607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:10.077346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:10.077796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:10.078593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:10.079025 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:10.154678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:10.158547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e925f004-89e4-4355-b765-8d72d01c91c3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:10.163192 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:10.164740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:10.165908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-32e32b36-c198-4f18-baee-66fb022d609d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.099710 Jul 14 10:10:10.166486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e925f004-89e4-4355-b765-8d72d01c91c3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.174615 Jul 14 10:10:10.166612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1073/2138] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:10 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:10.167028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1066/2139] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:09 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:10.312991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f7097534-802d-4620-9f1e-c8ea3920df00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:10.313510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f7097534-802d-4620-9f1e-c8ea3920df00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:10.319649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7097534-802d-4620-9f1e-c8ea3920df00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:10.320089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7097534-802d-4620-9f1e-c8ea3920df00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:10.321496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7097534-802d-4620-9f1e-c8ea3920df00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:10.322027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f7097534-802d-4620-9f1e-c8ea3920df00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:10.381841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f7097534-802d-4620-9f1e-c8ea3920df00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:10.390470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f7097534-802d-4620-9f1e-c8ea3920df00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081391 Jul 14 10:10:10.391023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1074/2140] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:10 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:10.652495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f7bc4923-1aed-454e-b21a-93a54de3dac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:10.653043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f7bc4923-1aed-454e-b21a-93a54de3dac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:10.659236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f7bc4923-1aed-454e-b21a-93a54de3dac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:10.659678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f7bc4923-1aed-454e-b21a-93a54de3dac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:10.660446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f7bc4923-1aed-454e-b21a-93a54de3dac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:10.660871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f7bc4923-1aed-454e-b21a-93a54de3dac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:10.790856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f7bc4923-1aed-454e-b21a-93a54de3dac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:10.798998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f7bc4923-1aed-454e-b21a-93a54de3dac3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150547 Jul 14 10:10:10.799555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1067/2141] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:11.183892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a900897a-e995-4754-b8f1-94925f21a743 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:11.184467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:11.184597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a900897a-e995-4754-b8f1-94925f21a743 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:11.184696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:11.186846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:11.190839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:11.191292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:11.192063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:11.192505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:11.192668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a900897a-e995-4754-b8f1-94925f21a743 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:11.193109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a900897a-e995-4754-b8f1-94925f21a743 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:11.193857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a900897a-e995-4754-b8f1-94925f21a743 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:11.194315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a900897a-e995-4754-b8f1-94925f21a743 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:11.211787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:11.261306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:11.269802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:11.271350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:11.272496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-35c4efc4-e322-455e-8c96-b08777ccabf0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092551 Jul 14 10:10:11.273051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1068/2142] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:11 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:11.343464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a900897a-e995-4754-b8f1-94925f21a743 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:11.351332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a900897a-e995-4754-b8f1-94925f21a743 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.171363 Jul 14 10:10:11.351941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1075/2143] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:11 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:11.407264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-480a9051-b7c5-4859-8e5a-0a5c6d68c9f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:11.407867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-480a9051-b7c5-4859-8e5a-0a5c6d68c9f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:11.413866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-480a9051-b7c5-4859-8e5a-0a5c6d68c9f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:11.414460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-480a9051-b7c5-4859-8e5a-0a5c6d68c9f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:11.415231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-480a9051-b7c5-4859-8e5a-0a5c6d68c9f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:11.415659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-480a9051-b7c5-4859-8e5a-0a5c6d68c9f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:11.478877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-480a9051-b7c5-4859-8e5a-0a5c6d68c9f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:11.486958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-480a9051-b7c5-4859-8e5a-0a5c6d68c9f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083600 Jul 14 10:10:11.487518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1069/2144] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:11 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:11.816418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a5a21da5-01c0-473f-a271-04af34cb456e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:11.816944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a5a21da5-01c0-473f-a271-04af34cb456e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:11.823672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5a21da5-01c0-473f-a271-04af34cb456e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:11.824115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5a21da5-01c0-473f-a271-04af34cb456e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:11.824868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5a21da5-01c0-473f-a271-04af34cb456e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:11.825297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5a21da5-01c0-473f-a271-04af34cb456e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:12.207409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a5a21da5-01c0-473f-a271-04af34cb456e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:12.215293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a5a21da5-01c0-473f-a271-04af34cb456e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.402855 Jul 14 10:10:12.215855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1076/2145] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:11 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:12.291409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:12.292035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:12.299342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:12.299851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:12.300750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:12.301184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:12.305156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:12.362493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:12.368185 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6015796a-6dc2-4a75-958e-5d89ba8d0afc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:12.368800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6015796a-6dc2-4a75-958e-5d89ba8d0afc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:12.370988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:12.372484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:12.373605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b05382f3-849c-4847-be6f-63c4a2d67629 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086681 Jul 14 10:10:12.374147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1070/2146] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:12 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:12.374762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6015796a-6dc2-4a75-958e-5d89ba8d0afc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:12.375283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6015796a-6dc2-4a75-958e-5d89ba8d0afc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:12.376050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6015796a-6dc2-4a75-958e-5d89ba8d0afc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:12.376484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6015796a-6dc2-4a75-958e-5d89ba8d0afc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:12.504554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d3e7e1ee-99ec-4d09-ac2a-22770f09c39b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:12.505166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d3e7e1ee-99ec-4d09-ac2a-22770f09c39b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:12.510330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6015796a-6dc2-4a75-958e-5d89ba8d0afc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:12.511295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3e7e1ee-99ec-4d09-ac2a-22770f09c39b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:12.511743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3e7e1ee-99ec-4d09-ac2a-22770f09c39b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:12.512508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3e7e1ee-99ec-4d09-ac2a-22770f09c39b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:12.512937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d3e7e1ee-99ec-4d09-ac2a-22770f09c39b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:12.518332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6015796a-6dc2-4a75-958e-5d89ba8d0afc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153936 Jul 14 10:10:12.518900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1077/2147] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:12 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:12.576423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d3e7e1ee-99ec-4d09-ac2a-22770f09c39b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:12.584295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d3e7e1ee-99ec-4d09-ac2a-22770f09c39b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083935 Jul 14 10:10:12.584845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1071/2148] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:12 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:13.233252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e44ee864-ef91-48e8-b4dc-3a5627f2b44b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:13.233848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e44ee864-ef91-48e8-b4dc-3a5627f2b44b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:13.240373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e44ee864-ef91-48e8-b4dc-3a5627f2b44b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:13.240817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e44ee864-ef91-48e8-b4dc-3a5627f2b44b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:13.241569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e44ee864-ef91-48e8-b4dc-3a5627f2b44b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:13.241998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e44ee864-ef91-48e8-b4dc-3a5627f2b44b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:13.365758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e44ee864-ef91-48e8-b4dc-3a5627f2b44b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:13.374117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e44ee864-ef91-48e8-b4dc-3a5627f2b44b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.144768 Jul 14 10:10:13.374706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1078/2149] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:13 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:13.392081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:13.392624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:13.394717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:13.399858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:13.400297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:13.401045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:13.401526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:13.466288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:13.474839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:13.476346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:13.477476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2e6e20b9-30cf-4995-9961-61380d41b5d8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089599 Jul 14 10:10:13.478029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1072/2150] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:13 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:13.536088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-39995bf8-c858-4fbb-91da-b1aba6c80914 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:13.536617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-39995bf8-c858-4fbb-91da-b1aba6c80914 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:13.542690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39995bf8-c858-4fbb-91da-b1aba6c80914 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:13.543130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39995bf8-c858-4fbb-91da-b1aba6c80914 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:13.543881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39995bf8-c858-4fbb-91da-b1aba6c80914 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:13.544312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39995bf8-c858-4fbb-91da-b1aba6c80914 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:13.600921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-97b27a63-3644-47d9-8fa0-db7a729d72f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:13.601532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-97b27a63-3644-47d9-8fa0-db7a729d72f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:13.607617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97b27a63-3644-47d9-8fa0-db7a729d72f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:13.608064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97b27a63-3644-47d9-8fa0-db7a729d72f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:13.608821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97b27a63-3644-47d9-8fa0-db7a729d72f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:13.609259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97b27a63-3644-47d9-8fa0-db7a729d72f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:13.674434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-97b27a63-3644-47d9-8fa0-db7a729d72f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:13.682327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-97b27a63-3644-47d9-8fa0-db7a729d72f7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085337 Jul 14 10:10:13.683405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1073/2151] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:13 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:13.695798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-39995bf8-c858-4fbb-91da-b1aba6c80914 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:13.704317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-39995bf8-c858-4fbb-91da-b1aba6c80914 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.172137 Jul 14 10:10:13.704862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1079/2152] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:13 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:14.391734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6dd520d4-b8cb-4ab9-a748-42d05428f043 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:14.392334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6dd520d4-b8cb-4ab9-a748-42d05428f043 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:14.400751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dd520d4-b8cb-4ab9-a748-42d05428f043 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:14.401194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dd520d4-b8cb-4ab9-a748-42d05428f043 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:14.402040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dd520d4-b8cb-4ab9-a748-42d05428f043 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:14.402499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dd520d4-b8cb-4ab9-a748-42d05428f043 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:14.496099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:14.496701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:14.503269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:14.504728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:14.504728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:14.504948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:14.536002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6dd520d4-b8cb-4ab9-a748-42d05428f043 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:14.544686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6dd520d4-b8cb-4ab9-a748-42d05428f043 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.156883 Jul 14 10:10:14.545629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1074/2153] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:14.566680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:14.575061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:14.576539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:14.577654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-16c42f55-b873-463e-b4d1-c9ea361d89c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086053 Jul 14 10:10:14.578222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1080/2154] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:14 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:14.699847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cf3b4971-961a-497f-bc54-72f504066f75 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:14.700449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cf3b4971-961a-497f-bc54-72f504066f75 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:14.706491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf3b4971-961a-497f-bc54-72f504066f75 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:14.706941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf3b4971-961a-497f-bc54-72f504066f75 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:14.707724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf3b4971-961a-497f-bc54-72f504066f75 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:14.708161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cf3b4971-961a-497f-bc54-72f504066f75 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:14.720849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a7522928-f4de-4c12-b48d-5ac517c44aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:14.721454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a7522928-f4de-4c12-b48d-5ac517c44aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:14.727405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7522928-f4de-4c12-b48d-5ac517c44aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:14.727844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7522928-f4de-4c12-b48d-5ac517c44aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:14.728633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7522928-f4de-4c12-b48d-5ac517c44aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:14.729062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7522928-f4de-4c12-b48d-5ac517c44aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:14.772243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cf3b4971-961a-497f-bc54-72f504066f75 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:14.780252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cf3b4971-961a-497f-bc54-72f504066f75 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084362 Jul 14 10:10:14.780855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1075/2155] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:14 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:14.868818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a7522928-f4de-4c12-b48d-5ac517c44aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:14.876844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a7522928-f4de-4c12-b48d-5ac517c44aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.159986 Jul 14 10:10:14.877392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1081/2156] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:14 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:15.562879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bc208242-5344-4ded-9f6b-5a3edd8e05ed tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:15.563521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bc208242-5344-4ded-9f6b-5a3edd8e05ed tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:15.570155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc208242-5344-4ded-9f6b-5a3edd8e05ed tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:15.570630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc208242-5344-4ded-9f6b-5a3edd8e05ed tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:15.571398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc208242-5344-4ded-9f6b-5a3edd8e05ed tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:15.571831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bc208242-5344-4ded-9f6b-5a3edd8e05ed tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:15.596237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:15.596841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:15.603148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:15.603593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:15.604357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:15.604789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:15.693774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:15.703354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:15.704873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:15.706041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f4f7aa72-7118-4435-9437-5a9fc08a8cab tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.113644 Jul 14 10:10:15.706640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1082/2157] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:15 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:15.735438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bc208242-5344-4ded-9f6b-5a3edd8e05ed tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:15.743537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bc208242-5344-4ded-9f6b-5a3edd8e05ed tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.185114 Jul 14 10:10:15.744091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1076/2158] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:15.797886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-25e19e57-b039-49ec-ab72-f0615be0dbc2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:15.798513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-25e19e57-b039-49ec-ab72-f0615be0dbc2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:15.804665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25e19e57-b039-49ec-ab72-f0615be0dbc2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:15.805107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25e19e57-b039-49ec-ab72-f0615be0dbc2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:15.805877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25e19e57-b039-49ec-ab72-f0615be0dbc2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:15.806341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25e19e57-b039-49ec-ab72-f0615be0dbc2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:15.874670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-25e19e57-b039-49ec-ab72-f0615be0dbc2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:15.882803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-25e19e57-b039-49ec-ab72-f0615be0dbc2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089629 Jul 14 10:10:15.883383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1083/2159] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:15 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:15.893563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8ed4056f-10dd-4bd7-847f-7440737827c8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:15.894171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8ed4056f-10dd-4bd7-847f-7440737827c8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:15.900813 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ed4056f-10dd-4bd7-847f-7440737827c8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:15.901259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ed4056f-10dd-4bd7-847f-7440737827c8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:15.902022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ed4056f-10dd-4bd7-847f-7440737827c8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:15.902470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ed4056f-10dd-4bd7-847f-7440737827c8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:16.038371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8ed4056f-10dd-4bd7-847f-7440737827c8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:16.047132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:10:16.047366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:10:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:10:16.047565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8ed4056f-10dd-4bd7-847f-7440737827c8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157610 Jul 14 10:10:16.048473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1077/2160] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:15 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:16.724470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:16.725118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:16.732176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:16.732613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:16.733371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:16.733799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:16.761843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-250e7643-1495-49a4-bc22-65e38d6e2e6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:16.762657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-250e7643-1495-49a4-bc22-65e38d6e2e6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:16.769744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-250e7643-1495-49a4-bc22-65e38d6e2e6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:16.770347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-250e7643-1495-49a4-bc22-65e38d6e2e6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:16.771125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-250e7643-1495-49a4-bc22-65e38d6e2e6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:16.771565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-250e7643-1495-49a4-bc22-65e38d6e2e6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:16.795460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:16.804169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:16.805678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:16.806842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-25b2d283-0193-45e2-b7c0-727d88c6ca59 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086370 Jul 14 10:10:16.807411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1084/2161] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:16 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:16.898689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-250e7643-1495-49a4-bc22-65e38d6e2e6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:16.900401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-44602937-e853-4b01-ac02-7a9bc6508488 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:16.901050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-44602937-e853-4b01-ac02-7a9bc6508488 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:16.907203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-250e7643-1495-49a4-bc22-65e38d6e2e6d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.149158 Jul 14 10:10:16.907755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1078/2162] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:16 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:16.907914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44602937-e853-4b01-ac02-7a9bc6508488 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:16.908318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44602937-e853-4b01-ac02-7a9bc6508488 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:16.909254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44602937-e853-4b01-ac02-7a9bc6508488 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:16.909687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44602937-e853-4b01-ac02-7a9bc6508488 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:16.973384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-44602937-e853-4b01-ac02-7a9bc6508488 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:16.981758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-44602937-e853-4b01-ac02-7a9bc6508488 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085121 Jul 14 10:10:16.982336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1085/2163] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:16 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:17.064911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e7d93bed-9249-460b-b964-abb1b9e981d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:17.065525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e7d93bed-9249-460b-b964-abb1b9e981d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:17.071678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7d93bed-9249-460b-b964-abb1b9e981d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:17.072128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7d93bed-9249-460b-b964-abb1b9e981d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:17.072943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7d93bed-9249-460b-b964-abb1b9e981d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:17.073315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e7d93bed-9249-460b-b964-abb1b9e981d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:17.206650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e7d93bed-9249-460b-b964-abb1b9e981d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:17.214606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e7d93bed-9249-460b-b964-abb1b9e981d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153524 Jul 14 10:10:17.215177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1079/2164] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:17 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:17.825452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:17.826000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:17.832767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:17.833211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:17.833981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:17.834445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:17.897749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:17.907027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:17.908667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:17.909810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1b20b9b5-5437-429e-9124-2bb828ec149b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088749 Jul 14 10:10:17.910390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1086/2165] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:17 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:17.924788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-926d17f2-3e69-45d5-8f49-2b368fd49b0b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:17.925402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-926d17f2-3e69-45d5-8f49-2b368fd49b0b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:17.932120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-926d17f2-3e69-45d5-8f49-2b368fd49b0b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:17.932571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-926d17f2-3e69-45d5-8f49-2b368fd49b0b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:17.933849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-926d17f2-3e69-45d5-8f49-2b368fd49b0b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:17.934342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-926d17f2-3e69-45d5-8f49-2b368fd49b0b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:17.999010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0a8f1cde-f5d5-42ac-b789-d584d7fda36d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:17.999752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0a8f1cde-f5d5-42ac-b789-d584d7fda36d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:18.007025 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a8f1cde-f5d5-42ac-b789-d584d7fda36d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:18.007456 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a8f1cde-f5d5-42ac-b789-d584d7fda36d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:18.008291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a8f1cde-f5d5-42ac-b789-d584d7fda36d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:18.008720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0a8f1cde-f5d5-42ac-b789-d584d7fda36d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:18.088321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0a8f1cde-f5d5-42ac-b789-d584d7fda36d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:18.096401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0a8f1cde-f5d5-42ac-b789-d584d7fda36d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.101271 Jul 14 10:10:18.096975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1087/2166] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:17 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:18.111066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-926d17f2-3e69-45d5-8f49-2b368fd49b0b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:18.120456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-926d17f2-3e69-45d5-8f49-2b368fd49b0b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.199390 Jul 14 10:10:18.121554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1080/2167] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:18.232008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f66477fa-c21b-4997-aa20-99541d058d15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:18.232617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f66477fa-c21b-4997-aa20-99541d058d15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:18.238685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f66477fa-c21b-4997-aa20-99541d058d15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:18.239129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f66477fa-c21b-4997-aa20-99541d058d15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:18.239887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f66477fa-c21b-4997-aa20-99541d058d15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:18.240319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f66477fa-c21b-4997-aa20-99541d058d15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:18.370308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f66477fa-c21b-4997-aa20-99541d058d15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:18.378940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f66477fa-c21b-4997-aa20-99541d058d15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151267 Jul 14 10:10:18.379499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1088/2168] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:18 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:18.928512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:18.929119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:18.935651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:18.936095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:18.936842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:18.937262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:19.001621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:19.010457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:19.012459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:19.013587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b2b3d5ee-b929-4064-99b1-14c5e20a4e93 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088985 Jul 14 10:10:19.014138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1081/2169] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:18 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:19.115387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c27b8cdf-1f31-4569-9974-12ddee879a18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:19.115994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c27b8cdf-1f31-4569-9974-12ddee879a18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:19.122527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c27b8cdf-1f31-4569-9974-12ddee879a18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:19.122969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c27b8cdf-1f31-4569-9974-12ddee879a18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:19.123720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c27b8cdf-1f31-4569-9974-12ddee879a18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:19.124148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c27b8cdf-1f31-4569-9974-12ddee879a18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:19.138679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-22eb829f-5658-4aa7-85fd-16b63b8b282d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:19.139289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-22eb829f-5658-4aa7-85fd-16b63b8b282d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:19.145260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22eb829f-5658-4aa7-85fd-16b63b8b282d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:19.145703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22eb829f-5658-4aa7-85fd-16b63b8b282d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:19.146553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22eb829f-5658-4aa7-85fd-16b63b8b282d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:19.146984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22eb829f-5658-4aa7-85fd-16b63b8b282d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:19.202336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c27b8cdf-1f31-4569-9974-12ddee879a18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:19.210406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c27b8cdf-1f31-4569-9974-12ddee879a18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.098778 Jul 14 10:10:19.210965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1089/2170] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:19 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:19.288318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-22eb829f-5658-4aa7-85fd-16b63b8b282d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:19.296508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-22eb829f-5658-4aa7-85fd-16b63b8b282d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.162042 Jul 14 10:10:19.297190 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1082/2171] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:19 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:19.396635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-804b7ebb-242c-4f97-8a4b-4ee66b20d736 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:19.397245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-804b7ebb-242c-4f97-8a4b-4ee66b20d736 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:19.403262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-804b7ebb-242c-4f97-8a4b-4ee66b20d736 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:19.403701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-804b7ebb-242c-4f97-8a4b-4ee66b20d736 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:19.404449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-804b7ebb-242c-4f97-8a4b-4ee66b20d736 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:19.404877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-804b7ebb-242c-4f97-8a4b-4ee66b20d736 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:19.535809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-804b7ebb-242c-4f97-8a4b-4ee66b20d736 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:19.543698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-804b7ebb-242c-4f97-8a4b-4ee66b20d736 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150900 Jul 14 10:10:19.544256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1090/2172] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:19 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:20.030845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:20.031450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:20.037946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:20.038426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:20.039188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:20.039622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:20.101761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:20.111057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:20.112551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:20.113678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1e2c3542-7c64-4587-ba00-7acb1d34a048 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086774 Jul 14 10:10:20.114258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1083/2173] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:20 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:20.228302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1bad9396-6301-47be-9b1d-1e0af4d76469 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:20.228886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1bad9396-6301-47be-9b1d-1e0af4d76469 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:20.236088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bad9396-6301-47be-9b1d-1e0af4d76469 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:20.236531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bad9396-6301-47be-9b1d-1e0af4d76469 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:20.237274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bad9396-6301-47be-9b1d-1e0af4d76469 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:20.237700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bad9396-6301-47be-9b1d-1e0af4d76469 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:20.300194 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1bad9396-6301-47be-9b1d-1e0af4d76469 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:20.307986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1bad9396-6301-47be-9b1d-1e0af4d76469 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083636 Jul 14 10:10:20.308749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1091/2174] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:20 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:20.313735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ee448a61-fe8a-4d5a-818c-a9a831198d9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:20.314409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ee448a61-fe8a-4d5a-818c-a9a831198d9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:20.320374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee448a61-fe8a-4d5a-818c-a9a831198d9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:20.320815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee448a61-fe8a-4d5a-818c-a9a831198d9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:20.321560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee448a61-fe8a-4d5a-818c-a9a831198d9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:20.321988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee448a61-fe8a-4d5a-818c-a9a831198d9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:20.452837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ee448a61-fe8a-4d5a-818c-a9a831198d9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:20.461543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ee448a61-fe8a-4d5a-818c-a9a831198d9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151582 Jul 14 10:10:20.462106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1084/2175] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:20.560765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-67d6ea47-81e5-408e-8748-fd9762981c69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:20.561373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-67d6ea47-81e5-408e-8748-fd9762981c69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:20.567430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67d6ea47-81e5-408e-8748-fd9762981c69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:20.567868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67d6ea47-81e5-408e-8748-fd9762981c69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:20.568613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67d6ea47-81e5-408e-8748-fd9762981c69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:20.569041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67d6ea47-81e5-408e-8748-fd9762981c69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:20.572897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:20.695960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-67d6ea47-81e5-408e-8748-fd9762981c69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:20.704616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-67d6ea47-81e5-408e-8748-fd9762981c69 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147689 Jul 14 10:10:20.705180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1092/2176] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:20 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:21.131788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:21.132388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:21.139557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:21.139995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:21.140737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:21.141168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:21.201832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:21.210314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:21.211804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:21.212956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4f726685-71dd-488e-8a9e-56297b3f5e88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085103 Jul 14 10:10:21.213504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1085/2177] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:21 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:21.325423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9eceddb8-c643-414a-823f-7cb243881558 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:21.326237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9eceddb8-c643-414a-823f-7cb243881558 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:21.332778 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9eceddb8-c643-414a-823f-7cb243881558 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:21.333219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9eceddb8-c643-414a-823f-7cb243881558 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:21.333971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9eceddb8-c643-414a-823f-7cb243881558 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:21.334425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9eceddb8-c643-414a-823f-7cb243881558 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:21.394567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9eceddb8-c643-414a-823f-7cb243881558 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:21.402678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9eceddb8-c643-414a-823f-7cb243881558 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.080844 Jul 14 10:10:21.403056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1093/2178] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:21 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:21.479661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6fe85678-a9dd-4223-9a0f-d0a90a582935 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:21.480374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6fe85678-a9dd-4223-9a0f-d0a90a582935 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:21.488460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6fe85678-a9dd-4223-9a0f-d0a90a582935 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:21.488910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6fe85678-a9dd-4223-9a0f-d0a90a582935 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:21.489703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6fe85678-a9dd-4223-9a0f-d0a90a582935 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:21.490139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6fe85678-a9dd-4223-9a0f-d0a90a582935 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:21.631380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6fe85678-a9dd-4223-9a0f-d0a90a582935 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:21.633629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:21.641080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6fe85678-a9dd-4223-9a0f-d0a90a582935 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.165271 Jul 14 10:10:21.642138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1086/2179] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:21.722765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e4b3f5bb-4900-467a-8e32-3316ff5b4493 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:21.723480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e4b3f5bb-4900-467a-8e32-3316ff5b4493 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:21.730234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4b3f5bb-4900-467a-8e32-3316ff5b4493 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:21.731244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4b3f5bb-4900-467a-8e32-3316ff5b4493 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:21.732141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4b3f5bb-4900-467a-8e32-3316ff5b4493 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:21.732611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4b3f5bb-4900-467a-8e32-3316ff5b4493 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:21.872090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e4b3f5bb-4900-467a-8e32-3316ff5b4493 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:21.880549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e4b3f5bb-4900-467a-8e32-3316ff5b4493 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162333 Jul 14 10:10:21.881115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1094/2180] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:21 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:22.231233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:22.231821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:22.238345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:22.238796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:22.239553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:22.239988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:22.303891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:22.312938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:22.314473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:22.315622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-455ee459-c6f5-4a0e-8175-8cdd05ed7334 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088619 Jul 14 10:10:22.316155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1087/2181] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:22 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:22.419954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f6a8b467-26d0-4a0e-9e7a-6a3952337170 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:22.420817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f6a8b467-26d0-4a0e-9e7a-6a3952337170 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:22.427361 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6a8b467-26d0-4a0e-9e7a-6a3952337170 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:22.427800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6a8b467-26d0-4a0e-9e7a-6a3952337170 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:22.428548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6a8b467-26d0-4a0e-9e7a-6a3952337170 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:22.428971 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6a8b467-26d0-4a0e-9e7a-6a3952337170 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:22.492942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f6a8b467-26d0-4a0e-9e7a-6a3952337170 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:22.502165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f6a8b467-26d0-4a0e-9e7a-6a3952337170 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086259 Jul 14 10:10:22.502755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1095/2182] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:22 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:22.660809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-109dc414-a67f-4404-9f2f-2f542eeb8312 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:22.661447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-109dc414-a67f-4404-9f2f-2f542eeb8312 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:22.667738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-109dc414-a67f-4404-9f2f-2f542eeb8312 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:22.668188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-109dc414-a67f-4404-9f2f-2f542eeb8312 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:22.668972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-109dc414-a67f-4404-9f2f-2f542eeb8312 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:22.669426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-109dc414-a67f-4404-9f2f-2f542eeb8312 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:22.805823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-109dc414-a67f-4404-9f2f-2f542eeb8312 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:22.815661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-109dc414-a67f-4404-9f2f-2f542eeb8312 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.158700 Jul 14 10:10:22.816268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1088/2183] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:22 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:22.898683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-75a65285-11bf-4523-a650-c103fb56440f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:22.899311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-75a65285-11bf-4523-a650-c103fb56440f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:22.905662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75a65285-11bf-4523-a650-c103fb56440f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:22.906158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75a65285-11bf-4523-a650-c103fb56440f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:22.907059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75a65285-11bf-4523-a650-c103fb56440f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:22.907487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75a65285-11bf-4523-a650-c103fb56440f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:23.040208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-75a65285-11bf-4523-a650-c103fb56440f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:23.049378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-75a65285-11bf-4523-a650-c103fb56440f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154462 Jul 14 10:10:23.049962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1096/2184] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:22 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:23.335223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:23.335833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:23.342946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:23.343397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:23.344255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:23.344918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:23.405018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:23.413417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:23.414986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:23.416132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f9080c77-4b31-48ae-b4b6-2fd2308fbc3b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085536 Jul 14 10:10:23.416679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1089/2185] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:23 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:23.519349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-db84bc36-6717-42ef-8c39-d39166911329 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:23.519890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-db84bc36-6717-42ef-8c39-d39166911329 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:23.526421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-db84bc36-6717-42ef-8c39-d39166911329 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:23.526872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-db84bc36-6717-42ef-8c39-d39166911329 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:23.528301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-db84bc36-6717-42ef-8c39-d39166911329 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:23.528726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-db84bc36-6717-42ef-8c39-d39166911329 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:23.591685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-db84bc36-6717-42ef-8c39-d39166911329 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:23.599725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-db84bc36-6717-42ef-8c39-d39166911329 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084399 Jul 14 10:10:23.600281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1097/2186] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:23 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:23.833637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3a66ad6c-a85d-4dbf-b7f3-18b8e57842ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:23.834157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3a66ad6c-a85d-4dbf-b7f3-18b8e57842ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:23.840345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a66ad6c-a85d-4dbf-b7f3-18b8e57842ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:23.840789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a66ad6c-a85d-4dbf-b7f3-18b8e57842ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:23.841533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a66ad6c-a85d-4dbf-b7f3-18b8e57842ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:23.841965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a66ad6c-a85d-4dbf-b7f3-18b8e57842ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:23.971911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a66ad6c-a85d-4dbf-b7f3-18b8e57842ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:23.979877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3a66ad6c-a85d-4dbf-b7f3-18b8e57842ff tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150172 Jul 14 10:10:23.980452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1090/2187] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:24.067017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6214b337-2b8c-48a4-9cb9-1b1f81317430 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:24.067619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6214b337-2b8c-48a4-9cb9-1b1f81317430 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:24.073626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6214b337-2b8c-48a4-9cb9-1b1f81317430 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:24.074069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6214b337-2b8c-48a4-9cb9-1b1f81317430 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:24.075442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6214b337-2b8c-48a4-9cb9-1b1f81317430 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:24.075872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6214b337-2b8c-48a4-9cb9-1b1f81317430 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:24.203569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6214b337-2b8c-48a4-9cb9-1b1f81317430 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:24.211424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6214b337-2b8c-48a4-9cb9-1b1f81317430 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148280 Jul 14 10:10:24.211981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1098/2188] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:24 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:24.435626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:24.436266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:24.442949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:24.443392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:24.444175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:24.444629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:24.506763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:24.515155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:24.516653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:24.517772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b4f3a1a5-4300-4075-b0bb-df43ff1bfa92 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086663 Jul 14 10:10:24.518354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1091/2189] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:24 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:24.616660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7381741f-b29a-4f8e-89dd-f11d24cbdfbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:24.617264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7381741f-b29a-4f8e-89dd-f11d24cbdfbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:24.623791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7381741f-b29a-4f8e-89dd-f11d24cbdfbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:24.624234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7381741f-b29a-4f8e-89dd-f11d24cbdfbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:24.624979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7381741f-b29a-4f8e-89dd-f11d24cbdfbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:24.625416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7381741f-b29a-4f8e-89dd-f11d24cbdfbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:24.687739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7381741f-b29a-4f8e-89dd-f11d24cbdfbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:24.695436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7381741f-b29a-4f8e-89dd-f11d24cbdfbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082634 Jul 14 10:10:24.695981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1099/2190] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:24 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:24.997070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b21ccdac-b715-46ba-8c70-c5989abd6302 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:24.997596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b21ccdac-b715-46ba-8c70-c5989abd6302 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:25.003590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b21ccdac-b715-46ba-8c70-c5989abd6302 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:25.004031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b21ccdac-b715-46ba-8c70-c5989abd6302 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:25.004776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b21ccdac-b715-46ba-8c70-c5989abd6302 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:25.005234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b21ccdac-b715-46ba-8c70-c5989abd6302 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:25.137527 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b21ccdac-b715-46ba-8c70-c5989abd6302 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:25.147248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b21ccdac-b715-46ba-8c70-c5989abd6302 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.154043 Jul 14 10:10:25.147834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1092/2191] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:24 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:25.228441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-81f57a58-2c1c-40c7-b2c6-3032caa23d10 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:25.229049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-81f57a58-2c1c-40c7-b2c6-3032caa23d10 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:25.235332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81f57a58-2c1c-40c7-b2c6-3032caa23d10 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:25.235779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81f57a58-2c1c-40c7-b2c6-3032caa23d10 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:25.236534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81f57a58-2c1c-40c7-b2c6-3032caa23d10 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:25.236969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81f57a58-2c1c-40c7-b2c6-3032caa23d10 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:25.363678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-81f57a58-2c1c-40c7-b2c6-3032caa23d10 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:25.372051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-81f57a58-2c1c-40c7-b2c6-3032caa23d10 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147445 Jul 14 10:10:25.372602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1100/2192] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:25 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:25.535956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:25.536560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:25.543319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:25.543767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:25.544584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:25.545018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:25.609751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:25.618405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:25.619889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:25.621562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d9a2b854-083e-4af9-b295-89323ed83f9a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.089019 Jul 14 10:10:25.622123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1093/2193] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:25 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:25.712254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2effa419-fcc3-47a3-9937-b3e77951bbe3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:25.712858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2effa419-fcc3-47a3-9937-b3e77951bbe3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:25.719401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2effa419-fcc3-47a3-9937-b3e77951bbe3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:25.719845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2effa419-fcc3-47a3-9937-b3e77951bbe3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:25.720599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2effa419-fcc3-47a3-9937-b3e77951bbe3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:25.721026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2effa419-fcc3-47a3-9937-b3e77951bbe3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:25.781771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2effa419-fcc3-47a3-9937-b3e77951bbe3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:25.789633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2effa419-fcc3-47a3-9937-b3e77951bbe3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081236 Jul 14 10:10:25.790208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1101/2194] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:25 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:26.165081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6dc7f342-3d8c-4cd2-b5cf-d37e91c5b70e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:26.165686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6dc7f342-3d8c-4cd2-b5cf-d37e91c5b70e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:26.173567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dc7f342-3d8c-4cd2-b5cf-d37e91c5b70e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:26.174010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dc7f342-3d8c-4cd2-b5cf-d37e91c5b70e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:26.174798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dc7f342-3d8c-4cd2-b5cf-d37e91c5b70e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:26.175230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6dc7f342-3d8c-4cd2-b5cf-d37e91c5b70e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:26.300199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6dc7f342-3d8c-4cd2-b5cf-d37e91c5b70e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:26.308121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6dc7f342-3d8c-4cd2-b5cf-d37e91c5b70e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.146924 Jul 14 10:10:26.308683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1094/2195] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:26.388706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-46a5f8d3-6eae-4c93-a84e-72f704de18c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:26.389312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-46a5f8d3-6eae-4c93-a84e-72f704de18c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:26.395508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-46a5f8d3-6eae-4c93-a84e-72f704de18c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:26.395951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-46a5f8d3-6eae-4c93-a84e-72f704de18c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:26.396698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-46a5f8d3-6eae-4c93-a84e-72f704de18c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:26.397126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-46a5f8d3-6eae-4c93-a84e-72f704de18c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:26.527964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-46a5f8d3-6eae-4c93-a84e-72f704de18c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:26.535982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-46a5f8d3-6eae-4c93-a84e-72f704de18c7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151079 Jul 14 10:10:26.536544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1102/2196] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:26 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:26.640008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:26.640610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:26.647284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:26.647728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:26.648479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:26.648906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:26.709616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:26.718614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:26.720173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:26.721287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-26f85ac5-3aa0-4a5f-93c2-00025e8a5abb tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.085672 Jul 14 10:10:26.721837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1095/2197] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:26 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:26.807513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1bf28940-7d5d-4a3d-9899-5b126559244b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:26.808037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1bf28940-7d5d-4a3d-9899-5b126559244b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:26.815404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bf28940-7d5d-4a3d-9899-5b126559244b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:26.815841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bf28940-7d5d-4a3d-9899-5b126559244b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:26.816615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bf28940-7d5d-4a3d-9899-5b126559244b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:26.817041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bf28940-7d5d-4a3d-9899-5b126559244b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:26.877945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1bf28940-7d5d-4a3d-9899-5b126559244b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:26.885846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1bf28940-7d5d-4a3d-9899-5b126559244b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082347 Jul 14 10:10:26.886431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1103/2198] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:26 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:27.325238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-52bfa449-7747-4c8e-ae3c-a5e3b0df86d1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:27.325839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-52bfa449-7747-4c8e-ae3c-a5e3b0df86d1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:27.332223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52bfa449-7747-4c8e-ae3c-a5e3b0df86d1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:27.332667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52bfa449-7747-4c8e-ae3c-a5e3b0df86d1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:27.333409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52bfa449-7747-4c8e-ae3c-a5e3b0df86d1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:27.333838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-52bfa449-7747-4c8e-ae3c-a5e3b0df86d1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:27.463185 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-52bfa449-7747-4c8e-ae3c-a5e3b0df86d1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:27.471462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-52bfa449-7747-4c8e-ae3c-a5e3b0df86d1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150287 Jul 14 10:10:27.472011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1096/2199] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:27.553276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ceb67122-1751-4e0d-ae1f-b647a2ec9cb3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:27.553916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ceb67122-1751-4e0d-ae1f-b647a2ec9cb3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:27.560839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ceb67122-1751-4e0d-ae1f-b647a2ec9cb3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:27.561104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ceb67122-1751-4e0d-ae1f-b647a2ec9cb3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:27.561832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ceb67122-1751-4e0d-ae1f-b647a2ec9cb3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:27.562330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ceb67122-1751-4e0d-ae1f-b647a2ec9cb3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:27.688839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ceb67122-1751-4e0d-ae1f-b647a2ec9cb3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:27.696732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ceb67122-1751-4e0d-ae1f-b647a2ec9cb3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147402 Jul 14 10:10:27.697390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1104/2200] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:27 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:27.739488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:27.740096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:27.746505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:27.746948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:27.747689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:27.748120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:27.815857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:27.824622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:27.826122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:27.827342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3a7e4f49-b599-4899-b7fb-d3b994ca99a0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091729 Jul 14 10:10:27.827895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1097/2201] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:27 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:27.903999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cc90e3c2-6c80-4b6b-9732-12186d2ba525 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:27.904534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cc90e3c2-6c80-4b6b-9732-12186d2ba525 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:27.911690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc90e3c2-6c80-4b6b-9732-12186d2ba525 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:27.912134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc90e3c2-6c80-4b6b-9732-12186d2ba525 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:27.912887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc90e3c2-6c80-4b6b-9732-12186d2ba525 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:27.913316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc90e3c2-6c80-4b6b-9732-12186d2ba525 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:27.978333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cc90e3c2-6c80-4b6b-9732-12186d2ba525 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:27.986476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cc90e3c2-6c80-4b6b-9732-12186d2ba525 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086845 Jul 14 10:10:27.987037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1105/2202] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:27 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:28.488162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-107a606a-b954-4146-ba26-93d0626c9434 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:28.488771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-107a606a-b954-4146-ba26-93d0626c9434 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:28.494838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-107a606a-b954-4146-ba26-93d0626c9434 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:28.495287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-107a606a-b954-4146-ba26-93d0626c9434 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:28.496539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-107a606a-b954-4146-ba26-93d0626c9434 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:28.496971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-107a606a-b954-4146-ba26-93d0626c9434 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:28.626304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-107a606a-b954-4146-ba26-93d0626c9434 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:28.634897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-107a606a-b954-4146-ba26-93d0626c9434 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150589 Jul 14 10:10:28.635464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1098/2203] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:28.713610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-83eabbed-90f2-4178-9237-0b282372dbc4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:28.714297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-83eabbed-90f2-4178-9237-0b282372dbc4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:28.720493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83eabbed-90f2-4178-9237-0b282372dbc4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:28.720931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83eabbed-90f2-4178-9237-0b282372dbc4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:28.721810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83eabbed-90f2-4178-9237-0b282372dbc4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:28.722277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83eabbed-90f2-4178-9237-0b282372dbc4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:28.845371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:28.845976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:28.852400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:28.852840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:28.853238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-83eabbed-90f2-4178-9237-0b282372dbc4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:28.853683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:28.854030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:28.862039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-83eabbed-90f2-4178-9237-0b282372dbc4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.152170 Jul 14 10:10:28.862635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1106/2204] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:28 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:28.922513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:28.931044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:28.932546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:28.934342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bfa8b845-c1f2-4b11-8031-406b8267694d tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.092251 Jul 14 10:10:28.934903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1099/2205] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:28 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:29.003226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2631729a-5f66-41e7-9050-31cec257efbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:29.003812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2631729a-5f66-41e7-9050-31cec257efbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:29.010337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2631729a-5f66-41e7-9050-31cec257efbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:29.010788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2631729a-5f66-41e7-9050-31cec257efbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:29.011545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2631729a-5f66-41e7-9050-31cec257efbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:29.011977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2631729a-5f66-41e7-9050-31cec257efbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:29.075796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2631729a-5f66-41e7-9050-31cec257efbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:29.083692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2631729a-5f66-41e7-9050-31cec257efbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084304 Jul 14 10:10:29.084252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1107/2206] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:28 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:29.652485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-943cf989-bbf4-4844-932e-96bcc3075019 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:29.653094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-943cf989-bbf4-4844-932e-96bcc3075019 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:29.659961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-943cf989-bbf4-4844-932e-96bcc3075019 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:29.660406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-943cf989-bbf4-4844-932e-96bcc3075019 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:29.661186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-943cf989-bbf4-4844-932e-96bcc3075019 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:29.661613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-943cf989-bbf4-4844-932e-96bcc3075019 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:29.796400 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-943cf989-bbf4-4844-932e-96bcc3075019 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:29.804364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-943cf989-bbf4-4844-932e-96bcc3075019 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155752 Jul 14 10:10:29.804925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1100/2207] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:29.879940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-aec609ec-5291-4a26-bc5c-4e0c4a0bb518 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:29.880472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-aec609ec-5291-4a26-bc5c-4e0c4a0bb518 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:29.886553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aec609ec-5291-4a26-bc5c-4e0c4a0bb518 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:29.887641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aec609ec-5291-4a26-bc5c-4e0c4a0bb518 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:29.888388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aec609ec-5291-4a26-bc5c-4e0c4a0bb518 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:29.888815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aec609ec-5291-4a26-bc5c-4e0c4a0bb518 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:29.952966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:29.953825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:29.960363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:29.960803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:29.961597 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:29.962061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:30.038053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:30.046766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:30.048271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:30.049409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9beedf03-1ef0-44e3-aff8-aac05357c2a3 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.101023 Jul 14 10:10:30.049973 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1101/2208] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:29 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:30.052407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aec609ec-5291-4a26-bc5c-4e0c4a0bb518 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:30.054808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:30.065689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-aec609ec-5291-4a26-bc5c-4e0c4a0bb518 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.189614 Jul 14 10:10:30.066310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1108/2209] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:29 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:30.101011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ed509149-5350-4218-80e8-9a26d36df139 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:30.101616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ed509149-5350-4218-80e8-9a26d36df139 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:30.107732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed509149-5350-4218-80e8-9a26d36df139 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:30.108180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed509149-5350-4218-80e8-9a26d36df139 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:30.108930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed509149-5350-4218-80e8-9a26d36df139 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:30.109363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed509149-5350-4218-80e8-9a26d36df139 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:30.173596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ed509149-5350-4218-80e8-9a26d36df139 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:30.181774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ed509149-5350-4218-80e8-9a26d36df139 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084735 Jul 14 10:10:30.182369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1102/2210] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:30 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:30.822318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-69578b8a-8ac4-40f2-8b73-1db7bc6a7f44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:30.822839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-69578b8a-8ac4-40f2-8b73-1db7bc6a7f44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:30.828772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69578b8a-8ac4-40f2-8b73-1db7bc6a7f44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:30.829208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69578b8a-8ac4-40f2-8b73-1db7bc6a7f44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:30.829953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69578b8a-8ac4-40f2-8b73-1db7bc6a7f44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:30.830408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69578b8a-8ac4-40f2-8b73-1db7bc6a7f44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:30.957182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-69578b8a-8ac4-40f2-8b73-1db7bc6a7f44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:30.966935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-69578b8a-8ac4-40f2-8b73-1db7bc6a7f44 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148800 Jul 14 10:10:30.967503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1109/2211] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:30 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:31.067862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:31.068467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:31.075568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:31.075946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:31.076700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:31.077128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:31.084849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0d41bb1a-9908-4931-8d8c-7a3d9295b10b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:31.085455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0d41bb1a-9908-4931-8d8c-7a3d9295b10b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:31.092563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d41bb1a-9908-4931-8d8c-7a3d9295b10b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:31.093004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d41bb1a-9908-4931-8d8c-7a3d9295b10b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:31.093768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d41bb1a-9908-4931-8d8c-7a3d9295b10b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:31.094138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:31.094371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d41bb1a-9908-4931-8d8c-7a3d9295b10b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:31.156475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:31.163328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:31.164864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:31.165987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e84427b1-7723-4ec2-812f-6bf4931d81e6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.102102 Jul 14 10:10:31.166577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1103/2212] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:31 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:31.198779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-be7b6889-e90b-4c4c-bc59-934df034a341 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:31.199916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-be7b6889-e90b-4c4c-bc59-934df034a341 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:31.206103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be7b6889-e90b-4c4c-bc59-934df034a341 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:31.206586 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be7b6889-e90b-4c4c-bc59-934df034a341 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:31.207352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be7b6889-e90b-4c4c-bc59-934df034a341 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:31.207786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-be7b6889-e90b-4c4c-bc59-934df034a341 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:31.243066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0d41bb1a-9908-4931-8d8c-7a3d9295b10b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:31.251195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0d41bb1a-9908-4931-8d8c-7a3d9295b10b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.170123 Jul 14 10:10:31.251773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1110/2213] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:31 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:31.271148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-be7b6889-e90b-4c4c-bc59-934df034a341 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:31.280908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-be7b6889-e90b-4c4c-bc59-934df034a341 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085962 Jul 14 10:10:31.281465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1104/2214] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:31 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:31.984880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e3a64948-257f-4691-9083-6a672fc87f7a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:31.985489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e3a64948-257f-4691-9083-6a672fc87f7a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:31.991801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3a64948-257f-4691-9083-6a672fc87f7a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:31.992246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3a64948-257f-4691-9083-6a672fc87f7a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:31.993002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3a64948-257f-4691-9083-6a672fc87f7a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:31.993435 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3a64948-257f-4691-9083-6a672fc87f7a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:32.127376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3a64948-257f-4691-9083-6a672fc87f7a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:32.135473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e3a64948-257f-4691-9083-6a672fc87f7a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155198 Jul 14 10:10:32.136024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1111/2215] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:32.187488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:32.188472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:32.195262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:32.195735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:32.196513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:32.196947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:32.258661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:32.267169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:32.268036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1b7ba70c-93e7-402b-bd20-32bfe34afb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:32.268634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1b7ba70c-93e7-402b-bd20-32bfe34afb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:32.268739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:32.269775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-87e3c8dd-4f9b-4d91-bf19-738ab39a4d88 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.088471 Jul 14 10:10:32.270350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1105/2216] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:32 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:32.275022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b7ba70c-93e7-402b-bd20-32bfe34afb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:32.275551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b7ba70c-93e7-402b-bd20-32bfe34afb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:32.276439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b7ba70c-93e7-402b-bd20-32bfe34afb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:32.276946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b7ba70c-93e7-402b-bd20-32bfe34afb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:32.299787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fff4afd5-f815-4653-8efd-87004ecd2fb2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:32.300397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fff4afd5-f815-4653-8efd-87004ecd2fb2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:32.306462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fff4afd5-f815-4653-8efd-87004ecd2fb2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:32.306902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fff4afd5-f815-4653-8efd-87004ecd2fb2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:32.307654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fff4afd5-f815-4653-8efd-87004ecd2fb2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:32.308087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fff4afd5-f815-4653-8efd-87004ecd2fb2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:32.380023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fff4afd5-f815-4653-8efd-87004ecd2fb2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:32.387979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fff4afd5-f815-4653-8efd-87004ecd2fb2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.093004 Jul 14 10:10:32.388550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1106/2217] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:32 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:32.442132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b7ba70c-93e7-402b-bd20-32bfe34afb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:32.452332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1b7ba70c-93e7-402b-bd20-32bfe34afb91 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.187956 Jul 14 10:10:32.452956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1112/2218] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:32 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:33.152141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b7f20ee4-b632-48a7-9226-297061aba581 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:33.152758 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b7f20ee4-b632-48a7-9226-297061aba581 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:33.158911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7f20ee4-b632-48a7-9226-297061aba581 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:33.159368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7f20ee4-b632-48a7-9226-297061aba581 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:33.160130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7f20ee4-b632-48a7-9226-297061aba581 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:33.160572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b7f20ee4-b632-48a7-9226-297061aba581 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:33.289340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:33.289951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:33.290448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b7f20ee4-b632-48a7-9226-297061aba581 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:33.297363 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:33.297813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:33.298606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:33.299042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:33.299189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b7f20ee4-b632-48a7-9226-297061aba581 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150906 Jul 14 10:10:33.299653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1107/2219] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:33.364374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:33.373474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:33.375002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:33.376128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c562ac6f-6e0b-454f-9b17-88ea7fffcf6e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091063 Jul 14 10:10:33.376682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1113/2220] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:33 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:33.405551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4c568e8d-5fe7-43da-a541-a069bd3abe07 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:33.406636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4c568e8d-5fe7-43da-a541-a069bd3abe07 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:33.413804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c568e8d-5fe7-43da-a541-a069bd3abe07 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:33.414290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c568e8d-5fe7-43da-a541-a069bd3abe07 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:33.415058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c568e8d-5fe7-43da-a541-a069bd3abe07 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:33.415493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c568e8d-5fe7-43da-a541-a069bd3abe07 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:33.470601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e71ab63a-7dc7-40cc-beca-1b7dacd63e0e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:33.471205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e71ab63a-7dc7-40cc-beca-1b7dacd63e0e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:33.477424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e71ab63a-7dc7-40cc-beca-1b7dacd63e0e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:33.477899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e71ab63a-7dc7-40cc-beca-1b7dacd63e0e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:33.478679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e71ab63a-7dc7-40cc-beca-1b7dacd63e0e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:33.479109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e71ab63a-7dc7-40cc-beca-1b7dacd63e0e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:33.482311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4c568e8d-5fe7-43da-a541-a069bd3abe07 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:33.490378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4c568e8d-5fe7-43da-a541-a069bd3abe07 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089377 Jul 14 10:10:33.490956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1108/2221] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:33 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:33.621619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e71ab63a-7dc7-40cc-beca-1b7dacd63e0e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:33.629536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e71ab63a-7dc7-40cc-beca-1b7dacd63e0e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162859 Jul 14 10:10:33.630095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1114/2222] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:33 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:34.315792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-97d20d1d-280a-4bbb-b17b-760f282fbc42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:34.316340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-97d20d1d-280a-4bbb-b17b-760f282fbc42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:34.322899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97d20d1d-280a-4bbb-b17b-760f282fbc42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:34.323347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97d20d1d-280a-4bbb-b17b-760f282fbc42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:34.324099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97d20d1d-280a-4bbb-b17b-760f282fbc42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:34.325198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97d20d1d-280a-4bbb-b17b-760f282fbc42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:34.394011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:34.394647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:34.401175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:34.401759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:34.402566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:34.403003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:34.491958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:34.495655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-97d20d1d-280a-4bbb-b17b-760f282fbc42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:34.500978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:34.502555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:34.503741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-51e627cd-63b9-4aca-a17c-464a9a198a4e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.113672 Jul 14 10:10:34.504300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1115/2223] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:34 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:10:34.504489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-97d20d1d-280a-4bbb-b17b-760f282fbc42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.192604 Jul 14 10:10:34.512627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1109/2224] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:34.512782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-161d237f-9ad7-4498-b56c-ace8f25bd86e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:34.512782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-161d237f-9ad7-4498-b56c-ace8f25bd86e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:34.516101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-161d237f-9ad7-4498-b56c-ace8f25bd86e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:34.516547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-161d237f-9ad7-4498-b56c-ace8f25bd86e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:34.517308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-161d237f-9ad7-4498-b56c-ace8f25bd86e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:34.517741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-161d237f-9ad7-4498-b56c-ace8f25bd86e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:34.580924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-161d237f-9ad7-4498-b56c-ace8f25bd86e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:34.588924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-161d237f-9ad7-4498-b56c-ace8f25bd86e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083666 Jul 14 10:10:34.589491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1116/2225] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:34 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:34.645670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c67269d-5a06-4215-a5d6-a8e80a2f6887 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:34.646306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c67269d-5a06-4215-a5d6-a8e80a2f6887 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:34.652288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c67269d-5a06-4215-a5d6-a8e80a2f6887 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:34.652739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c67269d-5a06-4215-a5d6-a8e80a2f6887 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:34.653491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c67269d-5a06-4215-a5d6-a8e80a2f6887 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:34.653926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c67269d-5a06-4215-a5d6-a8e80a2f6887 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:34.781343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1c67269d-5a06-4215-a5d6-a8e80a2f6887 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:34.789229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c67269d-5a06-4215-a5d6-a8e80a2f6887 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147433 Jul 14 10:10:34.789792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1110/2226] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:34 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:35.522274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-39e633d5-d9ff-47cf-9b2e-30b74e54c024 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:35.522959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:35.522959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:35.523409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-39e633d5-d9ff-47cf-9b2e-30b74e54c024 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:35.529826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39e633d5-d9ff-47cf-9b2e-30b74e54c024 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:35.530035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:35.530307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39e633d5-d9ff-47cf-9b2e-30b74e54c024 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:35.530433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:35.531060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:35.531172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39e633d5-d9ff-47cf-9b2e-30b74e54c024 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:35.531503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:35.531628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39e633d5-d9ff-47cf-9b2e-30b74e54c024 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:35.604760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:35.614404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:35.616083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:35.617229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e3c6c394-83f9-48ab-bf99-6125312b9855 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.098844 Jul 14 10:10:35.617787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1117/2227] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:35 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:35.622383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fa1bd7e6-1a8b-4d7f-9998-2a71ecc953ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:35.622988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fa1bd7e6-1a8b-4d7f-9998-2a71ecc953ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:35.629024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa1bd7e6-1a8b-4d7f-9998-2a71ecc953ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:35.629463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa1bd7e6-1a8b-4d7f-9998-2a71ecc953ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:35.630233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa1bd7e6-1a8b-4d7f-9998-2a71ecc953ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:35.630656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa1bd7e6-1a8b-4d7f-9998-2a71ecc953ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:35.697984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fa1bd7e6-1a8b-4d7f-9998-2a71ecc953ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:35.706313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fa1bd7e6-1a8b-4d7f-9998-2a71ecc953ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087452 Jul 14 10:10:35.706892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1118/2228] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:35 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:35.720022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-39e633d5-d9ff-47cf-9b2e-30b74e54c024 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:35.727978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-39e633d5-d9ff-47cf-9b2e-30b74e54c024 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.209527 Jul 14 10:10:35.728539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1111/2229] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:35 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:35.807115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ad34cf04-a099-46b4-aed2-299e50e2d9dd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:35.807639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ad34cf04-a099-46b4-aed2-299e50e2d9dd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:35.813720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad34cf04-a099-46b4-aed2-299e50e2d9dd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:35.814182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad34cf04-a099-46b4-aed2-299e50e2d9dd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:35.814954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad34cf04-a099-46b4-aed2-299e50e2d9dd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:35.815375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad34cf04-a099-46b4-aed2-299e50e2d9dd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:35.951032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ad34cf04-a099-46b4-aed2-299e50e2d9dd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:35.959051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ad34cf04-a099-46b4-aed2-299e50e2d9dd tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155783 Jul 14 10:10:35.959726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1119/2230] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:35 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:36.637228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:36.637838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:36.644433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:36.644884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:36.645640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:36.646074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:36.707490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:36.717377 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:36.719011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:36.720181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8e7bbfaa-1b5b-45f3-bafa-0504efa2b747 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086896 Jul 14 10:10:36.720893 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1112/2231] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:36 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:36.723543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ad20794d-b620-4a65-8110-8f59e0791899 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:36.724156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ad20794d-b620-4a65-8110-8f59e0791899 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:36.731278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad20794d-b620-4a65-8110-8f59e0791899 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:36.731725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad20794d-b620-4a65-8110-8f59e0791899 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:36.732496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad20794d-b620-4a65-8110-8f59e0791899 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:36.732933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad20794d-b620-4a65-8110-8f59e0791899 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:36.744571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-badbece3-2c05-4452-aac0-7dc01ca38ae4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:36.745185 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-badbece3-2c05-4452-aac0-7dc01ca38ae4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:36.752085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-badbece3-2c05-4452-aac0-7dc01ca38ae4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:36.752540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-badbece3-2c05-4452-aac0-7dc01ca38ae4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:36.753294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-badbece3-2c05-4452-aac0-7dc01ca38ae4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:36.753732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-badbece3-2c05-4452-aac0-7dc01ca38ae4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:36.796414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ad20794d-b620-4a65-8110-8f59e0791899 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:36.804383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ad20794d-b620-4a65-8110-8f59e0791899 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084637 Jul 14 10:10:36.804952 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1120/2232] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:36 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:36.888513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-badbece3-2c05-4452-aac0-7dc01ca38ae4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:36.896697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-badbece3-2c05-4452-aac0-7dc01ca38ae4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155812 Jul 14 10:10:36.897268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1113/2233] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:36.976125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e237623c-9099-4a22-9590-b6ca2ed3432b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:36.976723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e237623c-9099-4a22-9590-b6ca2ed3432b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:36.983382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e237623c-9099-4a22-9590-b6ca2ed3432b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:36.983818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e237623c-9099-4a22-9590-b6ca2ed3432b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:36.984605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e237623c-9099-4a22-9590-b6ca2ed3432b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:36.985060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e237623c-9099-4a22-9590-b6ca2ed3432b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:37.120092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e237623c-9099-4a22-9590-b6ca2ed3432b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:37.128724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e237623c-9099-4a22-9590-b6ca2ed3432b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.156408 Jul 14 10:10:37.129290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1121/2234] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:36 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:37.738874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:37.739488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:37.746265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:37.746725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:37.747487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:37.747946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:37.810811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:37.819543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:37.821042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:37.821828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0d0ac8e3-90a9-4cba-9ac2-59eee802a3ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:37.822319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ba00d540-e452-467a-8b02-3b6b33ac7d1c tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087259 Jul 14 10:10:37.822494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0d0ac8e3-90a9-4cba-9ac2-59eee802a3ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:37.822750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1114/2235] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:37 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:37.829544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8e3-90a9-4cba-9ac2-59eee802a3ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:37.829992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8e3-90a9-4cba-9ac2-59eee802a3ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:37.830788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8e3-90a9-4cba-9ac2-59eee802a3ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:37.831224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8e3-90a9-4cba-9ac2-59eee802a3ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:37.894129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0d0ac8e3-90a9-4cba-9ac2-59eee802a3ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:37.902120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0d0ac8e3-90a9-4cba-9ac2-59eee802a3ad tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084049 Jul 14 10:10:37.903259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1122/2236] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:37 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:37.912829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-07bd5801-37be-41d8-8f9a-e444d6b8d45f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:37.913464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-07bd5801-37be-41d8-8f9a-e444d6b8d45f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:37.919594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07bd5801-37be-41d8-8f9a-e444d6b8d45f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:37.920036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07bd5801-37be-41d8-8f9a-e444d6b8d45f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:37.921050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07bd5801-37be-41d8-8f9a-e444d6b8d45f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:37.921477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07bd5801-37be-41d8-8f9a-e444d6b8d45f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:38.051232 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-07bd5801-37be-41d8-8f9a-e444d6b8d45f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:38.059170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-07bd5801-37be-41d8-8f9a-e444d6b8d45f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150127 Jul 14 10:10:38.059767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1115/2237] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:38.150668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ba4c4866-92ce-4904-87e3-dfe841eb85e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:38.151467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ba4c4866-92ce-4904-87e3-dfe841eb85e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:38.157507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba4c4866-92ce-4904-87e3-dfe841eb85e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:38.158039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba4c4866-92ce-4904-87e3-dfe841eb85e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:38.158818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba4c4866-92ce-4904-87e3-dfe841eb85e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:38.159238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba4c4866-92ce-4904-87e3-dfe841eb85e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:38.297323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ba4c4866-92ce-4904-87e3-dfe841eb85e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:38.305534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ba4c4866-92ce-4904-87e3-dfe841eb85e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162362 Jul 14 10:10:38.306090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1123/2238] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:38 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:38.842590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:38.843183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:38.851563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:38.852013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:38.852778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:38.853506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:38.916601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:38.918689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7dcc282d-7d57-4aa7-a499-9652177aeee3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:38.920016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7dcc282d-7d57-4aa7-a499-9652177aeee3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:38.926231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:38.927128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dcc282d-7d57-4aa7-a499-9652177aeee3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:38.927569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dcc282d-7d57-4aa7-a499-9652177aeee3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:38.927732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:38.928353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dcc282d-7d57-4aa7-a499-9652177aeee3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:38.928785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dcc282d-7d57-4aa7-a499-9652177aeee3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:38.928918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-612286cf-dcfa-4fe0-be97-0c5fea37d6e5 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.091802 Jul 14 10:10:38.929403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1116/2239] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:38 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:38.993968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7dcc282d-7d57-4aa7-a499-9652177aeee3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:39.002015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7dcc282d-7d57-4aa7-a499-9652177aeee3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087142 Jul 14 10:10:39.002611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1124/2240] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:38 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:39.076129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-75998a70-7df9-4e34-9277-44122ecf14e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:39.076742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-75998a70-7df9-4e34-9277-44122ecf14e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:39.082802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75998a70-7df9-4e34-9277-44122ecf14e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:39.083248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75998a70-7df9-4e34-9277-44122ecf14e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:39.084002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75998a70-7df9-4e34-9277-44122ecf14e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:39.084442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75998a70-7df9-4e34-9277-44122ecf14e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:39.227704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-75998a70-7df9-4e34-9277-44122ecf14e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:39.235786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-75998a70-7df9-4e34-9277-44122ecf14e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.163517 Jul 14 10:10:39.236355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1117/2241] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:39.323078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c70d88c2-390c-46e2-8eb7-a617173414a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:39.323713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c70d88c2-390c-46e2-8eb7-a617173414a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:39.326105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:39.331782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c70d88c2-390c-46e2-8eb7-a617173414a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:39.332226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c70d88c2-390c-46e2-8eb7-a617173414a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:39.332981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c70d88c2-390c-46e2-8eb7-a617173414a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:39.333412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c70d88c2-390c-46e2-8eb7-a617173414a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:39.348646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:39.464422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c70d88c2-390c-46e2-8eb7-a617173414a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:39.473122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c70d88c2-390c-46e2-8eb7-a617173414a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153930 Jul 14 10:10:39.473691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1125/2242] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:39 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:39.947538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:39.948223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:39.955335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:39.955784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:39.956537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:39.956975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:40.018028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:40.019761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8b3e7297-b0b8-47fd-818e-10887e2e62e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:40.020374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8b3e7297-b0b8-47fd-818e-10887e2e62e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:40.026480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:40.026933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b3e7297-b0b8-47fd-818e-10887e2e62e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:40.027398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b3e7297-b0b8-47fd-818e-10887e2e62e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:40.027998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:40.028157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b3e7297-b0b8-47fd-818e-10887e2e62e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:40.029276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b3e7297-b0b8-47fd-818e-10887e2e62e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:40.029749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9f5049f4-0c12-4018-9132-84b576db1b08 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086361 Jul 14 10:10:40.030321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1118/2243] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:39 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:40.094967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8b3e7297-b0b8-47fd-818e-10887e2e62e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:40.102875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8b3e7297-b0b8-47fd-818e-10887e2e62e4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086977 Jul 14 10:10:40.103437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1126/2244] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:40 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:40.253096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ea63348f-726f-4a03-9546-1bc83d9840a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:40.255320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ea63348f-726f-4a03-9546-1bc83d9840a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:40.261276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea63348f-726f-4a03-9546-1bc83d9840a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:40.261720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea63348f-726f-4a03-9546-1bc83d9840a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:40.262573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea63348f-726f-4a03-9546-1bc83d9840a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:40.263661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea63348f-726f-4a03-9546-1bc83d9840a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:40.389590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ea63348f-726f-4a03-9546-1bc83d9840a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:40.397649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ea63348f-726f-4a03-9546-1bc83d9840a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148578 Jul 14 10:10:40.398238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1119/2245] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:40.489693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-44478d44-41c3-4297-a1d7-1b6d3c03a678 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:40.490336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-44478d44-41c3-4297-a1d7-1b6d3c03a678 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:40.496400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44478d44-41c3-4297-a1d7-1b6d3c03a678 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:40.496841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44478d44-41c3-4297-a1d7-1b6d3c03a678 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:40.498101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44478d44-41c3-4297-a1d7-1b6d3c03a678 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:40.498554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44478d44-41c3-4297-a1d7-1b6d3c03a678 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:40.629533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-44478d44-41c3-4297-a1d7-1b6d3c03a678 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:40.637414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-44478d44-41c3-4297-a1d7-1b6d3c03a678 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151618 Jul 14 10:10:40.638641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1127/2246] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:40 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:41.048405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:41.049010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:41.055583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:41.056042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:41.056811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:41.057247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:41.060835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:41.124311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:41.124699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-78f93fec-4e68-4b96-a401-df3b42224892 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:41.125336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-78f93fec-4e68-4b96-a401-df3b42224892 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:41.132711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78f93fec-4e68-4b96-a401-df3b42224892 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:41.133608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78f93fec-4e68-4b96-a401-df3b42224892 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:41.134175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78f93fec-4e68-4b96-a401-df3b42224892 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:41.134625 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78f93fec-4e68-4b96-a401-df3b42224892 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:41.139239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:41.142373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:41.143957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7217ecdc-94e4-49b7-9afa-92c4106765c8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.099761 Jul 14 10:10:41.144635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1120/2247] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:41 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:41.215024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-78f93fec-4e68-4b96-a401-df3b42224892 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:41.223076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-78f93fec-4e68-4b96-a401-df3b42224892 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.107099 Jul 14 10:10:41.223645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1128/2248] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:41.415511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-08e4aaac-f8e0-4b7c-812c-5f3dad66a42e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:41.416041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-08e4aaac-f8e0-4b7c-812c-5f3dad66a42e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:41.423205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08e4aaac-f8e0-4b7c-812c-5f3dad66a42e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:41.423653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08e4aaac-f8e0-4b7c-812c-5f3dad66a42e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:41.424537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08e4aaac-f8e0-4b7c-812c-5f3dad66a42e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:41.425001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08e4aaac-f8e0-4b7c-812c-5f3dad66a42e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:41.564406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-08e4aaac-f8e0-4b7c-812c-5f3dad66a42e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:41.572422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-08e4aaac-f8e0-4b7c-812c-5f3dad66a42e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.160853 Jul 14 10:10:41.573020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1121/2249] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:41.656046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3561ea48-e16d-4d6a-8a4f-954963b09a0f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:41.656640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3561ea48-e16d-4d6a-8a4f-954963b09a0f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:41.662787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3561ea48-e16d-4d6a-8a4f-954963b09a0f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:41.663226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3561ea48-e16d-4d6a-8a4f-954963b09a0f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:41.663979 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3561ea48-e16d-4d6a-8a4f-954963b09a0f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:41.664401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3561ea48-e16d-4d6a-8a4f-954963b09a0f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:41.795152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3561ea48-e16d-4d6a-8a4f-954963b09a0f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:41.803537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3561ea48-e16d-4d6a-8a4f-954963b09a0f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151382 Jul 14 10:10:41.804112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1129/2250] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:41 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:42.163263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:42.163901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:42.165848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:42.173668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:42.174113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:42.174911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:42.175362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:42.241484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-52be4308-86c1-48f1-bc68-dfa8b188f37e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:42.242356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:42.242484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-52be4308-86c1-48f1-bc68-dfa8b188f37e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:42.249845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52be4308-86c1-48f1-bc68-dfa8b188f37e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:42.250437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52be4308-86c1-48f1-bc68-dfa8b188f37e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:42.251095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:42.251241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52be4308-86c1-48f1-bc68-dfa8b188f37e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:42.251671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-52be4308-86c1-48f1-bc68-dfa8b188f37e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:42.252699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:42.253880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b109e955-fc27-4992-9780-77146d4155c9 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.095489 Jul 14 10:10:42.254481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1122/2251] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:42 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:42.322700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-52be4308-86c1-48f1-bc68-dfa8b188f37e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:42.331288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-52be4308-86c1-48f1-bc68-dfa8b188f37e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.094475 Jul 14 10:10:42.331853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1130/2252] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:42 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:42.589431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d66e12a9-90c1-4c8d-abdf-6b5b055dd075 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:42.589964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d66e12a9-90c1-4c8d-abdf-6b5b055dd075 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:42.596601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d66e12a9-90c1-4c8d-abdf-6b5b055dd075 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:42.597046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d66e12a9-90c1-4c8d-abdf-6b5b055dd075 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:42.597812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d66e12a9-90c1-4c8d-abdf-6b5b055dd075 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:42.598271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d66e12a9-90c1-4c8d-abdf-6b5b055dd075 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:42.736879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d66e12a9-90c1-4c8d-abdf-6b5b055dd075 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:42.745391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d66e12a9-90c1-4c8d-abdf-6b5b055dd075 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.159817 Jul 14 10:10:42.745977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1123/2253] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:42 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:42.821218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-690174ff-d1f4-4f38-b434-0a18ae2a9da3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:42.821858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-690174ff-d1f4-4f38-b434-0a18ae2a9da3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:42.830280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-690174ff-d1f4-4f38-b434-0a18ae2a9da3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:42.830730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-690174ff-d1f4-4f38-b434-0a18ae2a9da3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:42.831503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-690174ff-d1f4-4f38-b434-0a18ae2a9da3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:42.831938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-690174ff-d1f4-4f38-b434-0a18ae2a9da3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:42.967364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-690174ff-d1f4-4f38-b434-0a18ae2a9da3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:42.976310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-690174ff-d1f4-4f38-b434-0a18ae2a9da3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.158892 Jul 14 10:10:42.976883 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1131/2254] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:42 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:43.273889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:43.274649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:43.281725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:43.282179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:43.282972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:43.283411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:43.349794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a7a03d2b-61de-41dc-a3ab-fa60d94c3566 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:43.350443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a7a03d2b-61de-41dc-a3ab-fa60d94c3566 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:43.357819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:43.358005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7a03d2b-61de-41dc-a3ab-fa60d94c3566 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:43.358316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7a03d2b-61de-41dc-a3ab-fa60d94c3566 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:43.359084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7a03d2b-61de-41dc-a3ab-fa60d94c3566 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:43.359511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a7a03d2b-61de-41dc-a3ab-fa60d94c3566 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:43.369180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:43.371078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:43.372421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-83f618bb-2bbb-48d1-83b2-c9fe7d7b133e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.103343 Jul 14 10:10:43.373077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1124/2255] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:43 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:43.423513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a7a03d2b-61de-41dc-a3ab-fa60d94c3566 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:43.431467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a7a03d2b-61de-41dc-a3ab-fa60d94c3566 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086967 Jul 14 10:10:43.432024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1132/2256] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:43.766616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fd2d0656-8867-4caa-b060-6d61692d3cf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:43.767221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fd2d0656-8867-4caa-b060-6d61692d3cf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:43.773781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd2d0656-8867-4caa-b060-6d61692d3cf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:43.774260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd2d0656-8867-4caa-b060-6d61692d3cf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:43.775032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd2d0656-8867-4caa-b060-6d61692d3cf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:43.775467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd2d0656-8867-4caa-b060-6d61692d3cf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:43.908621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fd2d0656-8867-4caa-b060-6d61692d3cf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:43.916477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fd2d0656-8867-4caa-b060-6d61692d3cf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.154270 Jul 14 10:10:43.917032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1125/2257] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:43.993834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3965811c-4148-4c8d-bc96-ca51ce7c6f77 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:43.994453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3965811c-4148-4c8d-bc96-ca51ce7c6f77 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:44.000983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3965811c-4148-4c8d-bc96-ca51ce7c6f77 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:44.001415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3965811c-4148-4c8d-bc96-ca51ce7c6f77 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:44.002155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3965811c-4148-4c8d-bc96-ca51ce7c6f77 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:44.002602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3965811c-4148-4c8d-bc96-ca51ce7c6f77 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:44.136666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3965811c-4148-4c8d-bc96-ca51ce7c6f77 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:44.144699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3965811c-4148-4c8d-bc96-ca51ce7c6f77 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154689 Jul 14 10:10:44.145250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1133/2258] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:43 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:44.391224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:44.391780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:44.398120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:44.398607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:44.399371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:44.399819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:44.454181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a5dde051-9dc4-41c7-a112-33a7d78b752e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:44.454818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a5dde051-9dc4-41c7-a112-33a7d78b752e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:44.461666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:44.461821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5dde051-9dc4-41c7-a112-33a7d78b752e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:44.462288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5dde051-9dc4-41c7-a112-33a7d78b752e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:44.463111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5dde051-9dc4-41c7-a112-33a7d78b752e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:44.463604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a5dde051-9dc4-41c7-a112-33a7d78b752e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:44.470730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:44.472237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:44.473365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d12d8194-f3c9-4fb3-bb0a-dc3c9c8537fd tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.086191 Jul 14 10:10:44.473924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1126/2259] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:44 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:44.531041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a5dde051-9dc4-41c7-a112-33a7d78b752e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:44.540268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a5dde051-9dc4-41c7-a112-33a7d78b752e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090425 Jul 14 10:10:44.540844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1134/2260] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:44 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:44.942432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a0604a25-854b-4ef5-8ef4-8b20ee5f6316 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:44.943262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a0604a25-854b-4ef5-8ef4-8b20ee5f6316 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:44.949591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0604a25-854b-4ef5-8ef4-8b20ee5f6316 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:44.950238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0604a25-854b-4ef5-8ef4-8b20ee5f6316 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:44.951427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0604a25-854b-4ef5-8ef4-8b20ee5f6316 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:44.951855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a0604a25-854b-4ef5-8ef4-8b20ee5f6316 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:45.089370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a0604a25-854b-4ef5-8ef4-8b20ee5f6316 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:45.097812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a0604a25-854b-4ef5-8ef4-8b20ee5f6316 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.167039 Jul 14 10:10:45.098414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1127/2261] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:45.163994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b5242c58-3d40-406c-96ba-8363f97e22a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:45.164622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b5242c58-3d40-406c-96ba-8363f97e22a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:45.170964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5242c58-3d40-406c-96ba-8363f97e22a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:45.171408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5242c58-3d40-406c-96ba-8363f97e22a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:45.172166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5242c58-3d40-406c-96ba-8363f97e22a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:45.172626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5242c58-3d40-406c-96ba-8363f97e22a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:45.302542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b5242c58-3d40-406c-96ba-8363f97e22a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:45.310994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b5242c58-3d40-406c-96ba-8363f97e22a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.152071 Jul 14 10:10:45.311549 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1135/2262] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:45 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:45.491833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:45.492444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:45.499236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:45.499688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:45.500445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:45.500881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:45.556940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f82b660b-04f7-4ae4-9599-7a41d2b5f014 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:45.557470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f82b660b-04f7-4ae4-9599-7a41d2b5f014 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:45.564005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:45.564849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f82b660b-04f7-4ae4-9599-7a41d2b5f014 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:45.565294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f82b660b-04f7-4ae4-9599-7a41d2b5f014 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:45.566055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f82b660b-04f7-4ae4-9599-7a41d2b5f014 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:45.566508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f82b660b-04f7-4ae4-9599-7a41d2b5f014 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:45.572576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:45.574079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:45.575268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da396c80-f1e2-4846-9be8-3e88563f2a44 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 200 len: 1443 microversion: 2.20 time: 0.087519 Jul 14 10:10:45.576039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1128/2263] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:45 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:45.594791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ece67d1b-9d61-40df-a7e9-f975ee1c7576 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '.version_select at 0x7f7da1da1040>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:45.622522 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ece67d1b-9d61-40df-a7e9-f975ee1c7576 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455870700" status: 204 len: 0 microversion: 2.20 time: 0.031940 Jul 14 10:10:45.623110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1129/2264] 10.222.0.40 () {60 vars in 1258 bytes} [Thu Jul 14 10:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455870700 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 10:10:45.632111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f82b660b-04f7-4ae4-9599-7a41d2b5f014 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:45.640319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f82b660b-04f7-4ae4-9599-7a41d2b5f014 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087286 Jul 14 10:10:45.640897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1136/2265] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:45 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:46.115905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-99bf4a6d-210e-4993-86ad-655c71a5b830 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:46.116308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-99bf4a6d-210e-4993-86ad-655c71a5b830 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:46.124173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-99bf4a6d-210e-4993-86ad-655c71a5b830 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:46.124611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-99bf4a6d-210e-4993-86ad-655c71a5b830 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:46.125373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-99bf4a6d-210e-4993-86ad-655c71a5b830 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:46.125799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-99bf4a6d-210e-4993-86ad-655c71a5b830 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:46.310675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-99bf4a6d-210e-4993-86ad-655c71a5b830 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:46.318858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-99bf4a6d-210e-4993-86ad-655c71a5b830 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.207603 Jul 14 10:10:46.319440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1130/2266] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:46.328135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-80528efd-236f-4769-937a-474f7d368376 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:46.328948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-80528efd-236f-4769-937a-474f7d368376 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:46.335468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80528efd-236f-4769-937a-474f7d368376 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:46.335914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80528efd-236f-4769-937a-474f7d368376 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:46.336672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80528efd-236f-4769-937a-474f7d368376 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:46.337105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80528efd-236f-4769-937a-474f7d368376 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:46.425282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e0bc2af7-73d4-41ba-a93a-449cfffae928 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Action: 'create', calling method: .version_select at 0x7f7da2751a60>, body: {"keypair": {"name": "tempest-keypair-257520433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIzKTgna5uj9mefSLEn3s4iBJ5LgxZTkdrSHDrLGhmAqhAx+6FrPd5EYYtLTFcsvS/MlKwyoUL0NlEZf+E8gsFN680L8daEviBtGDyartkCtAstQdHMkwzipxFQXtMi+g=="}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:10:46.440357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-e0bc2af7-73d4-41ba-a93a-449cfffae928 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Getting quotas for project e4d87102c8234c7f9ba0c1a6299ba3d7. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:10:46.444413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-e0bc2af7-73d4-41ba-a93a-449cfffae928 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Getting quotas for user f50c3855aa764c2fb86c48c90eb9e15c and project e4d87102c8234c7f9ba0c1a6299ba3d7. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:10:46.466767 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e0bc2af7-73d4-41ba-a93a-449cfffae928 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048887 Jul 14 10:10:46.467372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1131/2267] 10.222.0.40 () {62 vars in 1199 bytes} [Thu Jul 14 10:10:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 10:10:46.478420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-80528efd-236f-4769-937a-474f7d368376 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:46.486959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-80528efd-236f-4769-937a-474f7d368376 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162632 Jul 14 10:10:46.487524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1137/2268] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:46 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:46.657480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a3d07232-de77-4812-94bf-762714aa222d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:46.658087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a3d07232-de77-4812-94bf-762714aa222d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:46.666659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a3d07232-de77-4812-94bf-762714aa222d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:46.667111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a3d07232-de77-4812-94bf-762714aa222d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:46.667877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a3d07232-de77-4812-94bf-762714aa222d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:46.668313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a3d07232-de77-4812-94bf-762714aa222d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:46.735746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a3d07232-de77-4812-94bf-762714aa222d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:46.748756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a3d07232-de77-4812-94bf-762714aa222d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.095673 Jul 14 10:10:46.749329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1132/2269] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:46 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:47.338791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6e8a1f39-869a-4346-bde4-7637ff1f75ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:47.340186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6e8a1f39-869a-4346-bde4-7637ff1f75ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:47.347756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e8a1f39-869a-4346-bde4-7637ff1f75ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:47.348466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e8a1f39-869a-4346-bde4-7637ff1f75ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:47.349287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e8a1f39-869a-4346-bde4-7637ff1f75ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:47.349727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6e8a1f39-869a-4346-bde4-7637ff1f75ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:47.504142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eb95a787-d9d9-4d67-b65c-ac016a41e0d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:47.505271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-eb95a787-d9d9-4d67-b65c-ac016a41e0d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:47.508326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6e8a1f39-869a-4346-bde4-7637ff1f75ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:47.516354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eb95a787-d9d9-4d67-b65c-ac016a41e0d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:47.517088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eb95a787-d9d9-4d67-b65c-ac016a41e0d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:47.517714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6e8a1f39-869a-4346-bde4-7637ff1f75ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.183528 Jul 14 10:10:47.518408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eb95a787-d9d9-4d67-b65c-ac016a41e0d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:47.529605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1138/2270] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:47.529863 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eb95a787-d9d9-4d67-b65c-ac016a41e0d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:47.700082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-eb95a787-d9d9-4d67-b65c-ac016a41e0d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:47.709850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eb95a787-d9d9-4d67-b65c-ac016a41e0d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.209780 Jul 14 10:10:47.710673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1133/2271] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:47 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:47.769916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e9ab4c4b-dd20-4a54-b9b2-b4aee501a1b5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:47.770565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e9ab4c4b-dd20-4a54-b9b2-b4aee501a1b5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:47.777160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9ab4c4b-dd20-4a54-b9b2-b4aee501a1b5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:47.777647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9ab4c4b-dd20-4a54-b9b2-b4aee501a1b5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:47.778497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9ab4c4b-dd20-4a54-b9b2-b4aee501a1b5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:47.779510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e9ab4c4b-dd20-4a54-b9b2-b4aee501a1b5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:47.828964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2093538478", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5490315d-3e4a-465a-9671-ccf13d951e7e"}], "security_groups": [{"name": "tempest-securitygroup--1773710322"}], "key_name": "tempest-keypair-257520433", "user_data": "}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:10:47.853986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e9ab4c4b-dd20-4a54-b9b2-b4aee501a1b5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:47.863371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e9ab4c4b-dd20-4a54-b9b2-b4aee501a1b5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.102065 Jul 14 10:10:47.863953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1139/2272] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:47.936537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] validate_networks() for [('5490315d-3e4a-465a-9671-ccf13d951e7e', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:10:48.434263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:10:48.434691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:10:48.435164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:10:48.435602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:10:48.436025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:10:48.447160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:48.447625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:48.448409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:48.448837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:48.466124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Getting quotas for project e4d87102c8234c7f9ba0c1a6299ba3d7. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:10:48.471679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Getting quotas for user f50c3855aa764c2fb86c48c90eb9e15c and project e4d87102c8234c7f9ba0c1a6299ba3d7. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:10:48.482928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:10:48.485202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:10:48.537140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f0bc2592-c554-46a2-997a-d44cee3dd291 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.712383 Jul 14 10:10:48.537459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-aa4aaf9f-bf53-4c43-b299-7b8d126a6d21 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:48.538098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1134/2273] 10.222.0.40 () {62 vars in 1187 bytes} [Thu Jul 14 10:10:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 14 10:10:48.539216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-aa4aaf9f-bf53-4c43-b299-7b8d126a6d21 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:48.547472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aa4aaf9f-bf53-4c43-b299-7b8d126a6d21 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:48.548236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aa4aaf9f-bf53-4c43-b299-7b8d126a6d21 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:48.549116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c3ff936a-9908-4691-8f05-2163d77aa126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:48.549761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c3ff936a-9908-4691-8f05-2163d77aa126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:48.550070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aa4aaf9f-bf53-4c43-b299-7b8d126a6d21 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:48.550696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aa4aaf9f-bf53-4c43-b299-7b8d126a6d21 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:48.614981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c3ff936a-9908-4691-8f05-2163d77aa126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:48.623718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c3ff936a-9908-4691-8f05-2163d77aa126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:48.625242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c3ff936a-9908-4691-8f05-2163d77aa126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:48.626417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c3ff936a-9908-4691-8f05-2163d77aa126 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1281 microversion: 2.20 time: 0.082474 Jul 14 10:10:48.630267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1135/2274] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:48 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:48.717499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aa4aaf9f-bf53-4c43-b299-7b8d126a6d21 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:48.732374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b1c0b081-aefb-4012-aa1d-bc0d92092850 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:48.733145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b1c0b081-aefb-4012-aa1d-bc0d92092850 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:48.739458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-aa4aaf9f-bf53-4c43-b299-7b8d126a6d21 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.205735 Jul 14 10:10:48.740330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1140/2275] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:48.750781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b1c0b081-aefb-4012-aa1d-bc0d92092850 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:48.751447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b1c0b081-aefb-4012-aa1d-bc0d92092850 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:48.752248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b1c0b081-aefb-4012-aa1d-bc0d92092850 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:48.752684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b1c0b081-aefb-4012-aa1d-bc0d92092850 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:48.880360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dac7ce66-2716-498a-a2a8-cbfc6b662557 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:48.881387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dac7ce66-2716-498a-a2a8-cbfc6b662557 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:48.890167 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dac7ce66-2716-498a-a2a8-cbfc6b662557 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:48.890634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dac7ce66-2716-498a-a2a8-cbfc6b662557 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:48.891387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dac7ce66-2716-498a-a2a8-cbfc6b662557 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:48.892019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dac7ce66-2716-498a-a2a8-cbfc6b662557 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:48.925252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b1c0b081-aefb-4012-aa1d-bc0d92092850 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:48.934329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b1c0b081-aefb-4012-aa1d-bc0d92092850 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.207158 Jul 14 10:10:48.935470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1136/2276] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:48 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:48.967153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dac7ce66-2716-498a-a2a8-cbfc6b662557 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:48.975964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dac7ce66-2716-498a-a2a8-cbfc6b662557 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.099410 Jul 14 10:10:48.976658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1141/2277] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:48 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:49.646796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:49.647396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:49.666320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:49.667077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:49.668107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:49.668551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:49.747468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:49.759540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:49.761948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:49.763732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da47a78b-1e86-4db4-8061-49df16c48374 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1341 microversion: 2.20 time: 0.120785 Jul 14 10:10:49.764704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1137/2278] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:49 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1341 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:49.853313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-60943f05-53bb-4a88-ae48-b822de8f1aa9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:49.853920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-60943f05-53bb-4a88-ae48-b822de8f1aa9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:49.860614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60943f05-53bb-4a88-ae48-b822de8f1aa9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:49.861081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60943f05-53bb-4a88-ae48-b822de8f1aa9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:49.861867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60943f05-53bb-4a88-ae48-b822de8f1aa9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:49.862617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60943f05-53bb-4a88-ae48-b822de8f1aa9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:49.866678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:50.015777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-60943f05-53bb-4a88-ae48-b822de8f1aa9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:50.027666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-658623b9-ffd7-451d-b44e-403be1c2a189 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:50.028303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-658623b9-ffd7-451d-b44e-403be1c2a189 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:50.031898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-60943f05-53bb-4a88-ae48-b822de8f1aa9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.278821 Jul 14 10:10:50.032610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1142/2279] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:50.037767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-06e80a2b-4d56-4036-ae9f-ffd5bd01130b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:50.038667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-06e80a2b-4d56-4036-ae9f-ffd5bd01130b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:50.043176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-658623b9-ffd7-451d-b44e-403be1c2a189 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:50.043628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-658623b9-ffd7-451d-b44e-403be1c2a189 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:50.045205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-658623b9-ffd7-451d-b44e-403be1c2a189 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:50.046426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-658623b9-ffd7-451d-b44e-403be1c2a189 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:50.046565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06e80a2b-4d56-4036-ae9f-ffd5bd01130b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:50.047090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06e80a2b-4d56-4036-ae9f-ffd5bd01130b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:50.047885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06e80a2b-4d56-4036-ae9f-ffd5bd01130b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:50.048301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06e80a2b-4d56-4036-ae9f-ffd5bd01130b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:50.141828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-06e80a2b-4d56-4036-ae9f-ffd5bd01130b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:50.152378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-06e80a2b-4d56-4036-ae9f-ffd5bd01130b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.118314 Jul 14 10:10:50.153948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1143/2280] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:50 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:50.219795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-658623b9-ffd7-451d-b44e-403be1c2a189 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:50.228686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-658623b9-ffd7-451d-b44e-403be1c2a189 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.279493 Jul 14 10:10:50.229280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1138/2281] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:49 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:50.783453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:50.784064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:50.791103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:50.791546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:50.792356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:50.792789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:50.931954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:50.940766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:50.942292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:50.943583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-26af6417-ab23-4ee8-930f-0fc6b9e0370b tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1407 microversion: 2.20 time: 0.165046 Jul 14 10:10:50.944662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1144/2282] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:50 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:51.049921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bf2cfba7-f68c-46db-9409-0f7ab5817dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:51.050555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bf2cfba7-f68c-46db-9409-0f7ab5817dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:51.057241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf2cfba7-f68c-46db-9409-0f7ab5817dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.057680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf2cfba7-f68c-46db-9409-0f7ab5817dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.058458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf2cfba7-f68c-46db-9409-0f7ab5817dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.058889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bf2cfba7-f68c-46db-9409-0f7ab5817dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.170567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-23f7738e-a0d4-43e2-999a-50a986a49900 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:51.172072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-23f7738e-a0d4-43e2-999a-50a986a49900 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:51.178770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23f7738e-a0d4-43e2-999a-50a986a49900 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.179964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23f7738e-a0d4-43e2-999a-50a986a49900 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.180801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23f7738e-a0d4-43e2-999a-50a986a49900 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.181245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-23f7738e-a0d4-43e2-999a-50a986a49900 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.496285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-23f7738e-a0d4-43e2-999a-50a986a49900 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:51.506084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-23f7738e-a0d4-43e2-999a-50a986a49900 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.339610 Jul 14 10:10:51.506717 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1145/2283] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:51 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:51.511565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-554c99e7-ffea-4136-9ad6-2aef1df2adef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:51.512406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-554c99e7-ffea-4136-9ad6-2aef1df2adef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:51.518710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-554c99e7-ffea-4136-9ad6-2aef1df2adef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.519156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-554c99e7-ffea-4136-9ad6-2aef1df2adef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.519922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-554c99e7-ffea-4136-9ad6-2aef1df2adef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.520350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-554c99e7-ffea-4136-9ad6-2aef1df2adef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.521539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bf2cfba7-f68c-46db-9409-0f7ab5817dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:51.541565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bf2cfba7-f68c-46db-9409-0f7ab5817dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.494911 Jul 14 10:10:51.543186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1139/2284] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:51.677218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-823c9b76-4981-4184-a4a4-8250dc55c32c req-bbc75c5e-0e0d-4751-a0f3-7d048f49c009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a1cd68-ca43-4d4c-9bcf-6b1552e945cc", "tag": "a2043256-8dca-4e80-a796-080a18c21591"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:10:51.688838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-823c9b76-4981-4184-a4a4-8250dc55c32c req-bbc75c5e-0e0d-4751-a0f3-7d048f49c009 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.689398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-823c9b76-4981-4184-a4a4-8250dc55c32c req-bbc75c5e-0e0d-4751-a0f3-7d048f49c009 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.709105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-823c9b76-4981-4184-a4a4-8250dc55c32c req-bbc75c5e-0e0d-4751-a0f3-7d048f49c009 service nova] Creating event network-changed:a2043256-8dca-4e80-a796-080a18c21591 for instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc on hv-cinder-82549 Jul 14 10:10:51.716608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-823c9b76-4981-4184-a4a4-8250dc55c32c req-bbc75c5e-0e0d-4751-a0f3-7d048f49c009 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114325 Jul 14 10:10:51.717263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1140/2285] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:10:51.732379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-554c99e7-ffea-4136-9ad6-2aef1df2adef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:51.746631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-554c99e7-ffea-4136-9ad6-2aef1df2adef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.238614 Jul 14 10:10:51.747258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1146/2286] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:51 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:51.963044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:51.963669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:51.970683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.971141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.971920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:51.972359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:51.975257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:52.144836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:52.153416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:52.155511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:52.156640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ebf065b2-1dba-4caa-b2cd-a12b73dd3dec tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1407 microversion: 2.20 time: 0.197993 Jul 14 10:10:52.157240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1141/2287] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:51 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:52.523729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-41381152-611f-4471-b9f6-cf5704b6f550 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:52.524680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-41381152-611f-4471-b9f6-cf5704b6f550 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:52.531441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41381152-611f-4471-b9f6-cf5704b6f550 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:52.531881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41381152-611f-4471-b9f6-cf5704b6f550 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:52.532639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41381152-611f-4471-b9f6-cf5704b6f550 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:52.533110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41381152-611f-4471-b9f6-cf5704b6f550 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:52.561805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-872c730b-6819-4769-afbe-837d19d1a142 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:52.562545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-872c730b-6819-4769-afbe-837d19d1a142 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:52.572628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-872c730b-6819-4769-afbe-837d19d1a142 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:52.573151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-872c730b-6819-4769-afbe-837d19d1a142 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:52.573951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-872c730b-6819-4769-afbe-837d19d1a142 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:52.574419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-872c730b-6819-4769-afbe-837d19d1a142 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:52.598749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-41381152-611f-4471-b9f6-cf5704b6f550 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:52.607983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-41381152-611f-4471-b9f6-cf5704b6f550 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088598 Jul 14 10:10:52.608556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1147/2288] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:52 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:52.725468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-872c730b-6819-4769-afbe-837d19d1a142 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:52.739581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-872c730b-6819-4769-afbe-837d19d1a142 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.182404 Jul 14 10:10:52.740604 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1142/2289] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:52.765743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9d87381f-099f-477c-ab6e-bc16e9de2aac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:52.766501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9d87381f-099f-477c-ab6e-bc16e9de2aac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:52.772874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d87381f-099f-477c-ab6e-bc16e9de2aac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:52.773423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d87381f-099f-477c-ab6e-bc16e9de2aac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:52.774446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d87381f-099f-477c-ab6e-bc16e9de2aac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:52.774833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d87381f-099f-477c-ab6e-bc16e9de2aac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:52.930127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9d87381f-099f-477c-ab6e-bc16e9de2aac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:52.939464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9d87381f-099f-477c-ab6e-bc16e9de2aac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.177440 Jul 14 10:10:52.940328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1148/2290] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:52 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:53.175636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:53.176250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:53.183109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:53.183567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:53.184325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:53.184763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:53.325690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:53.333932 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:53.335508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:53.336619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f064f947-0d47-4efe-9d01-a6a6be7aea85 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1407 microversion: 2.20 time: 0.164924 Jul 14 10:10:53.337174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1143/2291] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:53 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:53.626839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dc972981-db15-4b99-8610-96e6234f4cf8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:53.627922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dc972981-db15-4b99-8610-96e6234f4cf8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:53.636274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc972981-db15-4b99-8610-96e6234f4cf8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:53.636871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc972981-db15-4b99-8610-96e6234f4cf8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:53.638142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc972981-db15-4b99-8610-96e6234f4cf8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:53.638640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dc972981-db15-4b99-8610-96e6234f4cf8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:53.705242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dc972981-db15-4b99-8610-96e6234f4cf8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:53.713217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dc972981-db15-4b99-8610-96e6234f4cf8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090681 Jul 14 10:10:53.713775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1149/2292] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:53 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:53.766114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d5170752-9e9f-4534-8ee7-7b728d7dc972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:53.766743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d5170752-9e9f-4534-8ee7-7b728d7dc972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:53.772811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5170752-9e9f-4534-8ee7-7b728d7dc972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:53.773258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5170752-9e9f-4534-8ee7-7b728d7dc972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:53.774007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5170752-9e9f-4534-8ee7-7b728d7dc972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:53.774470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5170752-9e9f-4534-8ee7-7b728d7dc972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:53.905262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d5170752-9e9f-4534-8ee7-7b728d7dc972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:53.916510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d5170752-9e9f-4534-8ee7-7b728d7dc972 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.154750 Jul 14 10:10:53.917144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1144/2293] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:53 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:53.957506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8ccdd3fb-ef4f-42a1-804c-556e5b2464ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:53.958108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8ccdd3fb-ef4f-42a1-804c-556e5b2464ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:53.964319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ccdd3fb-ef4f-42a1-804c-556e5b2464ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:53.964765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ccdd3fb-ef4f-42a1-804c-556e5b2464ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:53.965525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ccdd3fb-ef4f-42a1-804c-556e5b2464ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:53.965956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8ccdd3fb-ef4f-42a1-804c-556e5b2464ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:54.109860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8ccdd3fb-ef4f-42a1-804c-556e5b2464ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:54.118085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8ccdd3fb-ef4f-42a1-804c-556e5b2464ce tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.164396 Jul 14 10:10:54.118697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1150/2294] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:53 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:54.355239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:54.355840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:54.363186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:54.363544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:54.364299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:54.364726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:54.503544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:54.513287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:54.514851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:54.515990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ac190974-53ca-4912-a286-067b048ebd98 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1407 microversion: 2.20 time: 0.164662 Jul 14 10:10:54.516561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1145/2295] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:54 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:54.732192 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-58de08d5-761f-4f26-b5ae-711219e4695c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:54.732797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-58de08d5-761f-4f26-b5ae-711219e4695c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:54.739382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-58de08d5-761f-4f26-b5ae-711219e4695c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:54.739828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-58de08d5-761f-4f26-b5ae-711219e4695c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:54.740588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-58de08d5-761f-4f26-b5ae-711219e4695c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:54.741022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-58de08d5-761f-4f26-b5ae-711219e4695c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:54.810846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-58de08d5-761f-4f26-b5ae-711219e4695c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:54.819101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-58de08d5-761f-4f26-b5ae-711219e4695c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091323 Jul 14 10:10:54.820512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1151/2296] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:54 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:54.934284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-08066022-254c-4170-9ba1-ce93fccc739a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:54.935030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-08066022-254c-4170-9ba1-ce93fccc739a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:54.941412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08066022-254c-4170-9ba1-ce93fccc739a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:54.941856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08066022-254c-4170-9ba1-ce93fccc739a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:54.942651 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08066022-254c-4170-9ba1-ce93fccc739a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:54.943081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08066022-254c-4170-9ba1-ce93fccc739a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:55.077450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-08066022-254c-4170-9ba1-ce93fccc739a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:55.085614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-08066022-254c-4170-9ba1-ce93fccc739a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155204 Jul 14 10:10:55.086415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1146/2297] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:55.138319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9749766c-a043-4084-83fb-e98e93b1a8d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:55.138937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9749766c-a043-4084-83fb-e98e93b1a8d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:55.146757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9749766c-a043-4084-83fb-e98e93b1a8d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:55.147206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9749766c-a043-4084-83fb-e98e93b1a8d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:55.149085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9749766c-a043-4084-83fb-e98e93b1a8d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:55.150170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9749766c-a043-4084-83fb-e98e93b1a8d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:55.292082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9749766c-a043-4084-83fb-e98e93b1a8d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:55.306058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9749766c-a043-4084-83fb-e98e93b1a8d5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.172065 Jul 14 10:10:55.306806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1152/2298] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:55 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:55.533791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:55.534372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:55.540842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:55.541285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:55.542033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:55.542495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:55.683006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:55.692844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:55.694770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:55.696059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b85f1013-dfc9-4b4f-a39b-155b80457774 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1407 microversion: 2.20 time: 0.166242 Jul 14 10:10:55.696656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1147/2299] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:55 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:55.836639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2dea516b-f708-4507-8914-05ea376222ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:55.837203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2dea516b-f708-4507-8914-05ea376222ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:55.843762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2dea516b-f708-4507-8914-05ea376222ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:55.844200 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2dea516b-f708-4507-8914-05ea376222ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:55.844974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2dea516b-f708-4507-8914-05ea376222ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:55.845394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2dea516b-f708-4507-8914-05ea376222ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:55.925350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2dea516b-f708-4507-8914-05ea376222ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:55.940654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2dea516b-f708-4507-8914-05ea376222ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.107485 Jul 14 10:10:55.941691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1153/2300] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:55 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:56.103860 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-985076ae-369f-49b2-b1e3-0f889fe3ee76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:56.104383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-985076ae-369f-49b2-b1e3-0f889fe3ee76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:56.111179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-985076ae-369f-49b2-b1e3-0f889fe3ee76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:56.111617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-985076ae-369f-49b2-b1e3-0f889fe3ee76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:56.112409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-985076ae-369f-49b2-b1e3-0f889fe3ee76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:56.112842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-985076ae-369f-49b2-b1e3-0f889fe3ee76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:56.253509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-985076ae-369f-49b2-b1e3-0f889fe3ee76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:56.261519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-985076ae-369f-49b2-b1e3-0f889fe3ee76 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.161610 Jul 14 10:10:56.262092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1148/2301] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:56.324239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-550c2c4e-ed2c-486c-9a25-529b4796b07f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:56.324847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-550c2c4e-ed2c-486c-9a25-529b4796b07f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:56.331045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-550c2c4e-ed2c-486c-9a25-529b4796b07f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:56.331488 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-550c2c4e-ed2c-486c-9a25-529b4796b07f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:56.332240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-550c2c4e-ed2c-486c-9a25-529b4796b07f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:56.332664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-550c2c4e-ed2c-486c-9a25-529b4796b07f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:56.476410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-550c2c4e-ed2c-486c-9a25-529b4796b07f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:56.484670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-550c2c4e-ed2c-486c-9a25-529b4796b07f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.164202 Jul 14 10:10:56.485242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1154/2302] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:56 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:56.715383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:56.716161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:56.723318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:56.723770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:56.724537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:56.724976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:56.863255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:56.871475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:56.873513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:56.874637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3f8c9192-60cd-47be-8e56-64e94462fbd0 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1407 microversion: 2.20 time: 0.163494 Jul 14 10:10:56.875188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1149/2303] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:56 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:56.962149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c9f4d4e9-efb6-401a-bb1f-4cf78c0fc00c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:56.962756 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c9f4d4e9-efb6-401a-bb1f-4cf78c0fc00c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:56.969327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9f4d4e9-efb6-401a-bb1f-4cf78c0fc00c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:56.969703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9f4d4e9-efb6-401a-bb1f-4cf78c0fc00c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:56.970485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9f4d4e9-efb6-401a-bb1f-4cf78c0fc00c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:56.970917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9f4d4e9-efb6-401a-bb1f-4cf78c0fc00c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:57.036795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9f4d4e9-efb6-401a-bb1f-4cf78c0fc00c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:57.045160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c9f4d4e9-efb6-401a-bb1f-4cf78c0fc00c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087038 Jul 14 10:10:57.045815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1155/2304] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:56 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:57.278924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6c6b1810-98bd-4037-b6f5-0c62d906bde0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:57.279436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6c6b1810-98bd-4037-b6f5-0c62d906bde0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:57.290104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c6b1810-98bd-4037-b6f5-0c62d906bde0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:57.290595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c6b1810-98bd-4037-b6f5-0c62d906bde0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:57.291369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c6b1810-98bd-4037-b6f5-0c62d906bde0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:57.291806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6c6b1810-98bd-4037-b6f5-0c62d906bde0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:57.423581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6c6b1810-98bd-4037-b6f5-0c62d906bde0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:57.431714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6c6b1810-98bd-4037-b6f5-0c62d906bde0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.156809 Jul 14 10:10:57.432280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1150/2305] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:57.501674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7742c726-6fc9-46e2-93dd-51f7ec98ab50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:57.502343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7742c726-6fc9-46e2-93dd-51f7ec98ab50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:57.508615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7742c726-6fc9-46e2-93dd-51f7ec98ab50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:57.509059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7742c726-6fc9-46e2-93dd-51f7ec98ab50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:57.509817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7742c726-6fc9-46e2-93dd-51f7ec98ab50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:57.510279 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7742c726-6fc9-46e2-93dd-51f7ec98ab50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:57.644529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7742c726-6fc9-46e2-93dd-51f7ec98ab50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:57.652584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7742c726-6fc9-46e2-93dd-51f7ec98ab50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155512 Jul 14 10:10:57.653148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1156/2306] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:57 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:57.892827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:57.893411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:57.900965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:57.901437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:57.902228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:57.902657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:58.045329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:58.062167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:58.063871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:58.064993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d040169e-553c-4fd1-ba83-d6931720974f tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1407 microversion: 2.20 time: 0.176168 Jul 14 10:10:58.065721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1151/2307] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:57 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:58.085715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a206e2a2-b8e9-42b0-8043-788de625f267 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:58.086369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a206e2a2-b8e9-42b0-8043-788de625f267 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:58.093010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a206e2a2-b8e9-42b0-8043-788de625f267 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:58.093454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a206e2a2-b8e9-42b0-8043-788de625f267 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:58.094244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a206e2a2-b8e9-42b0-8043-788de625f267 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:58.094681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a206e2a2-b8e9-42b0-8043-788de625f267 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:58.120023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-119b0d24-7698-49c2-ac00-1b9b95117420 req-cd2fdb97-63af-403f-a261-cd4657e62501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a1cd68-ca43-4d4c-9bcf-6b1552e945cc", "name": "network-vif-plugged", "status": "completed", "tag": "a2043256-8dca-4e80-a796-080a18c21591"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:10:58.128389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-119b0d24-7698-49c2-ac00-1b9b95117420 req-cd2fdb97-63af-403f-a261-cd4657e62501 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:58.128824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-119b0d24-7698-49c2-ac00-1b9b95117420 req-cd2fdb97-63af-403f-a261-cd4657e62501 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:58.141282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-119b0d24-7698-49c2-ac00-1b9b95117420 req-cd2fdb97-63af-403f-a261-cd4657e62501 service nova] Creating event network-vif-plugged:a2043256-8dca-4e80-a796-080a18c21591 for instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc on hv-cinder-82549 Jul 14 10:10:58.147447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-119b0d24-7698-49c2-ac00-1b9b95117420 req-cd2fdb97-63af-403f-a261-cd4657e62501 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099366 Jul 14 10:10:58.148155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1157/2308] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:10:58.168621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a206e2a2-b8e9-42b0-8043-788de625f267 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:58.177673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a206e2a2-b8e9-42b0-8043-788de625f267 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.095937 Jul 14 10:10:58.178272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1152/2309] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:58 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:58.449825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-09464498-44e5-45c7-908b-21e77ca52c8e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:58.451126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-09464498-44e5-45c7-908b-21e77ca52c8e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:58.457696 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09464498-44e5-45c7-908b-21e77ca52c8e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:58.458144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09464498-44e5-45c7-908b-21e77ca52c8e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:58.458936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09464498-44e5-45c7-908b-21e77ca52c8e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:58.459368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09464498-44e5-45c7-908b-21e77ca52c8e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:58.605438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-09464498-44e5-45c7-908b-21e77ca52c8e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:58.613859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-09464498-44e5-45c7-908b-21e77ca52c8e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.168255 Jul 14 10:10:58.614476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1158/2310] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:58.670569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d76880b5-9fb8-4914-bcb7-c781e371fc34 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:58.671361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d76880b5-9fb8-4914-bcb7-c781e371fc34 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:58.673260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:58.673959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=12 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:58.680287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d76880b5-9fb8-4914-bcb7-c781e371fc34 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:58.680728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d76880b5-9fb8-4914-bcb7-c781e371fc34 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:58.681491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d76880b5-9fb8-4914-bcb7-c781e371fc34 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:58.681953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d76880b5-9fb8-4914-bcb7-c781e371fc34 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:58.817373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d76880b5-9fb8-4914-bcb7-c781e371fc34 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:58.825835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d76880b5-9fb8-4914-bcb7-c781e371fc34 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.159425 Jul 14 10:10:58.826431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1153/2311] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:58 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:59.087832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:59.088442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:59.095832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:59.096272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:59.097035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:59.097461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:59.113853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:10:59.195656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-131f8d8d-b29d-43b0-beb6-064e200e85a3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:59.196341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-131f8d8d-b29d-43b0-beb6-064e200e85a3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:59.204662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-131f8d8d-b29d-43b0-beb6-064e200e85a3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:59.205295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-131f8d8d-b29d-43b0-beb6-064e200e85a3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:59.206172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-131f8d8d-b29d-43b0-beb6-064e200e85a3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:59.206836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-131f8d8d-b29d-43b0-beb6-064e200e85a3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:59.234706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:59.243128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:59.244648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:59.245767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d5ca0a0e-4151-49ff-bd01-c16c1c4e2882 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1407 microversion: 2.20 time: 0.161850 Jul 14 10:10:59.246398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1159/2312] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:10:59 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:10:59.271618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-131f8d8d-b29d-43b0-beb6-064e200e85a3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:59.280157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-131f8d8d-b29d-43b0-beb6-064e200e85a3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088507 Jul 14 10:10:59.280724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1154/2313] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:59 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:10:59.631743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0dfe4555-e9e3-43ce-bc56-9d89d5e65752 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:59.632383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0dfe4555-e9e3-43ce-bc56-9d89d5e65752 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:59.639002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0dfe4555-e9e3-43ce-bc56-9d89d5e65752 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:59.639445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0dfe4555-e9e3-43ce-bc56-9d89d5e65752 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:59.640198 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0dfe4555-e9e3-43ce-bc56-9d89d5e65752 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:59.640757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0dfe4555-e9e3-43ce-bc56-9d89d5e65752 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:59.780360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0dfe4555-e9e3-43ce-bc56-9d89d5e65752 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:10:59.789480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0dfe4555-e9e3-43ce-bc56-9d89d5e65752 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.161530 Jul 14 10:10:59.790096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1160/2314] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:59 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:10:59.844215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8e12a84b-a3af-4c34-85e9-9395ee63e8ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:10:59.844816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8e12a84b-a3af-4c34-85e9-9395ee63e8ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:10:59.851181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e12a84b-a3af-4c34-85e9-9395ee63e8ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:59.851630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e12a84b-a3af-4c34-85e9-9395ee63e8ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:59.852380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e12a84b-a3af-4c34-85e9-9395ee63e8ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:10:59.852838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8e12a84b-a3af-4c34-85e9-9395ee63e8ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:10:59.993313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8e12a84b-a3af-4c34-85e9-9395ee63e8ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:00.004287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8e12a84b-a3af-4c34-85e9-9395ee63e8ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.164016 Jul 14 10:11:00.005257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1155/2315] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:10:59 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:00.264452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:00.265261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:00.272126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:00.272576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:00.273366 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:00.273796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:00.299744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7338bd77-0eeb-4f34-a184-df9c037108ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:00.300915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7338bd77-0eeb-4f34-a184-df9c037108ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:00.307545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7338bd77-0eeb-4f34-a184-df9c037108ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:00.307915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7338bd77-0eeb-4f34-a184-df9c037108ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:00.308699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7338bd77-0eeb-4f34-a184-df9c037108ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:00.309141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7338bd77-0eeb-4f34-a184-df9c037108ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:00.405382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7338bd77-0eeb-4f34-a184-df9c037108ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:00.416396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7338bd77-0eeb-4f34-a184-df9c037108ef tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.122944 Jul 14 10:11:00.418274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1156/2316] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:00 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:00.492445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:00.501484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:00.503269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:00.504438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a3b4094d-a1e6-42b8-af14-86f0d650a488 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1599 microversion: 2.20 time: 0.243984 Jul 14 10:11:00.504993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1161/2317] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:11:00 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1599 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:11:00.522655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3958a446-668d-4a5f-b753-5414c77da250 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:00.523096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3958a446-668d-4a5f-b753-5414c77da250 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:00.526089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:00.530334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3958a446-668d-4a5f-b753-5414c77da250 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:00.530880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3958a446-668d-4a5f-b753-5414c77da250 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:00.531756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3958a446-668d-4a5f-b753-5414c77da250 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:00.532183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3958a446-668d-4a5f-b753-5414c77da250 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:00.617928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3958a446-668d-4a5f-b753-5414c77da250 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099524 Jul 14 10:11:00.618679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1157/2318] 10.222.0.40 () {60 vars in 1315 bytes} [Thu Jul 14 10:11:00 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:11:00.812660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f01a45c9-bbbb-4931-8f72-2d350c04b642 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:00.813193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f01a45c9-bbbb-4931-8f72-2d350c04b642 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:00.819419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f01a45c9-bbbb-4931-8f72-2d350c04b642 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:00.819856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f01a45c9-bbbb-4931-8f72-2d350c04b642 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:00.820620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f01a45c9-bbbb-4931-8f72-2d350c04b642 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:00.821051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f01a45c9-bbbb-4931-8f72-2d350c04b642 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:00.953466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f01a45c9-bbbb-4931-8f72-2d350c04b642 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:00.961544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f01a45c9-bbbb-4931-8f72-2d350c04b642 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152855 Jul 14 10:11:00.962114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1162/2319] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:00 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:01.023903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-779c8bd2-dcae-4c56-9697-5ad3df1fb3ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:01.024523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-779c8bd2-dcae-4c56-9697-5ad3df1fb3ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:01.031982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-779c8bd2-dcae-4c56-9697-5ad3df1fb3ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:01.032437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-779c8bd2-dcae-4c56-9697-5ad3df1fb3ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:01.033444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-779c8bd2-dcae-4c56-9697-5ad3df1fb3ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:01.033674 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-779c8bd2-dcae-4c56-9697-5ad3df1fb3ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:01.036581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:01.201272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-779c8bd2-dcae-4c56-9697-5ad3df1fb3ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:01.210503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-779c8bd2-dcae-4c56-9697-5ad3df1fb3ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.190482 Jul 14 10:11:01.211197 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1158/2320] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:01 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:01.438558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-53d7de01-d539-4a7c-b129-9c7e1e131120 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:01.439163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-53d7de01-d539-4a7c-b129-9c7e1e131120 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:01.445488 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-53d7de01-d539-4a7c-b129-9c7e1e131120 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:01.445946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-53d7de01-d539-4a7c-b129-9c7e1e131120 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:01.446759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-53d7de01-d539-4a7c-b129-9c7e1e131120 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:01.447193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-53d7de01-d539-4a7c-b129-9c7e1e131120 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:01.518350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-53d7de01-d539-4a7c-b129-9c7e1e131120 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:01.526834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-53d7de01-d539-4a7c-b129-9c7e1e131120 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.092612 Jul 14 10:11:01.527414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1163/2321] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:01 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:01.646104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-36bbde3d-618b-4156-bdaf-d262a29c769d req-528eb82e-a604-4ace-a86f-a1ac48472a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a1cd68-ca43-4d4c-9bcf-6b1552e945cc", "tag": "a2043256-8dca-4e80-a796-080a18c21591"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:11:01.654962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-36bbde3d-618b-4156-bdaf-d262a29c769d req-528eb82e-a604-4ace-a86f-a1ac48472a6c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:01.655415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-36bbde3d-618b-4156-bdaf-d262a29c769d req-528eb82e-a604-4ace-a86f-a1ac48472a6c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:01.667672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-36bbde3d-618b-4156-bdaf-d262a29c769d req-528eb82e-a604-4ace-a86f-a1ac48472a6c service nova] Creating event network-changed:a2043256-8dca-4e80-a796-080a18c21591 for instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc on hv-cinder-82549 Jul 14 10:11:01.676892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-36bbde3d-618b-4156-bdaf-d262a29c769d req-528eb82e-a604-4ace-a86f-a1ac48472a6c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034321 Jul 14 10:11:01.677540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1159/2322] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:11:01.979706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a52680b9-e01d-4726-ad1b-3214b1a8b771 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:01.980517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a52680b9-e01d-4726-ad1b-3214b1a8b771 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:01.988569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a52680b9-e01d-4726-ad1b-3214b1a8b771 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:01.989280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a52680b9-e01d-4726-ad1b-3214b1a8b771 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:01.990064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a52680b9-e01d-4726-ad1b-3214b1a8b771 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:01.990556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a52680b9-e01d-4726-ad1b-3214b1a8b771 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:02.133324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a52680b9-e01d-4726-ad1b-3214b1a8b771 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:02.142140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a52680b9-e01d-4726-ad1b-3214b1a8b771 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.166065 Jul 14 10:11:02.150305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1164/2323] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:02.233141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8b6b16ce-d5f4-4bfe-a968-e89b3952c0fa tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:02.234202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8b6b16ce-d5f4-4bfe-a968-e89b3952c0fa tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:02.240982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b6b16ce-d5f4-4bfe-a968-e89b3952c0fa tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:02.241262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b6b16ce-d5f4-4bfe-a968-e89b3952c0fa tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:02.242452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b6b16ce-d5f4-4bfe-a968-e89b3952c0fa tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:02.242886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8b6b16ce-d5f4-4bfe-a968-e89b3952c0fa tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:02.401299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8b6b16ce-d5f4-4bfe-a968-e89b3952c0fa tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:02.411808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8b6b16ce-d5f4-4bfe-a968-e89b3952c0fa tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.184746 Jul 14 10:11:02.412399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1160/2324] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:02 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:02.543999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-366a930c-2118-49f2-84c2-43d790ac17ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:02.544621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-366a930c-2118-49f2-84c2-43d790ac17ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:02.551742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-366a930c-2118-49f2-84c2-43d790ac17ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:02.552196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-366a930c-2118-49f2-84c2-43d790ac17ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:02.552959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-366a930c-2118-49f2-84c2-43d790ac17ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:02.553394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-366a930c-2118-49f2-84c2-43d790ac17ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:02.621006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-366a930c-2118-49f2-84c2-43d790ac17ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:02.629321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-366a930c-2118-49f2-84c2-43d790ac17ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089286 Jul 14 10:11:02.629907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1165/2325] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:02 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:03.159025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ffeebc1d-19a5-446b-9f53-1a4704660754 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:03.159593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ffeebc1d-19a5-446b-9f53-1a4704660754 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:03.166231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffeebc1d-19a5-446b-9f53-1a4704660754 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:03.166693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffeebc1d-19a5-446b-9f53-1a4704660754 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:03.167497 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffeebc1d-19a5-446b-9f53-1a4704660754 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:03.167941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ffeebc1d-19a5-446b-9f53-1a4704660754 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:03.304846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ffeebc1d-19a5-446b-9f53-1a4704660754 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:03.313536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ffeebc1d-19a5-446b-9f53-1a4704660754 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.158484 Jul 14 10:11:03.314111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1161/2326] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:03 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:03.430182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c99ea029-5097-4f76-ba0d-a30c34d31bd5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:03.430803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c99ea029-5097-4f76-ba0d-a30c34d31bd5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:03.437566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c99ea029-5097-4f76-ba0d-a30c34d31bd5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:03.438008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c99ea029-5097-4f76-ba0d-a30c34d31bd5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:03.438811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c99ea029-5097-4f76-ba0d-a30c34d31bd5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:03.439243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c99ea029-5097-4f76-ba0d-a30c34d31bd5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:03.578043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c99ea029-5097-4f76-ba0d-a30c34d31bd5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:03.586106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c99ea029-5097-4f76-ba0d-a30c34d31bd5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.159775 Jul 14 10:11:03.586708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1166/2327] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:03 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:03.646995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-433f757a-a1a3-4e34-ac88-c7f6897daed2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:03.647605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-433f757a-a1a3-4e34-ac88-c7f6897daed2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:03.654439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-433f757a-a1a3-4e34-ac88-c7f6897daed2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:03.654898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-433f757a-a1a3-4e34-ac88-c7f6897daed2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:03.655659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-433f757a-a1a3-4e34-ac88-c7f6897daed2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:03.656079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-433f757a-a1a3-4e34-ac88-c7f6897daed2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:03.721295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-433f757a-a1a3-4e34-ac88-c7f6897daed2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:03.729447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-433f757a-a1a3-4e34-ac88-c7f6897daed2 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086310 Jul 14 10:11:03.730017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1162/2328] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:03 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:04.331219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-898affd8-eed3-49a0-ab17-48ba118793ec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:04.331826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-898affd8-eed3-49a0-ab17-48ba118793ec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:04.338004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-898affd8-eed3-49a0-ab17-48ba118793ec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:04.338470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-898affd8-eed3-49a0-ab17-48ba118793ec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:04.339225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-898affd8-eed3-49a0-ab17-48ba118793ec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:04.339650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-898affd8-eed3-49a0-ab17-48ba118793ec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:04.473091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-898affd8-eed3-49a0-ab17-48ba118793ec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:04.481045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-898affd8-eed3-49a0-ab17-48ba118793ec tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153682 Jul 14 10:11:04.481609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1167/2329] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:04.604389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ac1d2edd-311e-415a-b7c7-473240f724e5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:04.604971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ac1d2edd-311e-415a-b7c7-473240f724e5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:04.611714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac1d2edd-311e-415a-b7c7-473240f724e5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:04.612169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac1d2edd-311e-415a-b7c7-473240f724e5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:04.612935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac1d2edd-311e-415a-b7c7-473240f724e5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:04.613379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ac1d2edd-311e-415a-b7c7-473240f724e5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:04.745844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ac1d2edd-311e-415a-b7c7-473240f724e5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:04.746473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c4bd8d1a-70fd-4ac2-bd00-bf5390ae6a68 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:04.747802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c4bd8d1a-70fd-4ac2-bd00-bf5390ae6a68 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:04.754321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4bd8d1a-70fd-4ac2-bd00-bf5390ae6a68 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:04.754768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4bd8d1a-70fd-4ac2-bd00-bf5390ae6a68 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:04.755207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ac1d2edd-311e-415a-b7c7-473240f724e5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154628 Jul 14 10:11:04.755533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4bd8d1a-70fd-4ac2-bd00-bf5390ae6a68 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:04.755920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1163/2330] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:04 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:04.756129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c4bd8d1a-70fd-4ac2-bd00-bf5390ae6a68 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:04.820116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c4bd8d1a-70fd-4ac2-bd00-bf5390ae6a68 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:04.828210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c4bd8d1a-70fd-4ac2-bd00-bf5390ae6a68 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085610 Jul 14 10:11:04.828765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1168/2331] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:04 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:05.498474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0face8d2-28e7-486b-817c-98fde704078e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:05.499116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0face8d2-28e7-486b-817c-98fde704078e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:05.505223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0face8d2-28e7-486b-817c-98fde704078e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:05.505671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0face8d2-28e7-486b-817c-98fde704078e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:05.506455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0face8d2-28e7-486b-817c-98fde704078e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:05.506890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0face8d2-28e7-486b-817c-98fde704078e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:05.640079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0face8d2-28e7-486b-817c-98fde704078e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:05.648225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0face8d2-28e7-486b-817c-98fde704078e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153631 Jul 14 10:11:05.648792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1164/2332] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:05.772903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-22fca99a-8cd3-49b1-9dcb-999e36c4202f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:05.773485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-22fca99a-8cd3-49b1-9dcb-999e36c4202f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:05.781438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22fca99a-8cd3-49b1-9dcb-999e36c4202f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:05.781878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22fca99a-8cd3-49b1-9dcb-999e36c4202f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:05.782700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22fca99a-8cd3-49b1-9dcb-999e36c4202f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:05.783125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-22fca99a-8cd3-49b1-9dcb-999e36c4202f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:05.847517 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e2d5b4ac-0272-4650-b802-30a09c063852 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:05.851036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e2d5b4ac-0272-4650-b802-30a09c063852 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:05.857976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2d5b4ac-0272-4650-b802-30a09c063852 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:05.858610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2d5b4ac-0272-4650-b802-30a09c063852 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:05.859439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2d5b4ac-0272-4650-b802-30a09c063852 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:05.859940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2d5b4ac-0272-4650-b802-30a09c063852 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:05.929694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e2d5b4ac-0272-4650-b802-30a09c063852 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:05.941343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e2d5b4ac-0272-4650-b802-30a09c063852 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.100172 Jul 14 10:11:05.945245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1165/2333] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:05 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:05.954516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-22fca99a-8cd3-49b1-9dcb-999e36c4202f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:05.962951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-22fca99a-8cd3-49b1-9dcb-999e36c4202f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.193857 Jul 14 10:11:05.963530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1169/2334] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:05 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:06.667266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-320af1a8-19c0-4a4e-a971-c21f25e331ad tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:06.668025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-320af1a8-19c0-4a4e-a971-c21f25e331ad tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:06.675585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-320af1a8-19c0-4a4e-a971-c21f25e331ad tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:06.676382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-320af1a8-19c0-4a4e-a971-c21f25e331ad tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:06.677019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-320af1a8-19c0-4a4e-a971-c21f25e331ad tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:06.677258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-320af1a8-19c0-4a4e-a971-c21f25e331ad tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:06.816533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-320af1a8-19c0-4a4e-a971-c21f25e331ad tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:06.824756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-320af1a8-19c0-4a4e-a971-c21f25e331ad tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.162685 Jul 14 10:11:06.825360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1166/2335] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:06 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:06.959304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fae79be4-107f-4ba8-adac-b03a9fa8d5a1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:06.959909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fae79be4-107f-4ba8-adac-b03a9fa8d5a1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:06.967124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fae79be4-107f-4ba8-adac-b03a9fa8d5a1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:06.967568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fae79be4-107f-4ba8-adac-b03a9fa8d5a1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:06.968331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fae79be4-107f-4ba8-adac-b03a9fa8d5a1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:06.968766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fae79be4-107f-4ba8-adac-b03a9fa8d5a1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:06.980197 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2d46d572-bc07-49c6-a68f-82c2b0634aa0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:06.980807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2d46d572-bc07-49c6-a68f-82c2b0634aa0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:06.987386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d46d572-bc07-49c6-a68f-82c2b0634aa0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:06.987830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d46d572-bc07-49c6-a68f-82c2b0634aa0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:06.988595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d46d572-bc07-49c6-a68f-82c2b0634aa0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:06.989039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2d46d572-bc07-49c6-a68f-82c2b0634aa0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:07.045733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fae79be4-107f-4ba8-adac-b03a9fa8d5a1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:07.057346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fae79be4-107f-4ba8-adac-b03a9fa8d5a1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.101831 Jul 14 10:11:07.057931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1170/2336] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:06 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:07.133798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2d46d572-bc07-49c6-a68f-82c2b0634aa0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:07.142642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2d46d572-bc07-49c6-a68f-82c2b0634aa0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.166296 Jul 14 10:11:07.143222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1167/2337] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:06 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:07.841874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f1bcaff1-20a9-4d06-bc82-b331c121abbb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:07.842418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f1bcaff1-20a9-4d06-bc82-b331c121abbb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:07.849064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1bcaff1-20a9-4d06-bc82-b331c121abbb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:07.849508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1bcaff1-20a9-4d06-bc82-b331c121abbb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:07.850292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1bcaff1-20a9-4d06-bc82-b331c121abbb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:07.850744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f1bcaff1-20a9-4d06-bc82-b331c121abbb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:07.992037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f1bcaff1-20a9-4d06-bc82-b331c121abbb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:08.001006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f1bcaff1-20a9-4d06-bc82-b331c121abbb tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.162826 Jul 14 10:11:08.001582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1171/2338] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:08.074718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-61fb2328-f3e2-4661-9b8c-32b12bef0345 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:08.075359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-61fb2328-f3e2-4661-9b8c-32b12bef0345 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:08.082245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61fb2328-f3e2-4661-9b8c-32b12bef0345 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:08.082695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61fb2328-f3e2-4661-9b8c-32b12bef0345 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:08.083511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61fb2328-f3e2-4661-9b8c-32b12bef0345 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:08.083941 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-61fb2328-f3e2-4661-9b8c-32b12bef0345 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:08.146937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-61fb2328-f3e2-4661-9b8c-32b12bef0345 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:08.155720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-61fb2328-f3e2-4661-9b8c-32b12bef0345 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085002 Jul 14 10:11:08.156299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1168/2339] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:08 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:08.160106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a08102b4-057d-47f7-971e-884c46277654 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:08.160729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a08102b4-057d-47f7-971e-884c46277654 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:08.166840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a08102b4-057d-47f7-971e-884c46277654 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:08.167276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a08102b4-057d-47f7-971e-884c46277654 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:08.168027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a08102b4-057d-47f7-971e-884c46277654 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:08.168455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a08102b4-057d-47f7-971e-884c46277654 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:08.298273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a08102b4-057d-47f7-971e-884c46277654 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:08.306305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a08102b4-057d-47f7-971e-884c46277654 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149970 Jul 14 10:11:08.306895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1172/2340] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:08 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:09.018489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-38ef077b-4e88-4b47-b78f-44c8f939179d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:09.019104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-38ef077b-4e88-4b47-b78f-44c8f939179d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:09.025350 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38ef077b-4e88-4b47-b78f-44c8f939179d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:09.025793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38ef077b-4e88-4b47-b78f-44c8f939179d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:09.026593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38ef077b-4e88-4b47-b78f-44c8f939179d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:09.027018 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38ef077b-4e88-4b47-b78f-44c8f939179d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:09.171622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-38ef077b-4e88-4b47-b78f-44c8f939179d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:09.173928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef8089e6-ae10-4038-9ad6-69ed8f051663 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:09.174881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ef8089e6-ae10-4038-9ad6-69ed8f051663 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:09.180856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-38ef077b-4e88-4b47-b78f-44c8f939179d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.166917 Jul 14 10:11:09.181445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1169/2341] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:09.182035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef8089e6-ae10-4038-9ad6-69ed8f051663 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:09.182578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef8089e6-ae10-4038-9ad6-69ed8f051663 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:09.183389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef8089e6-ae10-4038-9ad6-69ed8f051663 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:09.183830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef8089e6-ae10-4038-9ad6-69ed8f051663 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:09.256709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ef8089e6-ae10-4038-9ad6-69ed8f051663 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:09.267308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ef8089e6-ae10-4038-9ad6-69ed8f051663 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.098096 Jul 14 10:11:09.267926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1173/2342] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:09 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:09.323792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-98e5d726-21f0-44f0-a759-fa519881c3d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:09.324305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-98e5d726-21f0-44f0-a759-fa519881c3d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:09.330608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98e5d726-21f0-44f0-a759-fa519881c3d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:09.331076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98e5d726-21f0-44f0-a759-fa519881c3d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:09.331820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98e5d726-21f0-44f0-a759-fa519881c3d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:09.332252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98e5d726-21f0-44f0-a759-fa519881c3d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:09.474397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98e5d726-21f0-44f0-a759-fa519881c3d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:09.482513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-98e5d726-21f0-44f0-a759-fa519881c3d4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162819 Jul 14 10:11:09.483080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1170/2343] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:09 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:10.199015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8e5beba5-732a-42a5-bfa5-ebbd0d6e13d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:10.199622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8e5beba5-732a-42a5-bfa5-ebbd0d6e13d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:10.201919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=98 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:10.207849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e5beba5-732a-42a5-bfa5-ebbd0d6e13d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:10.208324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e5beba5-732a-42a5-bfa5-ebbd0d6e13d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:10.209133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e5beba5-732a-42a5-bfa5-ebbd0d6e13d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:10.209580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8e5beba5-732a-42a5-bfa5-ebbd0d6e13d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:10.284964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a8edf3bc-0938-481e-bf1b-d58dab857a48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:10.285601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a8edf3bc-0938-481e-bf1b-d58dab857a48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:10.292344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a8edf3bc-0938-481e-bf1b-d58dab857a48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:10.292786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a8edf3bc-0938-481e-bf1b-d58dab857a48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:10.293644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a8edf3bc-0938-481e-bf1b-d58dab857a48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:10.294477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a8edf3bc-0938-481e-bf1b-d58dab857a48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:10.368583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a8edf3bc-0938-481e-bf1b-d58dab857a48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:10.372020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8e5beba5-732a-42a5-bfa5-ebbd0d6e13d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:10.376888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a8edf3bc-0938-481e-bf1b-d58dab857a48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.096646 Jul 14 10:11:10.377499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1171/2344] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:10 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:10.380475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8e5beba5-732a-42a5-bfa5-ebbd0d6e13d4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.185362 Jul 14 10:11:10.381035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1174/2345] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:10.499323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7806f0ce-a43f-4e31-bd2f-42ee04aaa53a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:10.500226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7806f0ce-a43f-4e31-bd2f-42ee04aaa53a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:10.506346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7806f0ce-a43f-4e31-bd2f-42ee04aaa53a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:10.506980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7806f0ce-a43f-4e31-bd2f-42ee04aaa53a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:10.507736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7806f0ce-a43f-4e31-bd2f-42ee04aaa53a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:10.508171 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7806f0ce-a43f-4e31-bd2f-42ee04aaa53a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:10.647677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7806f0ce-a43f-4e31-bd2f-42ee04aaa53a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:10.658149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7806f0ce-a43f-4e31-bd2f-42ee04aaa53a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.162717 Jul 14 10:11:10.658764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1172/2346] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:10 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:11.394425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dd7aceba-9b5f-45a3-87ed-3133e5b91c62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:11.395227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dd7aceba-9b5f-45a3-87ed-3133e5b91c62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:11.397994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a212ebc3-3e01-434e-8f47-f43d883eff9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:11.398640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a212ebc3-3e01-434e-8f47-f43d883eff9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:11.402078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd7aceba-9b5f-45a3-87ed-3133e5b91c62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:11.402564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd7aceba-9b5f-45a3-87ed-3133e5b91c62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:11.403331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd7aceba-9b5f-45a3-87ed-3133e5b91c62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:11.403764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd7aceba-9b5f-45a3-87ed-3133e5b91c62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:11.405122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a212ebc3-3e01-434e-8f47-f43d883eff9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:11.405577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a212ebc3-3e01-434e-8f47-f43d883eff9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:11.406397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a212ebc3-3e01-434e-8f47-f43d883eff9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:11.406840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a212ebc3-3e01-434e-8f47-f43d883eff9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:11.475206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dd7aceba-9b5f-45a3-87ed-3133e5b91c62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:11.483781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dd7aceba-9b5f-45a3-87ed-3133e5b91c62 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.093534 Jul 14 10:11:11.484359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1175/2347] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:11 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:11.560346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a212ebc3-3e01-434e-8f47-f43d883eff9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:11.568911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a212ebc3-3e01-434e-8f47-f43d883eff9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.174824 Jul 14 10:11:11.569466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1173/2348] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:11 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:11.676885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1e5c925a-43b8-41fa-af63-23e45e4dea21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:11.677489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1e5c925a-43b8-41fa-af63-23e45e4dea21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:11.683910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e5c925a-43b8-41fa-af63-23e45e4dea21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:11.684358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e5c925a-43b8-41fa-af63-23e45e4dea21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:11.685129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e5c925a-43b8-41fa-af63-23e45e4dea21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:11.685562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e5c925a-43b8-41fa-af63-23e45e4dea21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:11.688929 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:11.819231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1e5c925a-43b8-41fa-af63-23e45e4dea21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:11.827245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1e5c925a-43b8-41fa-af63-23e45e4dea21 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154210 Jul 14 10:11:11.827812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1176/2349] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:11 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:12.501483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c0973ebe-b024-4d5a-8445-5e88eda78278 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:12.502033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c0973ebe-b024-4d5a-8445-5e88eda78278 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:12.508502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0973ebe-b024-4d5a-8445-5e88eda78278 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:12.508942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0973ebe-b024-4d5a-8445-5e88eda78278 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:12.509698 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0973ebe-b024-4d5a-8445-5e88eda78278 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:12.510128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0973ebe-b024-4d5a-8445-5e88eda78278 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:12.574887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c0973ebe-b024-4d5a-8445-5e88eda78278 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:12.583588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c0973ebe-b024-4d5a-8445-5e88eda78278 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086615 Jul 14 10:11:12.584146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1174/2350] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:12 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:12.585330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7362701d-341b-455b-ad00-6f02eb105636 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:12.585973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7362701d-341b-455b-ad00-6f02eb105636 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:12.600611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7362701d-341b-455b-ad00-6f02eb105636 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:12.601055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7362701d-341b-455b-ad00-6f02eb105636 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:12.601939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7362701d-341b-455b-ad00-6f02eb105636 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:12.602469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7362701d-341b-455b-ad00-6f02eb105636 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:12.730256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7362701d-341b-455b-ad00-6f02eb105636 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:12.738310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7362701d-341b-455b-ad00-6f02eb105636 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.156838 Jul 14 10:11:12.738873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1177/2351] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:12.844221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4cd16d85-5cc6-4200-a6ba-22fdbe7ce514 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:12.844824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4cd16d85-5cc6-4200-a6ba-22fdbe7ce514 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:12.851180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cd16d85-5cc6-4200-a6ba-22fdbe7ce514 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:12.851622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cd16d85-5cc6-4200-a6ba-22fdbe7ce514 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:12.852459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cd16d85-5cc6-4200-a6ba-22fdbe7ce514 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:12.852892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4cd16d85-5cc6-4200-a6ba-22fdbe7ce514 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:12.867955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:12.989103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4cd16d85-5cc6-4200-a6ba-22fdbe7ce514 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:12.997124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4cd16d85-5cc6-4200-a6ba-22fdbe7ce514 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.156783 Jul 14 10:11:12.997686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1175/2352] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:12 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:13.599822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-70280d54-e8b7-410f-831d-a54322563d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:13.600473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-70280d54-e8b7-410f-831d-a54322563d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:13.607047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-70280d54-e8b7-410f-831d-a54322563d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:13.607493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-70280d54-e8b7-410f-831d-a54322563d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:13.608890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-70280d54-e8b7-410f-831d-a54322563d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:13.609367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-70280d54-e8b7-410f-831d-a54322563d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:13.671662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-70280d54-e8b7-410f-831d-a54322563d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:13.679616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-70280d54-e8b7-410f-831d-a54322563d9b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083720 Jul 14 10:11:13.680180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1178/2353] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:13 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:13.755336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7888de51-5cba-43dd-bfe7-d4a51bb393cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:13.755938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7888de51-5cba-43dd-bfe7-d4a51bb393cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:13.762858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7888de51-5cba-43dd-bfe7-d4a51bb393cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:13.763300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7888de51-5cba-43dd-bfe7-d4a51bb393cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:13.764052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7888de51-5cba-43dd-bfe7-d4a51bb393cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:13.764977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7888de51-5cba-43dd-bfe7-d4a51bb393cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:13.890774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7888de51-5cba-43dd-bfe7-d4a51bb393cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:13.898667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7888de51-5cba-43dd-bfe7-d4a51bb393cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147134 Jul 14 10:11:13.899226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1176/2354] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:13 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:14.015319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0c65f310-a2d2-42c3-bd3f-622cb5b67709 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:14.016008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0c65f310-a2d2-42c3-bd3f-622cb5b67709 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:14.021970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c65f310-a2d2-42c3-bd3f-622cb5b67709 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:14.022439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c65f310-a2d2-42c3-bd3f-622cb5b67709 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:14.023186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c65f310-a2d2-42c3-bd3f-622cb5b67709 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:14.023618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c65f310-a2d2-42c3-bd3f-622cb5b67709 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:14.152522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0c65f310-a2d2-42c3-bd3f-622cb5b67709 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:14.160463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0c65f310-a2d2-42c3-bd3f-622cb5b67709 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149678 Jul 14 10:11:14.161019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1179/2355] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:14 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:14.696461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c5b8628c-7684-4e64-8e92-b5137dd1c385 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:14.697099 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c5b8628c-7684-4e64-8e92-b5137dd1c385 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:14.703533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5b8628c-7684-4e64-8e92-b5137dd1c385 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:14.703988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5b8628c-7684-4e64-8e92-b5137dd1c385 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:14.704787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5b8628c-7684-4e64-8e92-b5137dd1c385 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:14.705252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5b8628c-7684-4e64-8e92-b5137dd1c385 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:14.769338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c5b8628c-7684-4e64-8e92-b5137dd1c385 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:14.777555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c5b8628c-7684-4e64-8e92-b5137dd1c385 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084933 Jul 14 10:11:14.778137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1177/2356] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:14 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:14.917488 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-449c0c66-415b-4487-bc56-cbf5e906a45b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:14.918099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-449c0c66-415b-4487-bc56-cbf5e906a45b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:14.925853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-449c0c66-415b-4487-bc56-cbf5e906a45b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:14.926330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-449c0c66-415b-4487-bc56-cbf5e906a45b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:14.927097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-449c0c66-415b-4487-bc56-cbf5e906a45b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:14.927527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-449c0c66-415b-4487-bc56-cbf5e906a45b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:15.059352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-449c0c66-415b-4487-bc56-cbf5e906a45b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:15.067483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-449c0c66-415b-4487-bc56-cbf5e906a45b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153812 Jul 14 10:11:15.068058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1180/2357] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:15.177208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2e562211-864c-4572-a2a4-3bbcd3713544 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:15.177821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2e562211-864c-4572-a2a4-3bbcd3713544 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:15.184298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e562211-864c-4572-a2a4-3bbcd3713544 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:15.184751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e562211-864c-4572-a2a4-3bbcd3713544 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:15.185520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e562211-864c-4572-a2a4-3bbcd3713544 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:15.185958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e562211-864c-4572-a2a4-3bbcd3713544 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:15.319278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2e562211-864c-4572-a2a4-3bbcd3713544 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:15.327726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2e562211-864c-4572-a2a4-3bbcd3713544 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153898 Jul 14 10:11:15.328287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1178/2358] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:15 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:15.794939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ba5d00ce-96e6-469d-8890-426d78152946 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:15.795537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ba5d00ce-96e6-469d-8890-426d78152946 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:15.802054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba5d00ce-96e6-469d-8890-426d78152946 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:15.802521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba5d00ce-96e6-469d-8890-426d78152946 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:15.803275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba5d00ce-96e6-469d-8890-426d78152946 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:15.803702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba5d00ce-96e6-469d-8890-426d78152946 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:15.868936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ba5d00ce-96e6-469d-8890-426d78152946 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:15.877466 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ba5d00ce-96e6-469d-8890-426d78152946 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086396 Jul 14 10:11:15.878035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1181/2359] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:15 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:16.084631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-08a4dec4-12f1-4631-848c-a485a2cfbe98 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:16.085244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-08a4dec4-12f1-4631-848c-a485a2cfbe98 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:16.091912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08a4dec4-12f1-4631-848c-a485a2cfbe98 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:16.092355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08a4dec4-12f1-4631-848c-a485a2cfbe98 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:16.093156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08a4dec4-12f1-4631-848c-a485a2cfbe98 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:16.093594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-08a4dec4-12f1-4631-848c-a485a2cfbe98 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:16.228738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-08a4dec4-12f1-4631-848c-a485a2cfbe98 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:16.237645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-08a4dec4-12f1-4631-848c-a485a2cfbe98 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.156854 Jul 14 10:11:16.238485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1179/2360] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:16 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:16.345327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-28bcd92e-a5cc-459a-bed0-7e3b53c0916c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:16.345944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-28bcd92e-a5cc-459a-bed0-7e3b53c0916c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:16.352476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-28bcd92e-a5cc-459a-bed0-7e3b53c0916c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:16.352921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-28bcd92e-a5cc-459a-bed0-7e3b53c0916c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:16.353679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-28bcd92e-a5cc-459a-bed0-7e3b53c0916c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:16.354110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-28bcd92e-a5cc-459a-bed0-7e3b53c0916c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:16.646653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-28bcd92e-a5cc-459a-bed0-7e3b53c0916c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:16.654536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-28bcd92e-a5cc-459a-bed0-7e3b53c0916c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.313559 Jul 14 10:11:16.655098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1182/2361] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:16 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:16.894480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-69466b56-63b1-4b19-bd0f-e341f99e41ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:16.895031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-69466b56-63b1-4b19-bd0f-e341f99e41ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:16.901071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-69466b56-63b1-4b19-bd0f-e341f99e41ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:16.901514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-69466b56-63b1-4b19-bd0f-e341f99e41ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:16.902284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-69466b56-63b1-4b19-bd0f-e341f99e41ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:16.902714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-69466b56-63b1-4b19-bd0f-e341f99e41ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:16.964853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-69466b56-63b1-4b19-bd0f-e341f99e41ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:16.973640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-69466b56-63b1-4b19-bd0f-e341f99e41ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083645 Jul 14 10:11:16.974226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1180/2362] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:16 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:17.254725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a3da30ae-63a3-415f-8f81-0c383f36e345 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:17.255335 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a3da30ae-63a3-415f-8f81-0c383f36e345 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:17.261327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3da30ae-63a3-415f-8f81-0c383f36e345 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:17.261772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3da30ae-63a3-415f-8f81-0c383f36e345 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:17.262567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3da30ae-63a3-415f-8f81-0c383f36e345 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:17.263002 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a3da30ae-63a3-415f-8f81-0c383f36e345 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:17.393330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a3da30ae-63a3-415f-8f81-0c383f36e345 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:17.401340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a3da30ae-63a3-415f-8f81-0c383f36e345 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150489 Jul 14 10:11:17.401900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1183/2363] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:17.672511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a9bbaf15-8eac-4ace-952f-7edd0426a82f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:17.673115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a9bbaf15-8eac-4ace-952f-7edd0426a82f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:17.679811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9bbaf15-8eac-4ace-952f-7edd0426a82f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:17.680255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9bbaf15-8eac-4ace-952f-7edd0426a82f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:17.681009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9bbaf15-8eac-4ace-952f-7edd0426a82f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:17.681438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9bbaf15-8eac-4ace-952f-7edd0426a82f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:17.819455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a9bbaf15-8eac-4ace-952f-7edd0426a82f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:17.832654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a9bbaf15-8eac-4ace-952f-7edd0426a82f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.164333 Jul 14 10:11:17.833220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1181/2364] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:17 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:17.991358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f997c777-5c63-4eee-ba56-e3ee862027a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:17.991966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f997c777-5c63-4eee-ba56-e3ee862027a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:17.998242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f997c777-5c63-4eee-ba56-e3ee862027a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:17.998697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f997c777-5c63-4eee-ba56-e3ee862027a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:17.999974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f997c777-5c63-4eee-ba56-e3ee862027a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:18.000434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f997c777-5c63-4eee-ba56-e3ee862027a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:18.060736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f997c777-5c63-4eee-ba56-e3ee862027a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:18.069479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f997c777-5c63-4eee-ba56-e3ee862027a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081910 Jul 14 10:11:18.069970 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1184/2365] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:17 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:18.339767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:11:18.339997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:11:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:11:18.419272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-efe69d5d-c497-4aba-960a-2753f4a972c7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:18.419888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-efe69d5d-c497-4aba-960a-2753f4a972c7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:18.426788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efe69d5d-c497-4aba-960a-2753f4a972c7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:18.427265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efe69d5d-c497-4aba-960a-2753f4a972c7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:18.428004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efe69d5d-c497-4aba-960a-2753f4a972c7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:18.428452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-efe69d5d-c497-4aba-960a-2753f4a972c7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:18.562641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-efe69d5d-c497-4aba-960a-2753f4a972c7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:18.572601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-efe69d5d-c497-4aba-960a-2753f4a972c7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.157261 Jul 14 10:11:18.573166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1182/2366] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:18 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:18.850253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c093f0cf-5aac-4ae9-b9cc-a10879308eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:18.850913 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c093f0cf-5aac-4ae9-b9cc-a10879308eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:18.857434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c093f0cf-5aac-4ae9-b9cc-a10879308eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:18.857876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c093f0cf-5aac-4ae9-b9cc-a10879308eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:18.858652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c093f0cf-5aac-4ae9-b9cc-a10879308eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:18.859083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c093f0cf-5aac-4ae9-b9cc-a10879308eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:18.989271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c093f0cf-5aac-4ae9-b9cc-a10879308eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:18.997196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c093f0cf-5aac-4ae9-b9cc-a10879308eba tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151402 Jul 14 10:11:18.997752 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1185/2367] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:18 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:19.086704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7c7d7329-2041-42fa-8b31-1ac8c2550ccc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:19.087311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7c7d7329-2041-42fa-8b31-1ac8c2550ccc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:19.094031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c7d7329-2041-42fa-8b31-1ac8c2550ccc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:19.094485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c7d7329-2041-42fa-8b31-1ac8c2550ccc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:19.095237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c7d7329-2041-42fa-8b31-1ac8c2550ccc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:19.095667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7c7d7329-2041-42fa-8b31-1ac8c2550ccc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:19.157268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7c7d7329-2041-42fa-8b31-1ac8c2550ccc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:19.165167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7c7d7329-2041-42fa-8b31-1ac8c2550ccc tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082283 Jul 14 10:11:19.165724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1183/2368] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:19 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:19.590211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-704e299a-707a-41e7-a68f-9eeba3f2f6e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:19.590848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-704e299a-707a-41e7-a68f-9eeba3f2f6e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:19.597501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-704e299a-707a-41e7-a68f-9eeba3f2f6e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:19.597948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-704e299a-707a-41e7-a68f-9eeba3f2f6e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:19.598738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-704e299a-707a-41e7-a68f-9eeba3f2f6e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:19.599171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-704e299a-707a-41e7-a68f-9eeba3f2f6e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:19.729356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-704e299a-707a-41e7-a68f-9eeba3f2f6e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:19.738727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-704e299a-707a-41e7-a68f-9eeba3f2f6e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152332 Jul 14 10:11:19.739292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1186/2369] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:19 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:20.015700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ad445970-e22e-4f9e-a054-3fcd97e779a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:20.016307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ad445970-e22e-4f9e-a054-3fcd97e779a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:20.022421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad445970-e22e-4f9e-a054-3fcd97e779a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:20.022852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad445970-e22e-4f9e-a054-3fcd97e779a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:20.023605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad445970-e22e-4f9e-a054-3fcd97e779a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:20.024054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ad445970-e22e-4f9e-a054-3fcd97e779a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:20.152001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ad445970-e22e-4f9e-a054-3fcd97e779a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:20.160030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ad445970-e22e-4f9e-a054-3fcd97e779a4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148893 Jul 14 10:11:20.160590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1184/2370] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:20 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:20.182580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cdb1ed68-6e7c-4f2e-b3b7-8b339116ecd8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:20.183181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cdb1ed68-6e7c-4f2e-b3b7-8b339116ecd8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:20.190265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cdb1ed68-6e7c-4f2e-b3b7-8b339116ecd8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:20.190709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cdb1ed68-6e7c-4f2e-b3b7-8b339116ecd8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:20.191454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cdb1ed68-6e7c-4f2e-b3b7-8b339116ecd8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:20.191879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cdb1ed68-6e7c-4f2e-b3b7-8b339116ecd8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:20.253905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cdb1ed68-6e7c-4f2e-b3b7-8b339116ecd8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:20.261937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cdb1ed68-6e7c-4f2e-b3b7-8b339116ecd8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083174 Jul 14 10:11:20.262516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1187/2371] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:20 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:20.756569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a59c914b-5c1a-4602-82f3-bfe3bb21a51a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:20.757214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a59c914b-5c1a-4602-82f3-bfe3bb21a51a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:20.763355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a59c914b-5c1a-4602-82f3-bfe3bb21a51a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:20.763841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a59c914b-5c1a-4602-82f3-bfe3bb21a51a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:20.764605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a59c914b-5c1a-4602-82f3-bfe3bb21a51a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:20.765679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a59c914b-5c1a-4602-82f3-bfe3bb21a51a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:20.895269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a59c914b-5c1a-4602-82f3-bfe3bb21a51a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:20.903260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a59c914b-5c1a-4602-82f3-bfe3bb21a51a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150666 Jul 14 10:11:20.903830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1185/2372] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:21.177713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1e88ccf8-1147-4232-9184-eaf06ec4180c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:21.178353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1e88ccf8-1147-4232-9184-eaf06ec4180c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:21.184602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e88ccf8-1147-4232-9184-eaf06ec4180c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:21.185203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e88ccf8-1147-4232-9184-eaf06ec4180c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:21.185795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e88ccf8-1147-4232-9184-eaf06ec4180c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:21.186238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1e88ccf8-1147-4232-9184-eaf06ec4180c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:21.279282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da98d554-73c6-4fcf-8531-db48b51083bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:21.279980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da98d554-73c6-4fcf-8531-db48b51083bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:21.286565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da98d554-73c6-4fcf-8531-db48b51083bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:21.287012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da98d554-73c6-4fcf-8531-db48b51083bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:21.287774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da98d554-73c6-4fcf-8531-db48b51083bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:21.288211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da98d554-73c6-4fcf-8531-db48b51083bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:21.324469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1e88ccf8-1147-4232-9184-eaf06ec4180c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:21.332552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1e88ccf8-1147-4232-9184-eaf06ec4180c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.158714 Jul 14 10:11:21.333503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1188/2373] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:21 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:21.352599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da98d554-73c6-4fcf-8531-db48b51083bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:21.361358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da98d554-73c6-4fcf-8531-db48b51083bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085962 Jul 14 10:11:21.361927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1186/2374] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:21 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:21.920568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-39896128-b193-441b-8124-d8ce5f5c01ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:21.921124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-39896128-b193-441b-8124-d8ce5f5c01ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:21.927487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39896128-b193-441b-8124-d8ce5f5c01ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:21.927930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39896128-b193-441b-8124-d8ce5f5c01ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:21.928682 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39896128-b193-441b-8124-d8ce5f5c01ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:21.929113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-39896128-b193-441b-8124-d8ce5f5c01ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:22.059384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-39896128-b193-441b-8124-d8ce5f5c01ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:22.068033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-39896128-b193-441b-8124-d8ce5f5c01ab tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151520 Jul 14 10:11:22.068588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1189/2375] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:22.350092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9f31f387-f259-4b94-82c9-4d7a54ece97a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:22.350740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9f31f387-f259-4b94-82c9-4d7a54ece97a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:22.357274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f31f387-f259-4b94-82c9-4d7a54ece97a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:22.357724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f31f387-f259-4b94-82c9-4d7a54ece97a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:22.358575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f31f387-f259-4b94-82c9-4d7a54ece97a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:22.359583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9f31f387-f259-4b94-82c9-4d7a54ece97a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:22.378502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4b797568-c496-47bc-afb4-974d6f38180f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:22.379088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4b797568-c496-47bc-afb4-974d6f38180f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:22.385393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b797568-c496-47bc-afb4-974d6f38180f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:22.385830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b797568-c496-47bc-afb4-974d6f38180f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:22.386615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b797568-c496-47bc-afb4-974d6f38180f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:22.387047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b797568-c496-47bc-afb4-974d6f38180f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:22.456767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4b797568-c496-47bc-afb4-974d6f38180f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:22.464721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4b797568-c496-47bc-afb4-974d6f38180f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090444 Jul 14 10:11:22.465418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1190/2376] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:22 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:22.513940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9f31f387-f259-4b94-82c9-4d7a54ece97a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:22.522336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9f31f387-f259-4b94-82c9-4d7a54ece97a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.176110 Jul 14 10:11:22.522914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1187/2377] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:22 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:23.085291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7da9ad42-0eb1-4760-96cd-cfa7d7032ace tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:23.085909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7da9ad42-0eb1-4760-96cd-cfa7d7032ace tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:23.091904 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7da9ad42-0eb1-4760-96cd-cfa7d7032ace tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:23.092341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7da9ad42-0eb1-4760-96cd-cfa7d7032ace tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:23.093083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7da9ad42-0eb1-4760-96cd-cfa7d7032ace tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:23.093506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7da9ad42-0eb1-4760-96cd-cfa7d7032ace tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:23.223064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7da9ad42-0eb1-4760-96cd-cfa7d7032ace tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:23.231032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7da9ad42-0eb1-4760-96cd-cfa7d7032ace tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.149817 Jul 14 10:11:23.231588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1191/2378] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:23.481692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-844095c0-3ddb-4328-a72a-3a1e600436f9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:23.482322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-844095c0-3ddb-4328-a72a-3a1e600436f9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:23.489466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-844095c0-3ddb-4328-a72a-3a1e600436f9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:23.489911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-844095c0-3ddb-4328-a72a-3a1e600436f9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:23.490697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-844095c0-3ddb-4328-a72a-3a1e600436f9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:23.491128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-844095c0-3ddb-4328-a72a-3a1e600436f9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:23.540206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5e44a4a6-fdee-4988-9713-3a3d1f6fbd9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:23.540788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5e44a4a6-fdee-4988-9713-3a3d1f6fbd9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:23.548047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e44a4a6-fdee-4988-9713-3a3d1f6fbd9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:23.548480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e44a4a6-fdee-4988-9713-3a3d1f6fbd9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:23.549247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e44a4a6-fdee-4988-9713-3a3d1f6fbd9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:23.549672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e44a4a6-fdee-4988-9713-3a3d1f6fbd9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:23.554253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-844095c0-3ddb-4328-a72a-3a1e600436f9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:23.563227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-844095c0-3ddb-4328-a72a-3a1e600436f9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085318 Jul 14 10:11:23.563810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1188/2379] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:23 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:23.683859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5e44a4a6-fdee-4988-9713-3a3d1f6fbd9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:23.686088 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:23.693998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5e44a4a6-fdee-4988-9713-3a3d1f6fbd9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157575 Jul 14 10:11:23.694597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1192/2380] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:23 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:24.248405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b83b62f1-b328-44ff-b0c1-5e927000f765 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:24.249008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b83b62f1-b328-44ff-b0c1-5e927000f765 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:24.255294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b83b62f1-b328-44ff-b0c1-5e927000f765 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:24.255737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b83b62f1-b328-44ff-b0c1-5e927000f765 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:24.256488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b83b62f1-b328-44ff-b0c1-5e927000f765 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:24.256917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b83b62f1-b328-44ff-b0c1-5e927000f765 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:24.383948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b83b62f1-b328-44ff-b0c1-5e927000f765 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:24.392415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b83b62f1-b328-44ff-b0c1-5e927000f765 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147883 Jul 14 10:11:24.392980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1189/2381] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:24 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:24.580489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f99d67e3-008f-45c4-9f34-ca4ed679164b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:24.581097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f99d67e3-008f-45c4-9f34-ca4ed679164b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:24.587644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f99d67e3-008f-45c4-9f34-ca4ed679164b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:24.588091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f99d67e3-008f-45c4-9f34-ca4ed679164b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:24.588849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f99d67e3-008f-45c4-9f34-ca4ed679164b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:24.589289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f99d67e3-008f-45c4-9f34-ca4ed679164b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:24.649987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f99d67e3-008f-45c4-9f34-ca4ed679164b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:24.657886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f99d67e3-008f-45c4-9f34-ca4ed679164b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081909 Jul 14 10:11:24.658477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1193/2382] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:24 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:24.710397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d8ce78a1-3586-4d44-9a3e-d7b2fa23da7f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:24.711138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d8ce78a1-3586-4d44-9a3e-d7b2fa23da7f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:24.717761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8ce78a1-3586-4d44-9a3e-d7b2fa23da7f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:24.718231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8ce78a1-3586-4d44-9a3e-d7b2fa23da7f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:24.719003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8ce78a1-3586-4d44-9a3e-d7b2fa23da7f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:24.719439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d8ce78a1-3586-4d44-9a3e-d7b2fa23da7f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:24.852852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d8ce78a1-3586-4d44-9a3e-d7b2fa23da7f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:24.860750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d8ce78a1-3586-4d44-9a3e-d7b2fa23da7f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154246 Jul 14 10:11:24.861313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1190/2383] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:24 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:25.409530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c2e5d8aa-74b6-42aa-afa9-d851a5432a39 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:25.410059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c2e5d8aa-74b6-42aa-afa9-d851a5432a39 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:25.416150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c2e5d8aa-74b6-42aa-afa9-d851a5432a39 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:25.416598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c2e5d8aa-74b6-42aa-afa9-d851a5432a39 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:25.417357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c2e5d8aa-74b6-42aa-afa9-d851a5432a39 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:25.417790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c2e5d8aa-74b6-42aa-afa9-d851a5432a39 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:25.547617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c2e5d8aa-74b6-42aa-afa9-d851a5432a39 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:25.555507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c2e5d8aa-74b6-42aa-afa9-d851a5432a39 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150483 Jul 14 10:11:25.556079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1194/2384] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:25 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:25.675459 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-db705dd1-c465-443c-93ee-b08f7dd7063d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:25.676054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-db705dd1-c465-443c-93ee-b08f7dd7063d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:25.682281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db705dd1-c465-443c-93ee-b08f7dd7063d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:25.682734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db705dd1-c465-443c-93ee-b08f7dd7063d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:25.683492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db705dd1-c465-443c-93ee-b08f7dd7063d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:25.683925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db705dd1-c465-443c-93ee-b08f7dd7063d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:25.745620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-db705dd1-c465-443c-93ee-b08f7dd7063d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:25.754127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-db705dd1-c465-443c-93ee-b08f7dd7063d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082902 Jul 14 10:11:25.754723 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1191/2385] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:25 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:25.877794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-88da32db-d560-4bf0-ba94-205e8d1d4a4b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:25.878460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-88da32db-d560-4bf0-ba94-205e8d1d4a4b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:25.885004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88da32db-d560-4bf0-ba94-205e8d1d4a4b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:25.885453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88da32db-d560-4bf0-ba94-205e8d1d4a4b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:25.886238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88da32db-d560-4bf0-ba94-205e8d1d4a4b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:25.886680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88da32db-d560-4bf0-ba94-205e8d1d4a4b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:26.021333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-88da32db-d560-4bf0-ba94-205e8d1d4a4b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:26.029314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-88da32db-d560-4bf0-ba94-205e8d1d4a4b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155416 Jul 14 10:11:26.029873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1195/2386] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:25 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:26.572657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0588b872-990c-46de-9c7a-bd8a3335494e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:26.573267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0588b872-990c-46de-9c7a-bd8a3335494e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:26.579283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0588b872-990c-46de-9c7a-bd8a3335494e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:26.579724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0588b872-990c-46de-9c7a-bd8a3335494e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:26.580470 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0588b872-990c-46de-9c7a-bd8a3335494e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:26.580903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0588b872-990c-46de-9c7a-bd8a3335494e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:26.583401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:26.713030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0588b872-990c-46de-9c7a-bd8a3335494e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:26.721609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0588b872-990c-46de-9c7a-bd8a3335494e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152765 Jul 14 10:11:26.722169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1192/2387] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:26.770885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f366028e-5a66-475d-a823-82bfa69b7d14 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:26.771488 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f366028e-5a66-475d-a823-82bfa69b7d14 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:26.777451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f366028e-5a66-475d-a823-82bfa69b7d14 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:26.777886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f366028e-5a66-475d-a823-82bfa69b7d14 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:26.778673 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f366028e-5a66-475d-a823-82bfa69b7d14 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:26.779103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f366028e-5a66-475d-a823-82bfa69b7d14 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:26.842776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f366028e-5a66-475d-a823-82bfa69b7d14 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:26.851381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f366028e-5a66-475d-a823-82bfa69b7d14 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084368 Jul 14 10:11:26.851954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1196/2388] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:26 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:27.046016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-401044e1-a7fc-4624-a2b1-531d25a5c293 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:27.047486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-401044e1-a7fc-4624-a2b1-531d25a5c293 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:27.053535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-401044e1-a7fc-4624-a2b1-531d25a5c293 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:27.053981 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-401044e1-a7fc-4624-a2b1-531d25a5c293 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:27.054769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-401044e1-a7fc-4624-a2b1-531d25a5c293 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:27.055205 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-401044e1-a7fc-4624-a2b1-531d25a5c293 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:27.181011 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-401044e1-a7fc-4624-a2b1-531d25a5c293 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:27.188974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-401044e1-a7fc-4624-a2b1-531d25a5c293 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146819 Jul 14 10:11:27.189535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1193/2389] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:27 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:27.738799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-de9e8018-20fe-4271-9699-d07f5d29cf0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:27.739444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-de9e8018-20fe-4271-9699-d07f5d29cf0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:27.745453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de9e8018-20fe-4271-9699-d07f5d29cf0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:27.745899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de9e8018-20fe-4271-9699-d07f5d29cf0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:27.746681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de9e8018-20fe-4271-9699-d07f5d29cf0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:27.747115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de9e8018-20fe-4271-9699-d07f5d29cf0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:27.869020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-43295609-b686-4841-b812-1eed5d4b3153 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:27.869625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-43295609-b686-4841-b812-1eed5d4b3153 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:27.873958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-de9e8018-20fe-4271-9699-d07f5d29cf0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:27.876772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43295609-b686-4841-b812-1eed5d4b3153 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:27.877215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43295609-b686-4841-b812-1eed5d4b3153 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:27.877979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43295609-b686-4841-b812-1eed5d4b3153 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:27.878435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-43295609-b686-4841-b812-1eed5d4b3153 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:27.882441 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-de9e8018-20fe-4271-9699-d07f5d29cf0e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147961 Jul 14 10:11:27.883015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1197/2390] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:27.943575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-43295609-b686-4841-b812-1eed5d4b3153 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:27.952323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-43295609-b686-4841-b812-1eed5d4b3153 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087121 Jul 14 10:11:27.952886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1194/2391] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:27 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:28.206051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-00de27bb-f6a8-4b9a-9fce-d82840dc8839 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:28.206725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-00de27bb-f6a8-4b9a-9fce-d82840dc8839 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:28.212870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00de27bb-f6a8-4b9a-9fce-d82840dc8839 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:28.213311 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00de27bb-f6a8-4b9a-9fce-d82840dc8839 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:28.214063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00de27bb-f6a8-4b9a-9fce-d82840dc8839 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:28.214515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00de27bb-f6a8-4b9a-9fce-d82840dc8839 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:28.343740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-00de27bb-f6a8-4b9a-9fce-d82840dc8839 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:28.351674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-00de27bb-f6a8-4b9a-9fce-d82840dc8839 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150006 Jul 14 10:11:28.352228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1198/2392] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:28 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:28.900343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9d2fab41-06b3-4607-9d2c-b5f3ffa37917 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:28.900912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9d2fab41-06b3-4607-9d2c-b5f3ffa37917 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:28.908248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d2fab41-06b3-4607-9d2c-b5f3ffa37917 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:28.908696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d2fab41-06b3-4607-9d2c-b5f3ffa37917 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:28.909462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d2fab41-06b3-4607-9d2c-b5f3ffa37917 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:28.909895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d2fab41-06b3-4607-9d2c-b5f3ffa37917 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:28.969844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef2b3f63-ea7e-417a-ad3e-c692f6008e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:28.970459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ef2b3f63-ea7e-417a-ad3e-c692f6008e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:28.977616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef2b3f63-ea7e-417a-ad3e-c692f6008e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:28.978163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef2b3f63-ea7e-417a-ad3e-c692f6008e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:28.978860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef2b3f63-ea7e-417a-ad3e-c692f6008e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:28.979285 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef2b3f63-ea7e-417a-ad3e-c692f6008e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:29.048659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ef2b3f63-ea7e-417a-ad3e-c692f6008e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:29.057187 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ef2b3f63-ea7e-417a-ad3e-c692f6008e7d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.092151 Jul 14 10:11:29.057772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1199/2393] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:28 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:29.069339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9d2fab41-06b3-4607-9d2c-b5f3ffa37917 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:29.077346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9d2fab41-06b3-4607-9d2c-b5f3ffa37917 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.180985 Jul 14 10:11:29.077903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1195/2394] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:29.368764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1ecedf4d-747a-4840-a942-70d54d8cc878 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:29.369478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ecedf4d-747a-4840-a942-70d54d8cc878 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:29.376144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ecedf4d-747a-4840-a942-70d54d8cc878 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:29.376596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ecedf4d-747a-4840-a942-70d54d8cc878 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:29.377355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ecedf4d-747a-4840-a942-70d54d8cc878 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:29.377786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ecedf4d-747a-4840-a942-70d54d8cc878 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:29.506286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1ecedf4d-747a-4840-a942-70d54d8cc878 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:29.514147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1ecedf4d-747a-4840-a942-70d54d8cc878 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149254 Jul 14 10:11:29.514729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1200/2395] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:29 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:30.074403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4334f249-0520-4097-902d-e1539da3f414 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:30.074965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4334f249-0520-4097-902d-e1539da3f414 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:30.081544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4334f249-0520-4097-902d-e1539da3f414 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:30.081987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4334f249-0520-4097-902d-e1539da3f414 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:30.082788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4334f249-0520-4097-902d-e1539da3f414 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:30.083220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4334f249-0520-4097-902d-e1539da3f414 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:30.094917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8fa9db30-1855-4415-b74c-3c7d3b58d7fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:30.095518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8fa9db30-1855-4415-b74c-3c7d3b58d7fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:30.101903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fa9db30-1855-4415-b74c-3c7d3b58d7fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:30.102379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fa9db30-1855-4415-b74c-3c7d3b58d7fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:30.103325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fa9db30-1855-4415-b74c-3c7d3b58d7fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:30.103813 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fa9db30-1855-4415-b74c-3c7d3b58d7fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:30.150071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4334f249-0520-4097-902d-e1539da3f414 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:30.159203 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4334f249-0520-4097-902d-e1539da3f414 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088776 Jul 14 10:11:30.159779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1196/2396] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:30 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:30.246099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8fa9db30-1855-4415-b74c-3c7d3b58d7fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:30.253978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8fa9db30-1855-4415-b74c-3c7d3b58d7fc tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.163479 Jul 14 10:11:30.254559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1201/2397] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:30 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:30.531503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a54dae9f-4e61-4678-94e0-18d382457040 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:30.532106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a54dae9f-4e61-4678-94e0-18d382457040 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:30.538320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a54dae9f-4e61-4678-94e0-18d382457040 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:30.538769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a54dae9f-4e61-4678-94e0-18d382457040 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:30.539521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a54dae9f-4e61-4678-94e0-18d382457040 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:30.539951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a54dae9f-4e61-4678-94e0-18d382457040 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:30.666605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a54dae9f-4e61-4678-94e0-18d382457040 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:30.676192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a54dae9f-4e61-4678-94e0-18d382457040 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148489 Jul 14 10:11:30.676874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1197/2398] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:30 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:31.176969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fb651df6-e8fa-48ad-84f1-43ab8808ca13 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:31.177563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fb651df6-e8fa-48ad-84f1-43ab8808ca13 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:31.184159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb651df6-e8fa-48ad-84f1-43ab8808ca13 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:31.184602 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb651df6-e8fa-48ad-84f1-43ab8808ca13 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:31.185359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb651df6-e8fa-48ad-84f1-43ab8808ca13 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:31.185790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fb651df6-e8fa-48ad-84f1-43ab8808ca13 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:31.246733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fb651df6-e8fa-48ad-84f1-43ab8808ca13 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:31.255478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fb651df6-e8fa-48ad-84f1-43ab8808ca13 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082408 Jul 14 10:11:31.256037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1202/2399] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:31 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:31.270869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-662e90fa-1f6f-4b9a-99ee-353854fb2e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:31.271479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-662e90fa-1f6f-4b9a-99ee-353854fb2e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:31.273809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=82 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:31.279484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-662e90fa-1f6f-4b9a-99ee-353854fb2e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:31.279933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-662e90fa-1f6f-4b9a-99ee-353854fb2e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:31.281198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-662e90fa-1f6f-4b9a-99ee-353854fb2e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:31.281628 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-662e90fa-1f6f-4b9a-99ee-353854fb2e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:31.410939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-662e90fa-1f6f-4b9a-99ee-353854fb2e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:31.419028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-662e90fa-1f6f-4b9a-99ee-353854fb2e8d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152005 Jul 14 10:11:31.419594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1198/2400] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:31.693880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7d4d9869-688b-4549-b262-51a5d5663844 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:31.694593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7d4d9869-688b-4549-b262-51a5d5663844 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:31.700695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d4d9869-688b-4549-b262-51a5d5663844 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:31.701140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d4d9869-688b-4549-b262-51a5d5663844 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:31.701894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d4d9869-688b-4549-b262-51a5d5663844 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:31.702882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7d4d9869-688b-4549-b262-51a5d5663844 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:31.828840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7d4d9869-688b-4549-b262-51a5d5663844 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:31.836732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7d4d9869-688b-4549-b262-51a5d5663844 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147047 Jul 14 10:11:31.837294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1203/2401] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:31 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:32.272381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7e1efb23-7fbb-4ea5-937b-37eecec75c90 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:32.272964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7e1efb23-7fbb-4ea5-937b-37eecec75c90 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:32.279877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e1efb23-7fbb-4ea5-937b-37eecec75c90 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:32.280335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e1efb23-7fbb-4ea5-937b-37eecec75c90 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:32.281087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e1efb23-7fbb-4ea5-937b-37eecec75c90 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:32.281515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7e1efb23-7fbb-4ea5-937b-37eecec75c90 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:32.342563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7e1efb23-7fbb-4ea5-937b-37eecec75c90 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:32.350483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7e1efb23-7fbb-4ea5-937b-37eecec75c90 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081909 Jul 14 10:11:32.351039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1199/2402] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:32 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:32.437515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5de205a9-835c-4b86-b646-9b4b8142ba01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:32.438147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5de205a9-835c-4b86-b646-9b4b8142ba01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:32.444340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5de205a9-835c-4b86-b646-9b4b8142ba01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:32.444787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5de205a9-835c-4b86-b646-9b4b8142ba01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:32.445552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5de205a9-835c-4b86-b646-9b4b8142ba01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:32.445982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5de205a9-835c-4b86-b646-9b4b8142ba01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:32.578255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5de205a9-835c-4b86-b646-9b4b8142ba01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:32.586356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5de205a9-835c-4b86-b646-9b4b8142ba01 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153370 Jul 14 10:11:32.586917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1204/2403] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:32.853917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3f88613f-a959-44e0-bc68-a347dd0a5cd2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:32.854472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3f88613f-a959-44e0-bc68-a347dd0a5cd2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:32.861782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f88613f-a959-44e0-bc68-a347dd0a5cd2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:32.862279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f88613f-a959-44e0-bc68-a347dd0a5cd2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:32.863063 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f88613f-a959-44e0-bc68-a347dd0a5cd2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:32.863504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f88613f-a959-44e0-bc68-a347dd0a5cd2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:32.989616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3f88613f-a959-44e0-bc68-a347dd0a5cd2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:32.997659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3f88613f-a959-44e0-bc68-a347dd0a5cd2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147666 Jul 14 10:11:32.998235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1200/2404] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:32 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:33.367411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-51692431-66bd-4272-9ec1-9eac848a7b15 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:33.368014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-51692431-66bd-4272-9ec1-9eac848a7b15 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:33.375140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51692431-66bd-4272-9ec1-9eac848a7b15 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:33.375701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51692431-66bd-4272-9ec1-9eac848a7b15 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:33.376287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51692431-66bd-4272-9ec1-9eac848a7b15 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:33.376713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-51692431-66bd-4272-9ec1-9eac848a7b15 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:33.437646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-51692431-66bd-4272-9ec1-9eac848a7b15 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:33.445592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-51692431-66bd-4272-9ec1-9eac848a7b15 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082034 Jul 14 10:11:33.446151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1205/2405] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:33 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:33.603399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4530a5c2-edac-46b9-b7d7-e32a18c68482 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:33.604013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4530a5c2-edac-46b9-b7d7-e32a18c68482 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:33.611137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4530a5c2-edac-46b9-b7d7-e32a18c68482 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:33.611585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4530a5c2-edac-46b9-b7d7-e32a18c68482 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:33.612339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4530a5c2-edac-46b9-b7d7-e32a18c68482 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:33.612775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4530a5c2-edac-46b9-b7d7-e32a18c68482 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:33.747477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4530a5c2-edac-46b9-b7d7-e32a18c68482 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:33.755785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4530a5c2-edac-46b9-b7d7-e32a18c68482 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.156205 Jul 14 10:11:33.756368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1201/2406] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:34.015618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-18c5c118-a596-41b8-a656-ae6d23d546a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:34.016577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-18c5c118-a596-41b8-a656-ae6d23d546a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:34.024574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18c5c118-a596-41b8-a656-ae6d23d546a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:34.025018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18c5c118-a596-41b8-a656-ae6d23d546a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:34.025792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18c5c118-a596-41b8-a656-ae6d23d546a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:34.026406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-18c5c118-a596-41b8-a656-ae6d23d546a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:34.159099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-18c5c118-a596-41b8-a656-ae6d23d546a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:34.166945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-18c5c118-a596-41b8-a656-ae6d23d546a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155782 Jul 14 10:11:34.167511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1206/2407] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:34 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:34.462596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8d7e5afa-3f03-42a7-9704-fd144efb7d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:34.463234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8d7e5afa-3f03-42a7-9704-fd144efb7d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:34.469243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d7e5afa-3f03-42a7-9704-fd144efb7d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:34.469691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d7e5afa-3f03-42a7-9704-fd144efb7d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:34.470479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d7e5afa-3f03-42a7-9704-fd144efb7d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:34.470906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8d7e5afa-3f03-42a7-9704-fd144efb7d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:34.534580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8d7e5afa-3f03-42a7-9704-fd144efb7d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:34.542496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8d7e5afa-3f03-42a7-9704-fd144efb7d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083793 Jul 14 10:11:34.543047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1202/2408] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:34 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:34.773289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a933c857-7d99-401c-a50f-af3fbd40d977 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:34.773840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a933c857-7d99-401c-a50f-af3fbd40d977 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:34.780290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a933c857-7d99-401c-a50f-af3fbd40d977 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:34.780731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a933c857-7d99-401c-a50f-af3fbd40d977 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:34.781476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a933c857-7d99-401c-a50f-af3fbd40d977 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:34.781985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a933c857-7d99-401c-a50f-af3fbd40d977 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:34.908657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a933c857-7d99-401c-a50f-af3fbd40d977 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:34.916569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a933c857-7d99-401c-a50f-af3fbd40d977 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147259 Jul 14 10:11:34.917124 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1207/2409] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:35.184516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1653729e-a253-4297-8b53-b7e63d36a6b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:35.185127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1653729e-a253-4297-8b53-b7e63d36a6b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:35.191736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1653729e-a253-4297-8b53-b7e63d36a6b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:35.192182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1653729e-a253-4297-8b53-b7e63d36a6b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:35.192940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1653729e-a253-4297-8b53-b7e63d36a6b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:35.193369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1653729e-a253-4297-8b53-b7e63d36a6b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:35.319253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1653729e-a253-4297-8b53-b7e63d36a6b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:35.327183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1653729e-a253-4297-8b53-b7e63d36a6b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.146554 Jul 14 10:11:35.327745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1203/2410] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:35 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:35.559836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-da3ed540-66a5-433f-9243-f1a800d25494 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:35.560436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-da3ed540-66a5-433f-9243-f1a800d25494 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:35.566588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da3ed540-66a5-433f-9243-f1a800d25494 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:35.567022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da3ed540-66a5-433f-9243-f1a800d25494 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:35.567765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da3ed540-66a5-433f-9243-f1a800d25494 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:35.568186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-da3ed540-66a5-433f-9243-f1a800d25494 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:35.630664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-da3ed540-66a5-433f-9243-f1a800d25494 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:35.638581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-da3ed540-66a5-433f-9243-f1a800d25494 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082521 Jul 14 10:11:35.639122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1208/2411] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:35 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:35.933911 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e2649c02-b019-4f1c-ab32-c056ab4659c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:35.934546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e2649c02-b019-4f1c-ab32-c056ab4659c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:35.941123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2649c02-b019-4f1c-ab32-c056ab4659c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:35.941645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2649c02-b019-4f1c-ab32-c056ab4659c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:35.942420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2649c02-b019-4f1c-ab32-c056ab4659c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:35.942854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2649c02-b019-4f1c-ab32-c056ab4659c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:36.075238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e2649c02-b019-4f1c-ab32-c056ab4659c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:36.084080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e2649c02-b019-4f1c-ab32-c056ab4659c2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153968 Jul 14 10:11:36.085064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1204/2412] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:35 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:36.344290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c5b7d201-2e2a-410d-8f6c-cf0815325f6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:36.344833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c5b7d201-2e2a-410d-8f6c-cf0815325f6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:36.351308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c5b7d201-2e2a-410d-8f6c-cf0815325f6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:36.351747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c5b7d201-2e2a-410d-8f6c-cf0815325f6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:36.352496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c5b7d201-2e2a-410d-8f6c-cf0815325f6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:36.352926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c5b7d201-2e2a-410d-8f6c-cf0815325f6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:36.368569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:36.484880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c5b7d201-2e2a-410d-8f6c-cf0815325f6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:36.492743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c5b7d201-2e2a-410d-8f6c-cf0815325f6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.152405 Jul 14 10:11:36.493302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1209/2413] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:36 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:36.657370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bfd54dd4-04f6-4aa9-8bed-6b6df1b09f02 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:36.657921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bfd54dd4-04f6-4aa9-8bed-6b6df1b09f02 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:36.664392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd54dd4-04f6-4aa9-8bed-6b6df1b09f02 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:36.664841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd54dd4-04f6-4aa9-8bed-6b6df1b09f02 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:36.665593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd54dd4-04f6-4aa9-8bed-6b6df1b09f02 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:36.666054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd54dd4-04f6-4aa9-8bed-6b6df1b09f02 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:36.731679 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bfd54dd4-04f6-4aa9-8bed-6b6df1b09f02 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:36.741113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bfd54dd4-04f6-4aa9-8bed-6b6df1b09f02 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088313 Jul 14 10:11:36.741678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1205/2414] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:36 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:37.101425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-16d30917-a801-4a41-92d7-c12faf0adf33 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:37.102028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-16d30917-a801-4a41-92d7-c12faf0adf33 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:37.108133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16d30917-a801-4a41-92d7-c12faf0adf33 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:37.108569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16d30917-a801-4a41-92d7-c12faf0adf33 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:37.109455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16d30917-a801-4a41-92d7-c12faf0adf33 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:37.109824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16d30917-a801-4a41-92d7-c12faf0adf33 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:37.237380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-16d30917-a801-4a41-92d7-c12faf0adf33 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:37.245316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-16d30917-a801-4a41-92d7-c12faf0adf33 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147794 Jul 14 10:11:37.245867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1210/2415] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:37.510370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fad3f0c8-5664-4b4f-8052-a5f76759616d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:37.510928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fad3f0c8-5664-4b4f-8052-a5f76759616d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:37.517630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fad3f0c8-5664-4b4f-8052-a5f76759616d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:37.518073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fad3f0c8-5664-4b4f-8052-a5f76759616d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:37.518858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fad3f0c8-5664-4b4f-8052-a5f76759616d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:37.519286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fad3f0c8-5664-4b4f-8052-a5f76759616d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:37.646606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fad3f0c8-5664-4b4f-8052-a5f76759616d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:37.654466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fad3f0c8-5664-4b4f-8052-a5f76759616d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147981 Jul 14 10:11:37.655029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1206/2416] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:37 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:37.757966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-718b0274-54dc-41f7-ae96-036a05de192e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:37.758619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-718b0274-54dc-41f7-ae96-036a05de192e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:37.765151 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-718b0274-54dc-41f7-ae96-036a05de192e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:37.765522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-718b0274-54dc-41f7-ae96-036a05de192e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:37.766355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-718b0274-54dc-41f7-ae96-036a05de192e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:37.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-718b0274-54dc-41f7-ae96-036a05de192e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:37.830458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-718b0274-54dc-41f7-ae96-036a05de192e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:37.838616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-718b0274-54dc-41f7-ae96-036a05de192e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084534 Jul 14 10:11:37.839177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1211/2417] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:37 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:38.263818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0ee681f3-ea78-4052-8f79-0fd297f09d2a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:38.264425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0ee681f3-ea78-4052-8f79-0fd297f09d2a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:38.271089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ee681f3-ea78-4052-8f79-0fd297f09d2a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:38.271529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ee681f3-ea78-4052-8f79-0fd297f09d2a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:38.272275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ee681f3-ea78-4052-8f79-0fd297f09d2a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:38.272705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ee681f3-ea78-4052-8f79-0fd297f09d2a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:38.402540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0ee681f3-ea78-4052-8f79-0fd297f09d2a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:38.412539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0ee681f3-ea78-4052-8f79-0fd297f09d2a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152534 Jul 14 10:11:38.413159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1207/2418] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:38.671823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-612f7215-2ce2-46be-9a19-0977c4214676 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:38.672761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-612f7215-2ce2-46be-9a19-0977c4214676 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:38.679020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-612f7215-2ce2-46be-9a19-0977c4214676 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:38.679464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-612f7215-2ce2-46be-9a19-0977c4214676 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:38.680212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-612f7215-2ce2-46be-9a19-0977c4214676 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:38.680642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-612f7215-2ce2-46be-9a19-0977c4214676 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:38.808884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-612f7215-2ce2-46be-9a19-0977c4214676 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:38.817356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-612f7215-2ce2-46be-9a19-0977c4214676 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149387 Jul 14 10:11:38.817925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1212/2419] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:38 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:38.855791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-19dd5a87-cc76-416a-a2b5-af79c8a4e9f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:38.856398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-19dd5a87-cc76-416a-a2b5-af79c8a4e9f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:38.862528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-19dd5a87-cc76-416a-a2b5-af79c8a4e9f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:38.862979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-19dd5a87-cc76-416a-a2b5-af79c8a4e9f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:38.863729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-19dd5a87-cc76-416a-a2b5-af79c8a4e9f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:38.864162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-19dd5a87-cc76-416a-a2b5-af79c8a4e9f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:38.929076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-19dd5a87-cc76-416a-a2b5-af79c8a4e9f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:38.931298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:38.939093 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-19dd5a87-cc76-416a-a2b5-af79c8a4e9f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087115 Jul 14 10:11:38.939670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1208/2420] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:38 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:39.430426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-45818620-2327-488c-84cf-145d737acee0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:39.431034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-45818620-2327-488c-84cf-145d737acee0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:39.437845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45818620-2327-488c-84cf-145d737acee0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:39.438386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45818620-2327-488c-84cf-145d737acee0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:39.439261 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45818620-2327-488c-84cf-145d737acee0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:39.439689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-45818620-2327-488c-84cf-145d737acee0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:39.567437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-45818620-2327-488c-84cf-145d737acee0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:39.575302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-45818620-2327-488c-84cf-145d737acee0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148888 Jul 14 10:11:39.575860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1213/2421] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:39.834500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d79bee25-c44b-4382-b6da-16e02c6c458d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:39.835110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d79bee25-c44b-4382-b6da-16e02c6c458d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:39.841756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d79bee25-c44b-4382-b6da-16e02c6c458d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:39.842228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d79bee25-c44b-4382-b6da-16e02c6c458d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:39.843010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d79bee25-c44b-4382-b6da-16e02c6c458d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:39.843448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d79bee25-c44b-4382-b6da-16e02c6c458d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:39.956231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-90a8aa26-ec51-4006-911e-820424da5756 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:39.956794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-90a8aa26-ec51-4006-911e-820424da5756 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:39.963043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90a8aa26-ec51-4006-911e-820424da5756 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:39.963482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90a8aa26-ec51-4006-911e-820424da5756 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:39.964421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90a8aa26-ec51-4006-911e-820424da5756 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:39.964856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-90a8aa26-ec51-4006-911e-820424da5756 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:39.970549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d79bee25-c44b-4382-b6da-16e02c6c458d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:39.978560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d79bee25-c44b-4382-b6da-16e02c6c458d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.147931 Jul 14 10:11:39.979133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1209/2422] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:39 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:40.032368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-90a8aa26-ec51-4006-911e-820424da5756 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:40.040631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-90a8aa26-ec51-4006-911e-820424da5756 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088461 Jul 14 10:11:40.041197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1214/2423] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:39 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:40.592637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6bacae2c-b654-47f9-b8ee-a43fcf9adb0a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:40.593759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6bacae2c-b654-47f9-b8ee-a43fcf9adb0a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:40.599923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bacae2c-b654-47f9-b8ee-a43fcf9adb0a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:40.600366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bacae2c-b654-47f9-b8ee-a43fcf9adb0a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:40.601111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bacae2c-b654-47f9-b8ee-a43fcf9adb0a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:40.601540 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bacae2c-b654-47f9-b8ee-a43fcf9adb0a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:40.732442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6bacae2c-b654-47f9-b8ee-a43fcf9adb0a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:40.741137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6bacae2c-b654-47f9-b8ee-a43fcf9adb0a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152525 Jul 14 10:11:40.741705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1210/2424] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:40.996158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-acca887c-7bd5-4e23-9922-7d085584d168 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:40.996760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-acca887c-7bd5-4e23-9922-7d085584d168 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:40.999050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=82 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:41.004762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acca887c-7bd5-4e23-9922-7d085584d168 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:41.005206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acca887c-7bd5-4e23-9922-7d085584d168 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:41.005954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acca887c-7bd5-4e23-9922-7d085584d168 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:41.006413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-acca887c-7bd5-4e23-9922-7d085584d168 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:41.057904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eda4b749-c2c9-4e88-a272-963b8b113405 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:41.058546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-eda4b749-c2c9-4e88-a272-963b8b113405 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:41.065261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eda4b749-c2c9-4e88-a272-963b8b113405 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:41.065707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eda4b749-c2c9-4e88-a272-963b8b113405 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:41.066493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eda4b749-c2c9-4e88-a272-963b8b113405 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:41.066926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eda4b749-c2c9-4e88-a272-963b8b113405 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:41.141380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-eda4b749-c2c9-4e88-a272-963b8b113405 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:41.149268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eda4b749-c2c9-4e88-a272-963b8b113405 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.095124 Jul 14 10:11:41.149820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1211/2425] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:41.162353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-acca887c-7bd5-4e23-9922-7d085584d168 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:41.170238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-acca887c-7bd5-4e23-9922-7d085584d168 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.177909 Jul 14 10:11:41.170826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1215/2426] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:40 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:41.758436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e21c17e7-0e33-4cf4-b5b6-9a739bdc5477 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:41.759072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e21c17e7-0e33-4cf4-b5b6-9a739bdc5477 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:41.765560 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e21c17e7-0e33-4cf4-b5b6-9a739bdc5477 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:41.766000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e21c17e7-0e33-4cf4-b5b6-9a739bdc5477 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:41.766781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e21c17e7-0e33-4cf4-b5b6-9a739bdc5477 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:41.767212 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e21c17e7-0e33-4cf4-b5b6-9a739bdc5477 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:42.152201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e21c17e7-0e33-4cf4-b5b6-9a739bdc5477 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:42.161286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e21c17e7-0e33-4cf4-b5b6-9a739bdc5477 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.406590 Jul 14 10:11:42.162167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1212/2427] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:42.166036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8163f9d2-bd32-4e12-af48-ddd58d170f8e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:42.166671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8163f9d2-bd32-4e12-af48-ddd58d170f8e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:42.173415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8163f9d2-bd32-4e12-af48-ddd58d170f8e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:42.173861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8163f9d2-bd32-4e12-af48-ddd58d170f8e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:42.174631 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8163f9d2-bd32-4e12-af48-ddd58d170f8e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:42.175054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8163f9d2-bd32-4e12-af48-ddd58d170f8e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:42.187360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0524a5f7-bc98-4fb1-a8a4-bcc68d5491c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:42.187976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0524a5f7-bc98-4fb1-a8a4-bcc68d5491c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:42.194069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0524a5f7-bc98-4fb1-a8a4-bcc68d5491c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:42.194547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0524a5f7-bc98-4fb1-a8a4-bcc68d5491c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:42.195311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0524a5f7-bc98-4fb1-a8a4-bcc68d5491c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:42.195743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0524a5f7-bc98-4fb1-a8a4-bcc68d5491c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:42.238309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8163f9d2-bd32-4e12-af48-ddd58d170f8e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:42.246341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8163f9d2-bd32-4e12-af48-ddd58d170f8e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083994 Jul 14 10:11:42.246909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1216/2428] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:42 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:42.331599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0524a5f7-bc98-4fb1-a8a4-bcc68d5491c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:42.339457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0524a5f7-bc98-4fb1-a8a4-bcc68d5491c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155955 Jul 14 10:11:42.340015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1213/2429] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:42 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:43.178607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-32688066-c38f-4dcd-a50b-87cc4a0d8bf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:43.179212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-32688066-c38f-4dcd-a50b-87cc4a0d8bf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:43.185629 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32688066-c38f-4dcd-a50b-87cc4a0d8bf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:43.186065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32688066-c38f-4dcd-a50b-87cc4a0d8bf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:43.187433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32688066-c38f-4dcd-a50b-87cc4a0d8bf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:43.188015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-32688066-c38f-4dcd-a50b-87cc4a0d8bf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:43.263706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b4c59f19-e513-44a6-a216-523348d42bbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:43.264087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b4c59f19-e513-44a6-a216-523348d42bbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:43.271472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4c59f19-e513-44a6-a216-523348d42bbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:43.271926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4c59f19-e513-44a6-a216-523348d42bbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:43.272699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4c59f19-e513-44a6-a216-523348d42bbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:43.273372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b4c59f19-e513-44a6-a216-523348d42bbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:43.326477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-32688066-c38f-4dcd-a50b-87cc4a0d8bf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:43.334524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-32688066-c38f-4dcd-a50b-87cc4a0d8bf9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.159768 Jul 14 10:11:43.335096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1217/2430] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:43.342795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b4c59f19-e513-44a6-a216-523348d42bbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:43.351347 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b4c59f19-e513-44a6-a216-523348d42bbf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091949 Jul 14 10:11:43.352068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1214/2431] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:43.356910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4a0f3450-1312-4726-9e7c-c8924223daa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:43.357521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4a0f3450-1312-4726-9e7c-c8924223daa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:43.364309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a0f3450-1312-4726-9e7c-c8924223daa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:43.364753 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a0f3450-1312-4726-9e7c-c8924223daa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:43.365514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a0f3450-1312-4726-9e7c-c8924223daa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:43.365947 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4a0f3450-1312-4726-9e7c-c8924223daa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:43.496868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4a0f3450-1312-4726-9e7c-c8924223daa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:43.504803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4a0f3450-1312-4726-9e7c-c8924223daa2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151719 Jul 14 10:11:43.505371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1218/2432] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:43 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:44.352394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c212c23c-e0ba-4bea-8713-66d00e8fecba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:44.352991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c212c23c-e0ba-4bea-8713-66d00e8fecba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:44.359608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c212c23c-e0ba-4bea-8713-66d00e8fecba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:44.360051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c212c23c-e0ba-4bea-8713-66d00e8fecba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:44.360800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c212c23c-e0ba-4bea-8713-66d00e8fecba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:44.361232 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c212c23c-e0ba-4bea-8713-66d00e8fecba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:44.368742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3ed57bab-b3c3-49cb-a999-44e68faac298 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:44.369348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3ed57bab-b3c3-49cb-a999-44e68faac298 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:44.376419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3ed57bab-b3c3-49cb-a999-44e68faac298 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:44.376861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3ed57bab-b3c3-49cb-a999-44e68faac298 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:44.377630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3ed57bab-b3c3-49cb-a999-44e68faac298 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:44.378064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3ed57bab-b3c3-49cb-a999-44e68faac298 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:44.462699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3ed57bab-b3c3-49cb-a999-44e68faac298 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:44.470845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3ed57bab-b3c3-49cb-a999-44e68faac298 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.105908 Jul 14 10:11:44.471425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1219/2433] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:44 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:44.520993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-60570a27-1b7c-4fac-ab76-c38d8716ea9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:44.521441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c212c23c-e0ba-4bea-8713-66d00e8fecba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:44.521589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-60570a27-1b7c-4fac-ab76-c38d8716ea9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:44.527912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60570a27-1b7c-4fac-ab76-c38d8716ea9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:44.528355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60570a27-1b7c-4fac-ab76-c38d8716ea9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:44.529139 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60570a27-1b7c-4fac-ab76-c38d8716ea9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:44.529563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60570a27-1b7c-4fac-ab76-c38d8716ea9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:44.529812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c212c23c-e0ba-4bea-8713-66d00e8fecba tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.181207 Jul 14 10:11:44.530467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1215/2434] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:44.658722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-60570a27-1b7c-4fac-ab76-c38d8716ea9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:44.666750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-60570a27-1b7c-4fac-ab76-c38d8716ea9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149567 Jul 14 10:11:44.667321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1220/2435] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:44 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:45.487751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2e4d4c1a-651e-4921-bdd7-07c1cd237f45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:45.488382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2e4d4c1a-651e-4921-bdd7-07c1cd237f45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:45.494887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c1a-651e-4921-bdd7-07c1cd237f45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:45.495333 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c1a-651e-4921-bdd7-07c1cd237f45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:45.496077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c1a-651e-4921-bdd7-07c1cd237f45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:45.496507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e4d4c1a-651e-4921-bdd7-07c1cd237f45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:45.547860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1c3fc057-23c7-41c9-9275-73dcb457e2a1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:45.548461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1c3fc057-23c7-41c9-9275-73dcb457e2a1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:45.555527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c3fc057-23c7-41c9-9275-73dcb457e2a1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:45.556294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c3fc057-23c7-41c9-9275-73dcb457e2a1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:45.557131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c3fc057-23c7-41c9-9275-73dcb457e2a1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:45.557712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1c3fc057-23c7-41c9-9275-73dcb457e2a1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:45.557944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2e4d4c1a-651e-4921-bdd7-07c1cd237f45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:45.566620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2e4d4c1a-651e-4921-bdd7-07c1cd237f45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082792 Jul 14 10:11:45.567185 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1216/2436] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:45 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:45.685803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-02d2a367-9223-4bdc-b1c6-37acec2880da tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:45.687443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-02d2a367-9223-4bdc-b1c6-37acec2880da tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:45.688949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1c3fc057-23c7-41c9-9275-73dcb457e2a1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:45.697998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02d2a367-9223-4bdc-b1c6-37acec2880da tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:45.698755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02d2a367-9223-4bdc-b1c6-37acec2880da tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:45.700009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02d2a367-9223-4bdc-b1c6-37acec2880da tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:45.700727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-02d2a367-9223-4bdc-b1c6-37acec2880da tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:45.702288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1c3fc057-23c7-41c9-9275-73dcb457e2a1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.158187 Jul 14 10:11:45.707792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1221/2437] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:45 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:45.833335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-02d2a367-9223-4bdc-b1c6-37acec2880da tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:45.841267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-02d2a367-9223-4bdc-b1c6-37acec2880da tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.160524 Jul 14 10:11:45.841832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1217/2438] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:45 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:46.583690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e4e08e81-7c33-421e-a623-0372cf55374b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:46.584296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e4e08e81-7c33-421e-a623-0372cf55374b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:46.590879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e08e81-7c33-421e-a623-0372cf55374b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:46.591319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e08e81-7c33-421e-a623-0372cf55374b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:46.592067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e08e81-7c33-421e-a623-0372cf55374b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:46.592495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4e08e81-7c33-421e-a623-0372cf55374b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:46.653678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e4e08e81-7c33-421e-a623-0372cf55374b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:46.662280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e4e08e81-7c33-421e-a623-0372cf55374b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082484 Jul 14 10:11:46.662839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1222/2439] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:46 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:46.721236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-07cdc622-6c4b-4ede-aff3-101bf033494c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:46.722017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-07cdc622-6c4b-4ede-aff3-101bf033494c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:46.728866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07cdc622-6c4b-4ede-aff3-101bf033494c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:46.729482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07cdc622-6c4b-4ede-aff3-101bf033494c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:46.730268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07cdc622-6c4b-4ede-aff3-101bf033494c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:46.730700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-07cdc622-6c4b-4ede-aff3-101bf033494c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:46.858299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-67838bd5-99f4-460e-ae29-d26baebf6d9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:46.858978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-67838bd5-99f4-460e-ae29-d26baebf6d9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:46.861618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-07cdc622-6c4b-4ede-aff3-101bf033494c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:46.865386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67838bd5-99f4-460e-ae29-d26baebf6d9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:46.865854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67838bd5-99f4-460e-ae29-d26baebf6d9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:46.866640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67838bd5-99f4-460e-ae29-d26baebf6d9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:46.867067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67838bd5-99f4-460e-ae29-d26baebf6d9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:46.869902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-07cdc622-6c4b-4ede-aff3-101bf033494c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.153201 Jul 14 10:11:46.870508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1218/2440] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:46.995606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-67838bd5-99f4-460e-ae29-d26baebf6d9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:47.004770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-67838bd5-99f4-460e-ae29-d26baebf6d9a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150278 Jul 14 10:11:47.005461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1223/2441] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:46 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:47.678485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3301f73d-f310-4287-806c-500257bb7e2d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:47.679089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3301f73d-f310-4287-806c-500257bb7e2d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:47.685120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3301f73d-f310-4287-806c-500257bb7e2d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:47.685566 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3301f73d-f310-4287-806c-500257bb7e2d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:47.686343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3301f73d-f310-4287-806c-500257bb7e2d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:47.687391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3301f73d-f310-4287-806c-500257bb7e2d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:47.748434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3301f73d-f310-4287-806c-500257bb7e2d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:47.757007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3301f73d-f310-4287-806c-500257bb7e2d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082450 Jul 14 10:11:47.757575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1219/2442] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:47.887319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cba0470b-9e86-4e9c-b77f-9a1ab7b27f71 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:47.888083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cba0470b-9e86-4e9c-b77f-9a1ab7b27f71 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:47.894462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cba0470b-9e86-4e9c-b77f-9a1ab7b27f71 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:47.894860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cba0470b-9e86-4e9c-b77f-9a1ab7b27f71 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:47.895605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cba0470b-9e86-4e9c-b77f-9a1ab7b27f71 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:47.896032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cba0470b-9e86-4e9c-b77f-9a1ab7b27f71 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:48.022331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2db463a0-ac46-40d1-84e1-ebf38aa4d122 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:48.022961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2db463a0-ac46-40d1-84e1-ebf38aa4d122 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:48.023663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cba0470b-9e86-4e9c-b77f-9a1ab7b27f71 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:48.029017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2db463a0-ac46-40d1-84e1-ebf38aa4d122 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:48.029469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2db463a0-ac46-40d1-84e1-ebf38aa4d122 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:48.030291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2db463a0-ac46-40d1-84e1-ebf38aa4d122 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:48.031239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2db463a0-ac46-40d1-84e1-ebf38aa4d122 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:48.032063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cba0470b-9e86-4e9c-b77f-9a1ab7b27f71 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148647 Jul 14 10:11:48.032623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1224/2443] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:48.158763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2db463a0-ac46-40d1-84e1-ebf38aa4d122 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:48.166603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2db463a0-ac46-40d1-84e1-ebf38aa4d122 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148227 Jul 14 10:11:48.167164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1220/2444] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:48 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:48.774171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-93081972-3832-4f43-88d8-eb414b912dc5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:48.774805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-93081972-3832-4f43-88d8-eb414b912dc5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:48.780938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93081972-3832-4f43-88d8-eb414b912dc5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:48.781384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93081972-3832-4f43-88d8-eb414b912dc5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:48.782357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93081972-3832-4f43-88d8-eb414b912dc5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:48.782792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-93081972-3832-4f43-88d8-eb414b912dc5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:48.843395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-93081972-3832-4f43-88d8-eb414b912dc5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:48.851371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-93081972-3832-4f43-88d8-eb414b912dc5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081253 Jul 14 10:11:48.851931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1225/2445] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:48 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:49.049952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f0164f3d-1956-404a-93a9-76ef12778f6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:49.050627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f0164f3d-1956-404a-93a9-76ef12778f6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:49.057229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0164f3d-1956-404a-93a9-76ef12778f6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:49.057681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0164f3d-1956-404a-93a9-76ef12778f6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:49.058473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0164f3d-1956-404a-93a9-76ef12778f6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:49.058921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f0164f3d-1956-404a-93a9-76ef12778f6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:49.185741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4c08323c-7b80-4ac1-8efd-17cfe948aca4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:49.189148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4c08323c-7b80-4ac1-8efd-17cfe948aca4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:49.191336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f0164f3d-1956-404a-93a9-76ef12778f6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:49.196071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4c08323c-7b80-4ac1-8efd-17cfe948aca4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:49.196535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4c08323c-7b80-4ac1-8efd-17cfe948aca4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:49.197292 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4c08323c-7b80-4ac1-8efd-17cfe948aca4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:49.197715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4c08323c-7b80-4ac1-8efd-17cfe948aca4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:49.199675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f0164f3d-1956-404a-93a9-76ef12778f6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.154365 Jul 14 10:11:49.200287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1221/2446] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:49.200413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:49.325175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4c08323c-7b80-4ac1-8efd-17cfe948aca4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:49.333130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4c08323c-7b80-4ac1-8efd-17cfe948aca4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151903 Jul 14 10:11:49.333683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1226/2447] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:49 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:49.867653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-17e2693f-9ec2-440a-bc04-fa7d55724f05 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:49.868254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-17e2693f-9ec2-440a-bc04-fa7d55724f05 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:49.874425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-17e2693f-9ec2-440a-bc04-fa7d55724f05 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:49.874870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-17e2693f-9ec2-440a-bc04-fa7d55724f05 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:49.875622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-17e2693f-9ec2-440a-bc04-fa7d55724f05 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:49.876053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-17e2693f-9ec2-440a-bc04-fa7d55724f05 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:49.940514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-17e2693f-9ec2-440a-bc04-fa7d55724f05 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:49.948787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-17e2693f-9ec2-440a-bc04-fa7d55724f05 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085210 Jul 14 10:11:49.949342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1222/2448] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:49 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:50.217053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a00cf268-f3fd-4b40-b407-f51dbfbbbdf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:50.217732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a00cf268-f3fd-4b40-b407-f51dbfbbbdf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:50.224525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a00cf268-f3fd-4b40-b407-f51dbfbbbdf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:50.224962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a00cf268-f3fd-4b40-b407-f51dbfbbbdf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:50.225744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a00cf268-f3fd-4b40-b407-f51dbfbbbdf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:50.226217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a00cf268-f3fd-4b40-b407-f51dbfbbbdf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:50.349466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b39add7c-1fbc-44e2-9739-9492bc315ddb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:50.350165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b39add7c-1fbc-44e2-9739-9492bc315ddb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:50.353850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a00cf268-f3fd-4b40-b407-f51dbfbbbdf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:50.356927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b39add7c-1fbc-44e2-9739-9492bc315ddb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:50.357450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b39add7c-1fbc-44e2-9739-9492bc315ddb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:50.358309 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b39add7c-1fbc-44e2-9739-9492bc315ddb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:50.358957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b39add7c-1fbc-44e2-9739-9492bc315ddb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:50.362110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a00cf268-f3fd-4b40-b407-f51dbfbbbdf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148923 Jul 14 10:11:50.362711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1227/2449] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:50.487768 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b39add7c-1fbc-44e2-9739-9492bc315ddb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:50.495666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b39add7c-1fbc-44e2-9739-9492bc315ddb tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150114 Jul 14 10:11:50.496226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1223/2450] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:50 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:50.967197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9fe355d7-cd3f-481b-8b0f-82a665937786 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:50.968481 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9fe355d7-cd3f-481b-8b0f-82a665937786 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:50.974780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9fe355d7-cd3f-481b-8b0f-82a665937786 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:50.975233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9fe355d7-cd3f-481b-8b0f-82a665937786 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:50.975995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9fe355d7-cd3f-481b-8b0f-82a665937786 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:50.976437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9fe355d7-cd3f-481b-8b0f-82a665937786 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:51.041794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9fe355d7-cd3f-481b-8b0f-82a665937786 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:51.050881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9fe355d7-cd3f-481b-8b0f-82a665937786 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.088251 Jul 14 10:11:51.051467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1228/2451] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:50 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:51.379290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0ee48ad1-20c1-411e-814d-1838375f6d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:51.379834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0ee48ad1-20c1-411e-814d-1838375f6d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:51.386384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ee48ad1-20c1-411e-814d-1838375f6d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:51.386831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ee48ad1-20c1-411e-814d-1838375f6d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:51.387577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ee48ad1-20c1-411e-814d-1838375f6d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:51.388009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0ee48ad1-20c1-411e-814d-1838375f6d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:51.512977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-59384c75-13bf-4323-aa9e-3aef272ff29c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:51.513570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-59384c75-13bf-4323-aa9e-3aef272ff29c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:51.519144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0ee48ad1-20c1-411e-814d-1838375f6d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:51.520279 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59384c75-13bf-4323-aa9e-3aef272ff29c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:51.520721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59384c75-13bf-4323-aa9e-3aef272ff29c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:51.521488 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59384c75-13bf-4323-aa9e-3aef272ff29c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:51.521916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59384c75-13bf-4323-aa9e-3aef272ff29c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:51.527248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0ee48ad1-20c1-411e-814d-1838375f6d7c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151842 Jul 14 10:11:51.528029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1224/2452] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:51.651524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-59384c75-13bf-4323-aa9e-3aef272ff29c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:51.659909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-59384c75-13bf-4323-aa9e-3aef272ff29c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150817 Jul 14 10:11:51.660470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1229/2453] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:51 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:52.067321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-28df3f21-8454-4663-b05c-9dfc552b081a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:52.067939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-28df3f21-8454-4663-b05c-9dfc552b081a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:52.074032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28df3f21-8454-4663-b05c-9dfc552b081a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:52.074525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28df3f21-8454-4663-b05c-9dfc552b081a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:52.075290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28df3f21-8454-4663-b05c-9dfc552b081a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:52.075731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28df3f21-8454-4663-b05c-9dfc552b081a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:52.090905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:52.140356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-28df3f21-8454-4663-b05c-9dfc552b081a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:52.148360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-28df3f21-8454-4663-b05c-9dfc552b081a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084961 Jul 14 10:11:52.148923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1225/2454] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:52 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:52.544871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-422b8656-7e4e-42a5-ac62-c2d71248e55b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:52.545460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-422b8656-7e4e-42a5-ac62-c2d71248e55b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:52.552375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-422b8656-7e4e-42a5-ac62-c2d71248e55b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:52.552812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-422b8656-7e4e-42a5-ac62-c2d71248e55b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:52.553562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-422b8656-7e4e-42a5-ac62-c2d71248e55b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:52.553985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-422b8656-7e4e-42a5-ac62-c2d71248e55b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:52.678114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dada80f5-5b82-4a5e-8612-d4ec0e7e6c6c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:52.678764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dada80f5-5b82-4a5e-8612-d4ec0e7e6c6c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:52.683665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-422b8656-7e4e-42a5-ac62-c2d71248e55b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:52.685462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dada80f5-5b82-4a5e-8612-d4ec0e7e6c6c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:52.685914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dada80f5-5b82-4a5e-8612-d4ec0e7e6c6c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:52.687365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dada80f5-5b82-4a5e-8612-d4ec0e7e6c6c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:52.687807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dada80f5-5b82-4a5e-8612-d4ec0e7e6c6c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:52.692459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-422b8656-7e4e-42a5-ac62-c2d71248e55b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151378 Jul 14 10:11:52.693050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1230/2455] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:52.815237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dada80f5-5b82-4a5e-8612-d4ec0e7e6c6c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:52.823216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dada80f5-5b82-4a5e-8612-d4ec0e7e6c6c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149098 Jul 14 10:11:52.823782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1226/2456] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:52 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:53.164989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d08240b6-dc55-4088-8098-a336ff2db283 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:53.165503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d08240b6-dc55-4088-8098-a336ff2db283 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:53.172187 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d08240b6-dc55-4088-8098-a336ff2db283 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:53.172891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d08240b6-dc55-4088-8098-a336ff2db283 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:53.173640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d08240b6-dc55-4088-8098-a336ff2db283 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:53.174065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d08240b6-dc55-4088-8098-a336ff2db283 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:53.239607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d08240b6-dc55-4088-8098-a336ff2db283 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:53.247469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d08240b6-dc55-4088-8098-a336ff2db283 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086468 Jul 14 10:11:53.248024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1231/2457] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:53 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:53.709762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4362c1a9-af31-42bb-8767-c580feb29258 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:53.710421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4362c1a9-af31-42bb-8767-c580feb29258 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:53.716472 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4362c1a9-af31-42bb-8767-c580feb29258 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:53.716920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4362c1a9-af31-42bb-8767-c580feb29258 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:53.717698 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4362c1a9-af31-42bb-8767-c580feb29258 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:53.718844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4362c1a9-af31-42bb-8767-c580feb29258 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:53.840169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9d9f494d-ccd8-48ee-a3d6-52c394b212c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:53.840723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9d9f494d-ccd8-48ee-a3d6-52c394b212c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:53.847134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4362c1a9-af31-42bb-8767-c580feb29258 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:53.847497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d9f494d-ccd8-48ee-a3d6-52c394b212c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:53.847939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d9f494d-ccd8-48ee-a3d6-52c394b212c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:53.848700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d9f494d-ccd8-48ee-a3d6-52c394b212c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:53.849130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d9f494d-ccd8-48ee-a3d6-52c394b212c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:53.855003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4362c1a9-af31-42bb-8767-c580feb29258 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.149626 Jul 14 10:11:53.855565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1227/2458] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:53 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:53.976727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9d9f494d-ccd8-48ee-a3d6-52c394b212c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:53.986634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9d9f494d-ccd8-48ee-a3d6-52c394b212c0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150272 Jul 14 10:11:53.987207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1232/2459] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:53 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:54.264584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5e86f5dc-8ffd-419f-8aeb-2e58e84df090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:54.265192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5e86f5dc-8ffd-419f-8aeb-2e58e84df090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:54.271609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e86f5dc-8ffd-419f-8aeb-2e58e84df090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:54.272054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e86f5dc-8ffd-419f-8aeb-2e58e84df090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:54.272842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e86f5dc-8ffd-419f-8aeb-2e58e84df090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:54.273276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5e86f5dc-8ffd-419f-8aeb-2e58e84df090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:54.336944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5e86f5dc-8ffd-419f-8aeb-2e58e84df090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:54.344947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5e86f5dc-8ffd-419f-8aeb-2e58e84df090 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084201 Jul 14 10:11:54.345512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1228/2460] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:54 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:54.872305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9b5f59ef-d8fb-4eaf-b748-92d092d1ff06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:54.872914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9b5f59ef-d8fb-4eaf-b748-92d092d1ff06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:54.879526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b5f59ef-d8fb-4eaf-b748-92d092d1ff06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:54.879968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b5f59ef-d8fb-4eaf-b748-92d092d1ff06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:54.880718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b5f59ef-d8fb-4eaf-b748-92d092d1ff06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:54.881260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b5f59ef-d8fb-4eaf-b748-92d092d1ff06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:55.003603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e2331c72-861b-445d-8bf1-3cc75c20ad1f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:55.004250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e2331c72-861b-445d-8bf1-3cc75c20ad1f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:55.009038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9b5f59ef-d8fb-4eaf-b748-92d092d1ff06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:55.010928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2331c72-861b-445d-8bf1-3cc75c20ad1f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:55.011380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2331c72-861b-445d-8bf1-3cc75c20ad1f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:55.012150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2331c72-861b-445d-8bf1-3cc75c20ad1f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:55.012594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e2331c72-861b-445d-8bf1-3cc75c20ad1f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:55.017633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9b5f59ef-d8fb-4eaf-b748-92d092d1ff06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.149176 Jul 14 10:11:55.018215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1233/2461] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:55.146027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e2331c72-861b-445d-8bf1-3cc75c20ad1f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:55.153998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e2331c72-861b-445d-8bf1-3cc75c20ad1f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154241 Jul 14 10:11:55.154592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1229/2462] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:54 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:55.363121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ce0f6125-ed5e-48aa-9ad1-503aaa1b0880 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:55.363632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ce0f6125-ed5e-48aa-9ad1-503aaa1b0880 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:55.369664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce0f6125-ed5e-48aa-9ad1-503aaa1b0880 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:55.370106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce0f6125-ed5e-48aa-9ad1-503aaa1b0880 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:55.370898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce0f6125-ed5e-48aa-9ad1-503aaa1b0880 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:55.371325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ce0f6125-ed5e-48aa-9ad1-503aaa1b0880 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:55.436203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ce0f6125-ed5e-48aa-9ad1-503aaa1b0880 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:55.444668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ce0f6125-ed5e-48aa-9ad1-503aaa1b0880 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085510 Jul 14 10:11:55.445218 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1234/2463] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:55 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:56.034861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4966bfb9-5c60-4adc-9b45-1acf5d846ca1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:56.035418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4966bfb9-5c60-4adc-9b45-1acf5d846ca1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:56.041871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4966bfb9-5c60-4adc-9b45-1acf5d846ca1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:56.042356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4966bfb9-5c60-4adc-9b45-1acf5d846ca1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:56.043108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4966bfb9-5c60-4adc-9b45-1acf5d846ca1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:56.043535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4966bfb9-5c60-4adc-9b45-1acf5d846ca1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:56.172408 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-00135542-5ae5-4734-ae52-b1d427d6e4af tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:56.173470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-00135542-5ae5-4734-ae52-b1d427d6e4af tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:56.174268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4966bfb9-5c60-4adc-9b45-1acf5d846ca1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:56.180449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00135542-5ae5-4734-ae52-b1d427d6e4af tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:56.180890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00135542-5ae5-4734-ae52-b1d427d6e4af tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:56.181652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00135542-5ae5-4734-ae52-b1d427d6e4af tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:56.182084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-00135542-5ae5-4734-ae52-b1d427d6e4af tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:56.182226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4966bfb9-5c60-4adc-9b45-1acf5d846ca1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151790 Jul 14 10:11:56.182746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1230/2464] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:56 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:56.311699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-00135542-5ae5-4734-ae52-b1d427d6e4af tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:56.319751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-00135542-5ae5-4734-ae52-b1d427d6e4af tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151913 Jul 14 10:11:56.320314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1235/2465] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:56 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:56.462107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c553747-0a3f-4afe-a1d9-1149e933965f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:56.462744 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c553747-0a3f-4afe-a1d9-1149e933965f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:56.469428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c553747-0a3f-4afe-a1d9-1149e933965f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:56.469871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c553747-0a3f-4afe-a1d9-1149e933965f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:56.470656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c553747-0a3f-4afe-a1d9-1149e933965f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:56.471088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c553747-0a3f-4afe-a1d9-1149e933965f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:56.542237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1c553747-0a3f-4afe-a1d9-1149e933965f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:56.550486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c553747-0a3f-4afe-a1d9-1149e933965f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.092204 Jul 14 10:11:56.551039 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1231/2466] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:56 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:57.199953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-38a211f6-5017-4e22-8e58-176e68873944 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:57.200555 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-38a211f6-5017-4e22-8e58-176e68873944 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:57.207246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a211f6-5017-4e22-8e58-176e68873944 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:57.207692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a211f6-5017-4e22-8e58-176e68873944 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:57.208452 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a211f6-5017-4e22-8e58-176e68873944 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:57.208884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a211f6-5017-4e22-8e58-176e68873944 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:57.335553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38a211f6-5017-4e22-8e58-176e68873944 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:57.336782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-37f1ef94-2e1c-4113-8f22-ac95854e41e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:57.337424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-37f1ef94-2e1c-4113-8f22-ac95854e41e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:57.343838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-38a211f6-5017-4e22-8e58-176e68873944 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147707 Jul 14 10:11:57.344067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37f1ef94-2e1c-4113-8f22-ac95854e41e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:57.344405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1236/2467] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:57.344566 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37f1ef94-2e1c-4113-8f22-ac95854e41e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:57.345390 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37f1ef94-2e1c-4113-8f22-ac95854e41e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:57.345829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37f1ef94-2e1c-4113-8f22-ac95854e41e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:57.474269 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-37f1ef94-2e1c-4113-8f22-ac95854e41e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:57.482371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-37f1ef94-2e1c-4113-8f22-ac95854e41e2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149326 Jul 14 10:11:57.482939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1232/2468] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:57 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:57.567265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1488bf72-1859-42a7-a942-ed30606ceb5f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:57.567874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1488bf72-1859-42a7-a942-ed30606ceb5f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:57.573886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1488bf72-1859-42a7-a942-ed30606ceb5f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:57.574377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1488bf72-1859-42a7-a942-ed30606ceb5f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:57.575138 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1488bf72-1859-42a7-a942-ed30606ceb5f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:57.575573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1488bf72-1859-42a7-a942-ed30606ceb5f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:57.640982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1488bf72-1859-42a7-a942-ed30606ceb5f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:57.649014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1488bf72-1859-42a7-a942-ed30606ceb5f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085635 Jul 14 10:11:57.649582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1237/2469] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:57 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:58.361608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5b9fa582-4275-45af-aa62-727b27ba2f84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:58.362274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5b9fa582-4275-45af-aa62-727b27ba2f84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:58.368872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b9fa582-4275-45af-aa62-727b27ba2f84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:58.369323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b9fa582-4275-45af-aa62-727b27ba2f84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:58.370088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b9fa582-4275-45af-aa62-727b27ba2f84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:58.370550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b9fa582-4275-45af-aa62-727b27ba2f84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:58.497714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5b9fa582-4275-45af-aa62-727b27ba2f84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:58.499744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9aa24b6b-e4d0-41c6-b5c2-edbbdbdfb888 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:58.500348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9aa24b6b-e4d0-41c6-b5c2-edbbdbdfb888 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:58.505783 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5b9fa582-4275-45af-aa62-727b27ba2f84 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148704 Jul 14 10:11:58.506371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1233/2470] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:58.506996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9aa24b6b-e4d0-41c6-b5c2-edbbdbdfb888 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:58.507438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9aa24b6b-e4d0-41c6-b5c2-edbbdbdfb888 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:58.508189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9aa24b6b-e4d0-41c6-b5c2-edbbdbdfb888 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:58.508615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9aa24b6b-e4d0-41c6-b5c2-edbbdbdfb888 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:58.637329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9aa24b6b-e4d0-41c6-b5c2-edbbdbdfb888 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:58.646282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9aa24b6b-e4d0-41c6-b5c2-edbbdbdfb888 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150309 Jul 14 10:11:58.646892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1238/2471] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:58 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:58.666301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e81d866b-79a1-41fb-8ffb-cb36b5b434d8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:58.666915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e81d866b-79a1-41fb-8ffb-cb36b5b434d8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:58.673307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e81d866b-79a1-41fb-8ffb-cb36b5b434d8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:58.673755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e81d866b-79a1-41fb-8ffb-cb36b5b434d8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:58.674561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e81d866b-79a1-41fb-8ffb-cb36b5b434d8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:58.674997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e81d866b-79a1-41fb-8ffb-cb36b5b434d8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:58.740021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e81d866b-79a1-41fb-8ffb-cb36b5b434d8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:58.747952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e81d866b-79a1-41fb-8ffb-cb36b5b434d8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085505 Jul 14 10:11:58.748518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1234/2472] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:58 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:59.522969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d6ca4ec5-985e-4439-98b5-be79c176baea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:59.523571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d6ca4ec5-985e-4439-98b5-be79c176baea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:59.531141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6ca4ec5-985e-4439-98b5-be79c176baea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:59.531590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6ca4ec5-985e-4439-98b5-be79c176baea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:59.532379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6ca4ec5-985e-4439-98b5-be79c176baea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:59.532809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6ca4ec5-985e-4439-98b5-be79c176baea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:59.659864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d6ca4ec5-985e-4439-98b5-be79c176baea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:59.663340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ba164f3a-a651-446a-9e0a-717b1fe06a63 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:59.663948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ba164f3a-a651-446a-9e0a-717b1fe06a63 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:59.667959 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d6ca4ec5-985e-4439-98b5-be79c176baea tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148826 Jul 14 10:11:59.668523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1239/2473] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:59 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:59.670242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba164f3a-a651-446a-9e0a-717b1fe06a63 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:59.670693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba164f3a-a651-446a-9e0a-717b1fe06a63 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:59.671596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba164f3a-a651-446a-9e0a-717b1fe06a63 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:59.672031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba164f3a-a651-446a-9e0a-717b1fe06a63 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:59.764773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7f3f294a-eb6f-4c72-9635-7aee67cdf856 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:59.765459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7f3f294a-eb6f-4c72-9635-7aee67cdf856 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:11:59.772598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f3f294a-eb6f-4c72-9635-7aee67cdf856 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:59.773182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f3f294a-eb6f-4c72-9635-7aee67cdf856 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:59.773885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f3f294a-eb6f-4c72-9635-7aee67cdf856 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:59.774344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f3f294a-eb6f-4c72-9635-7aee67cdf856 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:59.801308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ba164f3a-a651-446a-9e0a-717b1fe06a63 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:59.809417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ba164f3a-a651-446a-9e0a-717b1fe06a63 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149818 Jul 14 10:11:59.809993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1235/2474] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:59 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:11:59.839317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7f3f294a-eb6f-4c72-9635-7aee67cdf856 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:11:59.847263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7f3f294a-eb6f-4c72-9635-7aee67cdf856 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086304 Jul 14 10:11:59.847825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1240/2475] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:11:59 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:00.684891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fd0a2c73-445d-4ccd-9f29-96eb06c1765d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:00.685496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fd0a2c73-445d-4ccd-9f29-96eb06c1765d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:00.692088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c73-445d-4ccd-9f29-96eb06c1765d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:00.692526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c73-445d-4ccd-9f29-96eb06c1765d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:00.693275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c73-445d-4ccd-9f29-96eb06c1765d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:00.693704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd0a2c73-445d-4ccd-9f29-96eb06c1765d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:00.824079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fd0a2c73-445d-4ccd-9f29-96eb06c1765d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:00.826603 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f34de449-4799-4b78-bad9-3b7526d833ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:00.827621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f34de449-4799-4b78-bad9-3b7526d833ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:00.832161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fd0a2c73-445d-4ccd-9f29-96eb06c1765d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151144 Jul 14 10:12:00.832736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1236/2476] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:00 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:00.834057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f34de449-4799-4b78-bad9-3b7526d833ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:00.834641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f34de449-4799-4b78-bad9-3b7526d833ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:00.835471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f34de449-4799-4b78-bad9-3b7526d833ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:00.835911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f34de449-4799-4b78-bad9-3b7526d833ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:00.864977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4f13af0b-81fd-46d6-aed0-0743d4d6165c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:00.865583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4f13af0b-81fd-46d6-aed0-0743d4d6165c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:00.871800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f13af0b-81fd-46d6-aed0-0743d4d6165c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:00.872249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f13af0b-81fd-46d6-aed0-0743d4d6165c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:00.873013 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f13af0b-81fd-46d6-aed0-0743d4d6165c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:00.873448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4f13af0b-81fd-46d6-aed0-0743d4d6165c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:00.949430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4f13af0b-81fd-46d6-aed0-0743d4d6165c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:00.958019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4f13af0b-81fd-46d6-aed0-0743d4d6165c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.096908 Jul 14 10:12:00.958618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1237/2477] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:00 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:00.990463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f34de449-4799-4b78-bad9-3b7526d833ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:00.998442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f34de449-4799-4b78-bad9-3b7526d833ac tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.175568 Jul 14 10:12:00.998999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1241/2478] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:00 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:01.849449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fc2dabfe-55df-4c6d-8186-5e880505db6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:01.850072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fc2dabfe-55df-4c6d-8186-5e880505db6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:01.852824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=80 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:01.859846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc2dabfe-55df-4c6d-8186-5e880505db6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:01.860327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc2dabfe-55df-4c6d-8186-5e880505db6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:01.861097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc2dabfe-55df-4c6d-8186-5e880505db6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:01.861528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fc2dabfe-55df-4c6d-8186-5e880505db6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:01.975227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5e452bcd-1e7b-4d0b-b62f-e26d7dae029d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:01.975794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5e452bcd-1e7b-4d0b-b62f-e26d7dae029d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:01.981693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e452bcd-1e7b-4d0b-b62f-e26d7dae029d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:01.982129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e452bcd-1e7b-4d0b-b62f-e26d7dae029d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:01.983076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e452bcd-1e7b-4d0b-b62f-e26d7dae029d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:01.984075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5e452bcd-1e7b-4d0b-b62f-e26d7dae029d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:01.992451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fc2dabfe-55df-4c6d-8186-5e880505db6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:02.001155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fc2dabfe-55df-4c6d-8186-5e880505db6e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155800 Jul 14 10:12:02.001733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1238/2479] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:01 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:02.015776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-49e02c3b-114a-455c-9ded-2c0dbf8b4718 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:02.016515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-49e02c3b-114a-455c-9ded-2c0dbf8b4718 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:02.022585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49e02c3b-114a-455c-9ded-2c0dbf8b4718 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:02.023031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49e02c3b-114a-455c-9ded-2c0dbf8b4718 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:02.023797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49e02c3b-114a-455c-9ded-2c0dbf8b4718 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:02.024227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49e02c3b-114a-455c-9ded-2c0dbf8b4718 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:02.048529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5e452bcd-1e7b-4d0b-b62f-e26d7dae029d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:02.050688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:02.057674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5e452bcd-1e7b-4d0b-b62f-e26d7dae029d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086476 Jul 14 10:12:02.058265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1242/2480] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:01 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:02.161075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-49e02c3b-114a-455c-9ded-2c0dbf8b4718 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:02.169275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-49e02c3b-114a-455c-9ded-2c0dbf8b4718 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157199 Jul 14 10:12:02.169924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1239/2481] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:02 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:03.019477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bf4801a8-9202-48be-b223-014345b2a49e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:03.020114 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bf4801a8-9202-48be-b223-014345b2a49e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:03.026675 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf4801a8-9202-48be-b223-014345b2a49e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:03.027123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf4801a8-9202-48be-b223-014345b2a49e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:03.027889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf4801a8-9202-48be-b223-014345b2a49e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:03.028322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bf4801a8-9202-48be-b223-014345b2a49e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:03.074523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-56009643-9dc6-4528-ac5a-10048580fcfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:03.075245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-56009643-9dc6-4528-ac5a-10048580fcfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:03.082607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56009643-9dc6-4528-ac5a-10048580fcfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:03.083132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56009643-9dc6-4528-ac5a-10048580fcfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:03.083966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56009643-9dc6-4528-ac5a-10048580fcfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:03.084524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56009643-9dc6-4528-ac5a-10048580fcfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:03.159844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-56009643-9dc6-4528-ac5a-10048580fcfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:03.167916 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-56009643-9dc6-4528-ac5a-10048580fcfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.097179 Jul 14 10:12:03.168482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1240/2482] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:03 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:03.182117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bf4801a8-9202-48be-b223-014345b2a49e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:03.187346 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-35d48354-3f4f-43e5-9208-b7a2bc761e54 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:03.188065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-35d48354-3f4f-43e5-9208-b7a2bc761e54 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:03.190853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bf4801a8-9202-48be-b223-014345b2a49e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.176071 Jul 14 10:12:03.191432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1243/2483] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:03 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:03.194430 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35d48354-3f4f-43e5-9208-b7a2bc761e54 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:03.194883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35d48354-3f4f-43e5-9208-b7a2bc761e54 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:03.195655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35d48354-3f4f-43e5-9208-b7a2bc761e54 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:03.196095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-35d48354-3f4f-43e5-9208-b7a2bc761e54 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:03.333937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-35d48354-3f4f-43e5-9208-b7a2bc761e54 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:03.341875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-35d48354-3f4f-43e5-9208-b7a2bc761e54 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.158960 Jul 14 10:12:03.342474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1241/2484] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:03 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:04.185108 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3cdb91ad-65b7-4010-9f01-27400283488a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:04.185702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3cdb91ad-65b7-4010-9f01-27400283488a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:04.192592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3cdb91ad-65b7-4010-9f01-27400283488a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:04.193030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3cdb91ad-65b7-4010-9f01-27400283488a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:04.193772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3cdb91ad-65b7-4010-9f01-27400283488a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:04.194208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3cdb91ad-65b7-4010-9f01-27400283488a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:04.208030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b90584aa-a1df-4875-8cb1-b715863d8489 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:04.208639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b90584aa-a1df-4875-8cb1-b715863d8489 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:04.215296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b90584aa-a1df-4875-8cb1-b715863d8489 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:04.215741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b90584aa-a1df-4875-8cb1-b715863d8489 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:04.216493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b90584aa-a1df-4875-8cb1-b715863d8489 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:04.216920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b90584aa-a1df-4875-8cb1-b715863d8489 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:04.220187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:04.258917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3cdb91ad-65b7-4010-9f01-27400283488a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:04.267737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3cdb91ad-65b7-4010-9f01-27400283488a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086414 Jul 14 10:12:04.268318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1244/2485] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:04 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:04.358452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b90584aa-a1df-4875-8cb1-b715863d8489 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:04.359157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a76243ef-8b50-4c09-9dbf-174dc2e53cee tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:04.359798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a76243ef-8b50-4c09-9dbf-174dc2e53cee tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:04.366293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a76243ef-8b50-4c09-9dbf-174dc2e53cee tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:04.366743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a76243ef-8b50-4c09-9dbf-174dc2e53cee tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:04.366917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b90584aa-a1df-4875-8cb1-b715863d8489 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.162652 Jul 14 10:12:04.367416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1242/2486] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:04.367577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a76243ef-8b50-4c09-9dbf-174dc2e53cee tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:04.368014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a76243ef-8b50-4c09-9dbf-174dc2e53cee tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:04.503000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a76243ef-8b50-4c09-9dbf-174dc2e53cee tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:04.510762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a76243ef-8b50-4c09-9dbf-174dc2e53cee tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.155479 Jul 14 10:12:04.511320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1245/2487] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:04 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:05.284640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7a17dfba-347f-4623-8acd-3d0f76732256 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:05.285253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7a17dfba-347f-4623-8acd-3d0f76732256 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:05.291819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7a17dfba-347f-4623-8acd-3d0f76732256 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:05.292267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7a17dfba-347f-4623-8acd-3d0f76732256 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:05.293025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7a17dfba-347f-4623-8acd-3d0f76732256 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:05.293460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7a17dfba-347f-4623-8acd-3d0f76732256 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:05.355184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7a17dfba-347f-4623-8acd-3d0f76732256 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:05.363592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7a17dfba-347f-4623-8acd-3d0f76732256 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082821 Jul 14 10:12:05.364153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1243/2488] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:05 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:05.383606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-98e19130-4f4f-4f77-9987-1a2c1b923387 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:05.384210 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-98e19130-4f4f-4f77-9987-1a2c1b923387 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:05.390842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98e19130-4f4f-4f77-9987-1a2c1b923387 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:05.391225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98e19130-4f4f-4f77-9987-1a2c1b923387 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:05.391974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98e19130-4f4f-4f77-9987-1a2c1b923387 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:05.392403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-98e19130-4f4f-4f77-9987-1a2c1b923387 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:05.519367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-98e19130-4f4f-4f77-9987-1a2c1b923387 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:05.527822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-98e19130-4f4f-4f77-9987-1a2c1b923387 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147936 Jul 14 10:12:05.528195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4c457b96-4b50-4310-9915-367382ef16ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:05.532070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1246/2489] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:05 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:05.532237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4c457b96-4b50-4310-9915-367382ef16ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:05.535805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c457b96-4b50-4310-9915-367382ef16ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:05.536450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c457b96-4b50-4310-9915-367382ef16ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:05.537222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c457b96-4b50-4310-9915-367382ef16ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:05.537661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4c457b96-4b50-4310-9915-367382ef16ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:05.669571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4c457b96-4b50-4310-9915-367382ef16ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:05.678605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4c457b96-4b50-4310-9915-367382ef16ad tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154146 Jul 14 10:12:05.679162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1244/2490] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:05 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:06.380413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-65aafa36-3286-4281-8de6-d2deaff9fca4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:06.381054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-65aafa36-3286-4281-8de6-d2deaff9fca4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:06.387058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-65aafa36-3286-4281-8de6-d2deaff9fca4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:06.387653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-65aafa36-3286-4281-8de6-d2deaff9fca4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:06.388271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-65aafa36-3286-4281-8de6-d2deaff9fca4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:06.388702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-65aafa36-3286-4281-8de6-d2deaff9fca4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:06.450529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-65aafa36-3286-4281-8de6-d2deaff9fca4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:06.460568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-65aafa36-3286-4281-8de6-d2deaff9fca4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083956 Jul 14 10:12:06.461128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1247/2491] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:06 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:06.544991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2a8fd5e0-e32e-4675-934a-58c5576d42c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:06.545622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2a8fd5e0-e32e-4675-934a-58c5576d42c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:06.552465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2a8fd5e0-e32e-4675-934a-58c5576d42c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:06.552947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2a8fd5e0-e32e-4675-934a-58c5576d42c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:06.553707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2a8fd5e0-e32e-4675-934a-58c5576d42c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:06.554144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2a8fd5e0-e32e-4675-934a-58c5576d42c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:06.681188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2a8fd5e0-e32e-4675-934a-58c5576d42c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:06.689446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2a8fd5e0-e32e-4675-934a-58c5576d42c9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.148281 Jul 14 10:12:06.690432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1245/2492] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:06 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:06.695396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b0c76698-46a2-45a8-b45c-15abd823e048 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:06.696008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b0c76698-46a2-45a8-b45c-15abd823e048 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:06.702644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0c76698-46a2-45a8-b45c-15abd823e048 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:06.703094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0c76698-46a2-45a8-b45c-15abd823e048 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:06.704392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0c76698-46a2-45a8-b45c-15abd823e048 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:06.704830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0c76698-46a2-45a8-b45c-15abd823e048 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:06.837509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b0c76698-46a2-45a8-b45c-15abd823e048 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:06.846054 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b0c76698-46a2-45a8-b45c-15abd823e048 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154490 Jul 14 10:12:06.846638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1248/2493] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:06 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:07.477867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-febc9c9a-0d73-42b0-b0bf-a6b9358fb803 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:07.478521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-febc9c9a-0d73-42b0-b0bf-a6b9358fb803 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:07.484539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-febc9c9a-0d73-42b0-b0bf-a6b9358fb803 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:07.484984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-febc9c9a-0d73-42b0-b0bf-a6b9358fb803 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:07.485730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-febc9c9a-0d73-42b0-b0bf-a6b9358fb803 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:07.486164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-febc9c9a-0d73-42b0-b0bf-a6b9358fb803 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:07.548141 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-febc9c9a-0d73-42b0-b0bf-a6b9358fb803 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:07.556584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-febc9c9a-0d73-42b0-b0bf-a6b9358fb803 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082520 Jul 14 10:12:07.557158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1246/2494] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:07 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:07.707286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f6a758f-e33a-4fda-9e73-574e592e1dc4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:07.707892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f6a758f-e33a-4fda-9e73-574e592e1dc4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:07.714438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f6a758f-e33a-4fda-9e73-574e592e1dc4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:07.714881 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f6a758f-e33a-4fda-9e73-574e592e1dc4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:07.715642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f6a758f-e33a-4fda-9e73-574e592e1dc4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:07.716073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f6a758f-e33a-4fda-9e73-574e592e1dc4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:07.846828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9f6a758f-e33a-4fda-9e73-574e592e1dc4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:07.854774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f6a758f-e33a-4fda-9e73-574e592e1dc4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151917 Jul 14 10:12:07.856273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1249/2495] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:07.864717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0c883b09-841d-4989-a015-7640182d844b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:07.865331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0c883b09-841d-4989-a015-7640182d844b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:07.871299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c883b09-841d-4989-a015-7640182d844b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:07.871749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c883b09-841d-4989-a015-7640182d844b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:07.872502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c883b09-841d-4989-a015-7640182d844b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:07.872939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c883b09-841d-4989-a015-7640182d844b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:08.003620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c883b09-841d-4989-a015-7640182d844b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:08.011570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0c883b09-841d-4989-a015-7640182d844b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150680 Jul 14 10:12:08.012129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1247/2496] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:07 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:08.573566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e4a8c661-c066-4874-b35d-06729f081aaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:08.574164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e4a8c661-c066-4874-b35d-06729f081aaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:08.580196 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4a8c661-c066-4874-b35d-06729f081aaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:08.580633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4a8c661-c066-4874-b35d-06729f081aaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:08.581380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4a8c661-c066-4874-b35d-06729f081aaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:08.581807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e4a8c661-c066-4874-b35d-06729f081aaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:08.645354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e4a8c661-c066-4874-b35d-06729f081aaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:08.653681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e4a8c661-c066-4874-b35d-06729f081aaf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084138 Jul 14 10:12:08.654263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1250/2497] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:08 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:08.873122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bd2caf9f-b188-4e59-bb83-ee62b5a2a796 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:08.873676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bd2caf9f-b188-4e59-bb83-ee62b5a2a796 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:08.880415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd2caf9f-b188-4e59-bb83-ee62b5a2a796 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:08.880858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd2caf9f-b188-4e59-bb83-ee62b5a2a796 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:08.881614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd2caf9f-b188-4e59-bb83-ee62b5a2a796 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:08.882043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd2caf9f-b188-4e59-bb83-ee62b5a2a796 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:09.026835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bd2caf9f-b188-4e59-bb83-ee62b5a2a796 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:09.028125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1cd6783f-e77a-483d-808d-d5e9d149ced8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:09.028736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1cd6783f-e77a-483d-808d-d5e9d149ced8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:09.035561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bd2caf9f-b188-4e59-bb83-ee62b5a2a796 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.166377 Jul 14 10:12:09.035855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1cd6783f-e77a-483d-808d-d5e9d149ced8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:09.036131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1248/2498] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:09.036300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1cd6783f-e77a-483d-808d-d5e9d149ced8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:09.037069 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1cd6783f-e77a-483d-808d-d5e9d149ced8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:09.037498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1cd6783f-e77a-483d-808d-d5e9d149ced8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:09.164589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1cd6783f-e77a-483d-808d-d5e9d149ced8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:09.172545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1cd6783f-e77a-483d-808d-d5e9d149ced8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148228 Jul 14 10:12:09.173375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1251/2499] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:09 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:09.671109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b8d9747a-97aa-4a7a-9504-d2d55e7aa1ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:09.671714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b8d9747a-97aa-4a7a-9504-d2d55e7aa1ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:09.678238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8d9747a-97aa-4a7a-9504-d2d55e7aa1ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:09.678687 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8d9747a-97aa-4a7a-9504-d2d55e7aa1ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:09.679463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8d9747a-97aa-4a7a-9504-d2d55e7aa1ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:09.679894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8d9747a-97aa-4a7a-9504-d2d55e7aa1ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:09.741009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b8d9747a-97aa-4a7a-9504-d2d55e7aa1ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:09.749020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b8d9747a-97aa-4a7a-9504-d2d55e7aa1ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081774 Jul 14 10:12:09.749587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1249/2500] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:09 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:10.053105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-729de688-6e58-4aae-ae54-d05f9c3bf908 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:10.053693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-729de688-6e58-4aae-ae54-d05f9c3bf908 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:10.060346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-729de688-6e58-4aae-ae54-d05f9c3bf908 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:10.060786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-729de688-6e58-4aae-ae54-d05f9c3bf908 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:10.061543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-729de688-6e58-4aae-ae54-d05f9c3bf908 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:10.061975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-729de688-6e58-4aae-ae54-d05f9c3bf908 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:10.189773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ed7dc9f6-de70-495b-97f9-1373619c689c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:10.191102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ed7dc9f6-de70-495b-97f9-1373619c689c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:10.193445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-729de688-6e58-4aae-ae54-d05f9c3bf908 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:10.197807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed7dc9f6-de70-495b-97f9-1373619c689c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:10.198290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed7dc9f6-de70-495b-97f9-1373619c689c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:10.199058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed7dc9f6-de70-495b-97f9-1373619c689c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:10.199492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ed7dc9f6-de70-495b-97f9-1373619c689c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:10.201565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-729de688-6e58-4aae-ae54-d05f9c3bf908 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152422 Jul 14 10:12:10.202135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1252/2501] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:10.343928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ed7dc9f6-de70-495b-97f9-1373619c689c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:10.351914 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ed7dc9f6-de70-495b-97f9-1373619c689c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.166518 Jul 14 10:12:10.352484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1250/2502] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:10 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:10.767009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a91511e7-9e97-4cf8-b4a9-02d7f4b187da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:10.767604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a91511e7-9e97-4cf8-b4a9-02d7f4b187da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:10.773557 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a91511e7-9e97-4cf8-b4a9-02d7f4b187da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:10.773992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a91511e7-9e97-4cf8-b4a9-02d7f4b187da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:10.774772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a91511e7-9e97-4cf8-b4a9-02d7f4b187da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:10.775197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a91511e7-9e97-4cf8-b4a9-02d7f4b187da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:10.837264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a91511e7-9e97-4cf8-b4a9-02d7f4b187da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:10.845317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a91511e7-9e97-4cf8-b4a9-02d7f4b187da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083601 Jul 14 10:12:10.845868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1253/2503] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:10 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:11.226140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e6f52815-1100-4507-8d24-fdbb68c70eb3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:11.226771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e6f52815-1100-4507-8d24-fdbb68c70eb3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:11.232907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e6f52815-1100-4507-8d24-fdbb68c70eb3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:11.233357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e6f52815-1100-4507-8d24-fdbb68c70eb3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:11.234110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e6f52815-1100-4507-8d24-fdbb68c70eb3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:11.235083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e6f52815-1100-4507-8d24-fdbb68c70eb3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:11.364442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e6f52815-1100-4507-8d24-fdbb68c70eb3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:11.368820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-13829322-e930-428c-b22b-b8d70338d97f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:11.369497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-13829322-e930-428c-b22b-b8d70338d97f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:11.371937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=78 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:11.372384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e6f52815-1100-4507-8d24-fdbb68c70eb3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150073 Jul 14 10:12:11.372960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1251/2504] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:11 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:11.378134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13829322-e930-428c-b22b-b8d70338d97f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:11.378599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13829322-e930-428c-b22b-b8d70338d97f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:11.379364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13829322-e930-428c-b22b-b8d70338d97f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:11.379793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-13829322-e930-428c-b22b-b8d70338d97f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:11.506023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-13829322-e930-428c-b22b-b8d70338d97f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:11.513975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-13829322-e930-428c-b22b-b8d70338d97f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149061 Jul 14 10:12:11.514567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1254/2505] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:11 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:11.862182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bfd17e78-c9af-4d8e-9ed4-e2b1d2b96904 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:11.862737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bfd17e78-c9af-4d8e-9ed4-e2b1d2b96904 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:11.868862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd17e78-c9af-4d8e-9ed4-e2b1d2b96904 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:11.869309 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd17e78-c9af-4d8e-9ed4-e2b1d2b96904 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:11.870097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd17e78-c9af-4d8e-9ed4-e2b1d2b96904 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:11.870559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bfd17e78-c9af-4d8e-9ed4-e2b1d2b96904 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:11.932528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bfd17e78-c9af-4d8e-9ed4-e2b1d2b96904 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:11.941341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bfd17e78-c9af-4d8e-9ed4-e2b1d2b96904 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083091 Jul 14 10:12:11.941936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1252/2506] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:11 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:12.390601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-759177c1-07c1-4bfe-8ef5-2f6bca661219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:12.391216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-759177c1-07c1-4bfe-8ef5-2f6bca661219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:12.398468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-759177c1-07c1-4bfe-8ef5-2f6bca661219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:12.399159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-759177c1-07c1-4bfe-8ef5-2f6bca661219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:12.399927 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-759177c1-07c1-4bfe-8ef5-2f6bca661219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:12.400365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-759177c1-07c1-4bfe-8ef5-2f6bca661219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:12.531069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f3d0555d-6a3e-4d53-b5fd-515dcb553df5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:12.532331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f3d0555d-6a3e-4d53-b5fd-515dcb553df5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:12.539282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3d0555d-6a3e-4d53-b5fd-515dcb553df5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:12.540066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3d0555d-6a3e-4d53-b5fd-515dcb553df5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:12.541402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3d0555d-6a3e-4d53-b5fd-515dcb553df5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:12.541975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-759177c1-07c1-4bfe-8ef5-2f6bca661219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:12.542215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3d0555d-6a3e-4d53-b5fd-515dcb553df5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:12.551401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-759177c1-07c1-4bfe-8ef5-2f6bca661219 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.164581 Jul 14 10:12:12.551990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1255/2507] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:12.695641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f3d0555d-6a3e-4d53-b5fd-515dcb553df5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:12.704642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f3d0555d-6a3e-4d53-b5fd-515dcb553df5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.177425 Jul 14 10:12:12.705232 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1253/2508] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:12 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:12.960824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-553c5292-2eb3-4e0b-be84-6a7bd210e765 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:12.961370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-553c5292-2eb3-4e0b-be84-6a7bd210e765 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:12.968830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-553c5292-2eb3-4e0b-be84-6a7bd210e765 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:12.969269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-553c5292-2eb3-4e0b-be84-6a7bd210e765 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:12.970027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-553c5292-2eb3-4e0b-be84-6a7bd210e765 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:12.970496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-553c5292-2eb3-4e0b-be84-6a7bd210e765 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:13.038875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-553c5292-2eb3-4e0b-be84-6a7bd210e765 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:13.048921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-553c5292-2eb3-4e0b-be84-6a7bd210e765 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.092219 Jul 14 10:12:13.049480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1256/2509] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:12 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:13.569383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-768902d4-a14a-47d2-90f5-c2ca49c662fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:13.570019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-768902d4-a14a-47d2-90f5-c2ca49c662fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:13.576595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-768902d4-a14a-47d2-90f5-c2ca49c662fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:13.577041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-768902d4-a14a-47d2-90f5-c2ca49c662fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:13.577789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-768902d4-a14a-47d2-90f5-c2ca49c662fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:13.578933 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-768902d4-a14a-47d2-90f5-c2ca49c662fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:13.704612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-768902d4-a14a-47d2-90f5-c2ca49c662fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:13.712487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-768902d4-a14a-47d2-90f5-c2ca49c662fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.146955 Jul 14 10:12:13.713055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1254/2510] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:13 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:13.721275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8b50fd48-f7ed-4e19-afa7-7dfe8efad09f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:13.721876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8b50fd48-f7ed-4e19-afa7-7dfe8efad09f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:13.728548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b50fd48-f7ed-4e19-afa7-7dfe8efad09f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:13.728993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b50fd48-f7ed-4e19-afa7-7dfe8efad09f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:13.729786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b50fd48-f7ed-4e19-afa7-7dfe8efad09f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:13.730178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b50fd48-f7ed-4e19-afa7-7dfe8efad09f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:13.857402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8b50fd48-f7ed-4e19-afa7-7dfe8efad09f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:13.865697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8b50fd48-f7ed-4e19-afa7-7dfe8efad09f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.148373 Jul 14 10:12:13.866286 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1257/2511] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:13 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:14.067813 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b19314be-b3bf-4dc6-8f10-47de826c31cb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:14.068428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b19314be-b3bf-4dc6-8f10-47de826c31cb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:14.074569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b19314be-b3bf-4dc6-8f10-47de826c31cb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:14.075026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b19314be-b3bf-4dc6-8f10-47de826c31cb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:14.075793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b19314be-b3bf-4dc6-8f10-47de826c31cb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:14.076235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b19314be-b3bf-4dc6-8f10-47de826c31cb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:14.139525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b19314be-b3bf-4dc6-8f10-47de826c31cb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:14.147549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b19314be-b3bf-4dc6-8f10-47de826c31cb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083644 Jul 14 10:12:14.148115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1255/2512] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:14 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:14.728812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e8c2374d-9964-4347-9675-509da05ae41b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:14.729397 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e8c2374d-9964-4347-9675-509da05ae41b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:14.736736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8c2374d-9964-4347-9675-509da05ae41b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:14.737172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8c2374d-9964-4347-9675-509da05ae41b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:14.737922 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8c2374d-9964-4347-9675-509da05ae41b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:14.738388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8c2374d-9964-4347-9675-509da05ae41b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:14.871765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e8c2374d-9964-4347-9675-509da05ae41b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:14.880329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e8c2374d-9964-4347-9675-509da05ae41b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155323 Jul 14 10:12:14.881058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1258/2513] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:14.882774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-75d2ea3c-f3e2-4050-881f-765264a8f27e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:14.883441 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-75d2ea3c-f3e2-4050-881f-765264a8f27e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:14.890536 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75d2ea3c-f3e2-4050-881f-765264a8f27e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:14.891021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75d2ea3c-f3e2-4050-881f-765264a8f27e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:14.891802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75d2ea3c-f3e2-4050-881f-765264a8f27e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:14.892238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75d2ea3c-f3e2-4050-881f-765264a8f27e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:15.023650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-75d2ea3c-f3e2-4050-881f-765264a8f27e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:15.032369 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-75d2ea3c-f3e2-4050-881f-765264a8f27e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153403 Jul 14 10:12:15.032945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1256/2514] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:14 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:15.164932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f6088695-b4b6-4a7c-9da6-2e35487d151c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:15.165670 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f6088695-b4b6-4a7c-9da6-2e35487d151c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:15.171790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6088695-b4b6-4a7c-9da6-2e35487d151c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:15.172235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6088695-b4b6-4a7c-9da6-2e35487d151c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:15.173012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6088695-b4b6-4a7c-9da6-2e35487d151c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:15.173711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f6088695-b4b6-4a7c-9da6-2e35487d151c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:15.189092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:15.239560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f6088695-b4b6-4a7c-9da6-2e35487d151c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:15.247657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f6088695-b4b6-4a7c-9da6-2e35487d151c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086634 Jul 14 10:12:15.248224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1259/2515] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:15 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:15.898107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f9ddb73e-848c-4aa4-bc02-a31cdbbdd92f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:15.898743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f9ddb73e-848c-4aa4-bc02-a31cdbbdd92f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:15.905344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9ddb73e-848c-4aa4-bc02-a31cdbbdd92f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:15.905793 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9ddb73e-848c-4aa4-bc02-a31cdbbdd92f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:15.906576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9ddb73e-848c-4aa4-bc02-a31cdbbdd92f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:15.907085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9ddb73e-848c-4aa4-bc02-a31cdbbdd92f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:16.041668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f9ddb73e-848c-4aa4-bc02-a31cdbbdd92f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:16.050777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f9ddb73e-848c-4aa4-bc02-a31cdbbdd92f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.156453 Jul 14 10:12:16.051008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5db5300f-e8f4-493e-9585-90c25636802e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:16.051571 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5db5300f-e8f4-493e-9585-90c25636802e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:16.051733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1257/2516] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:16.058850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5db5300f-e8f4-493e-9585-90c25636802e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:16.059296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5db5300f-e8f4-493e-9585-90c25636802e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:16.060061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5db5300f-e8f4-493e-9585-90c25636802e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:16.060493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5db5300f-e8f4-493e-9585-90c25636802e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:16.191323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5db5300f-e8f4-493e-9585-90c25636802e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:16.199389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5db5300f-e8f4-493e-9585-90c25636802e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153254 Jul 14 10:12:16.199978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1260/2517] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:16 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:16.264307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-50e58527-a9e4-41c2-89cf-24084ad6ca35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:16.264840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-50e58527-a9e4-41c2-89cf-24084ad6ca35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:16.271524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50e58527-a9e4-41c2-89cf-24084ad6ca35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:16.271971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50e58527-a9e4-41c2-89cf-24084ad6ca35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:16.272729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50e58527-a9e4-41c2-89cf-24084ad6ca35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:16.273159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50e58527-a9e4-41c2-89cf-24084ad6ca35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:16.340804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-50e58527-a9e4-41c2-89cf-24084ad6ca35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:16.343023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:16.350310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-50e58527-a9e4-41c2-89cf-24084ad6ca35 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089968 Jul 14 10:12:16.351028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1258/2518] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:16 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:16.670032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c6fb3329-ce42-451b-85db-8bfe0db84d2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:16.670560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c6fb3329-ce42-451b-85db-8bfe0db84d2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:16.677437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6fb3329-ce42-451b-85db-8bfe0db84d2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:16.677870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6fb3329-ce42-451b-85db-8bfe0db84d2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:16.678658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6fb3329-ce42-451b-85db-8bfe0db84d2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:16.679084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c6fb3329-ce42-451b-85db-8bfe0db84d2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:16.702516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c6fb3329-ce42-451b-85db-8bfe0db84d2a tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc/ips" status: 200 len: 151 microversion: 2.20 time: 0.036295 Jul 14 10:12:16.703095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1261/2519] 10.222.0.40 () {60 vars in 1288 bytes} [Thu Jul 14 10:12:16 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:12:17.068943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-065cddc5-9167-4f9e-af40-07f53590d851 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:17.069576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-065cddc5-9167-4f9e-af40-07f53590d851 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:17.076070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-065cddc5-9167-4f9e-af40-07f53590d851 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:17.076512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-065cddc5-9167-4f9e-af40-07f53590d851 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:17.077257 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-065cddc5-9167-4f9e-af40-07f53590d851 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:17.077690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-065cddc5-9167-4f9e-af40-07f53590d851 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:17.204096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-065cddc5-9167-4f9e-af40-07f53590d851 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:17.212223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-065cddc5-9167-4f9e-af40-07f53590d851 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.147127 Jul 14 10:12:17.212792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1259/2520] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:17.216885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a9d84fe9-9e9d-4325-9d0c-5ab86c6bc464 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:17.217498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a9d84fe9-9e9d-4325-9d0c-5ab86c6bc464 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:17.224600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a9d84fe9-9e9d-4325-9d0c-5ab86c6bc464 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:17.225043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a9d84fe9-9e9d-4325-9d0c-5ab86c6bc464 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:17.225797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a9d84fe9-9e9d-4325-9d0c-5ab86c6bc464 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:17.226249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a9d84fe9-9e9d-4325-9d0c-5ab86c6bc464 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:17.358407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a9d84fe9-9e9d-4325-9d0c-5ab86c6bc464 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:17.367289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a678dff7-4838-4c50-a86a-c12009ae0369 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:17.367468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a9d84fe9-9e9d-4325-9d0c-5ab86c6bc464 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154375 Jul 14 10:12:17.367898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a678dff7-4838-4c50-a86a-c12009ae0369 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:17.368060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1262/2521] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:17 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:17.374061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a678dff7-4838-4c50-a86a-c12009ae0369 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:17.374564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a678dff7-4838-4c50-a86a-c12009ae0369 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:17.375738 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a678dff7-4838-4c50-a86a-c12009ae0369 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:17.375913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a678dff7-4838-4c50-a86a-c12009ae0369 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:17.439861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a678dff7-4838-4c50-a86a-c12009ae0369 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:17.447782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a678dff7-4838-4c50-a86a-c12009ae0369 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.084326 Jul 14 10:12:17.448341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1260/2522] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:17 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:18.229791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-64171583-780f-4d0b-8356-3cd3cf1eb063 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:18.230537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-64171583-780f-4d0b-8356-3cd3cf1eb063 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:18.237505 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-64171583-780f-4d0b-8356-3cd3cf1eb063 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:18.237950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-64171583-780f-4d0b-8356-3cd3cf1eb063 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:18.238764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-64171583-780f-4d0b-8356-3cd3cf1eb063 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:18.239182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-64171583-780f-4d0b-8356-3cd3cf1eb063 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:18.371570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-64171583-780f-4d0b-8356-3cd3cf1eb063 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:18.384336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-95ab7806-8eb8-4795-8ccc-16faecfe13f0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:18.384896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-64171583-780f-4d0b-8356-3cd3cf1eb063 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.158744 Jul 14 10:12:18.385012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-95ab7806-8eb8-4795-8ccc-16faecfe13f0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:18.385193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1263/2523] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:18 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:18.391635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-95ab7806-8eb8-4795-8ccc-16faecfe13f0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:18.392083 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-95ab7806-8eb8-4795-8ccc-16faecfe13f0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:18.392847 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-95ab7806-8eb8-4795-8ccc-16faecfe13f0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:18.393282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-95ab7806-8eb8-4795-8ccc-16faecfe13f0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:18.464875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e5789c24-feed-468d-9bc5-017ce35cc62c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:18.465479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e5789c24-feed-468d-9bc5-017ce35cc62c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:18.471653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5789c24-feed-468d-9bc5-017ce35cc62c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:18.472113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5789c24-feed-468d-9bc5-017ce35cc62c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:18.472851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5789c24-feed-468d-9bc5-017ce35cc62c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:18.473277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e5789c24-feed-468d-9bc5-017ce35cc62c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:18.546223 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e5789c24-feed-468d-9bc5-017ce35cc62c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:18.550320 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-95ab7806-8eb8-4795-8ccc-16faecfe13f0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:18.555734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e5789c24-feed-468d-9bc5-017ce35cc62c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.094662 Jul 14 10:12:18.556495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1264/2524] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:18 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:18.559234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-95ab7806-8eb8-4795-8ccc-16faecfe13f0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.178653 Jul 14 10:12:18.560101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1261/2525] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:18 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:19.404513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7080a0de-af1e-4784-9576-144e6192ab4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:19.405484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7080a0de-af1e-4784-9576-144e6192ab4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:19.413150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7080a0de-af1e-4784-9576-144e6192ab4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:19.413591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7080a0de-af1e-4784-9576-144e6192ab4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:19.414384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7080a0de-af1e-4784-9576-144e6192ab4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:19.414818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7080a0de-af1e-4784-9576-144e6192ab4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:19.541201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7080a0de-af1e-4784-9576-144e6192ab4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:19.550161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7080a0de-af1e-4784-9576-144e6192ab4b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152124 Jul 14 10:12:19.550743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1265/2526] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:19 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:19.572541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c75f9110-7547-43d8-8697-ffb4fb021066 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:19.573156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c75f9110-7547-43d8-8697-ffb4fb021066 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:19.575912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7dd4acf4-821b-47cd-9cd7-e43b8b8c3e3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:19.576517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7dd4acf4-821b-47cd-9cd7-e43b8b8c3e3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:19.579946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c75f9110-7547-43d8-8697-ffb4fb021066 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:19.580423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c75f9110-7547-43d8-8697-ffb4fb021066 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:19.581184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c75f9110-7547-43d8-8697-ffb4fb021066 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:19.581626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c75f9110-7547-43d8-8697-ffb4fb021066 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:19.582668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dd4acf4-821b-47cd-9cd7-e43b8b8c3e3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:19.583111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dd4acf4-821b-47cd-9cd7-e43b8b8c3e3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:19.583859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dd4acf4-821b-47cd-9cd7-e43b8b8c3e3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:19.584288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dd4acf4-821b-47cd-9cd7-e43b8b8c3e3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:19.669626 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c75f9110-7547-43d8-8697-ffb4fb021066 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:19.677948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c75f9110-7547-43d8-8697-ffb4fb021066 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.109240 Jul 14 10:12:19.678559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1262/2527] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:19 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:19.737592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7dd4acf4-821b-47cd-9cd7-e43b8b8c3e3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:19.745612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7dd4acf4-821b-47cd-9cd7-e43b8b8c3e3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.173428 Jul 14 10:12:19.746171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1266/2528] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:19 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:20.567213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ecb1ad79-a8bd-461f-a5a6-e53b8dfd9d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:20.567854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ecb1ad79-a8bd-461f-a5a6-e53b8dfd9d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:20.574592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecb1ad79-a8bd-461f-a5a6-e53b8dfd9d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:20.575149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecb1ad79-a8bd-461f-a5a6-e53b8dfd9d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:20.575777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecb1ad79-a8bd-461f-a5a6-e53b8dfd9d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:20.576208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ecb1ad79-a8bd-461f-a5a6-e53b8dfd9d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:20.695000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a596d3a2-7b6a-48e2-8c86-edd1800961c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:20.695596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a596d3a2-7b6a-48e2-8c86-edd1800961c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:20.702106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a596d3a2-7b6a-48e2-8c86-edd1800961c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:20.702578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a596d3a2-7b6a-48e2-8c86-edd1800961c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:20.703341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a596d3a2-7b6a-48e2-8c86-edd1800961c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:20.703771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a596d3a2-7b6a-48e2-8c86-edd1800961c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:20.707567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ecb1ad79-a8bd-461f-a5a6-e53b8dfd9d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:20.715524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ecb1ad79-a8bd-461f-a5a6-e53b8dfd9d49 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152167 Jul 14 10:12:20.716095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1263/2529] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:20.762447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8f7938f8-26b3-489f-8b0a-b504eedf9e11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:20.763062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8f7938f8-26b3-489f-8b0a-b504eedf9e11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:20.769476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f7938f8-26b3-489f-8b0a-b504eedf9e11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:20.769928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f7938f8-26b3-489f-8b0a-b504eedf9e11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:20.770728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f7938f8-26b3-489f-8b0a-b504eedf9e11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:20.771201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8f7938f8-26b3-489f-8b0a-b504eedf9e11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:20.772455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a596d3a2-7b6a-48e2-8c86-edd1800961c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:20.782041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a596d3a2-7b6a-48e2-8c86-edd1800961c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090244 Jul 14 10:12:20.783279 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1267/2530] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:20 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:20.902411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8f7938f8-26b3-489f-8b0a-b504eedf9e11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:20.911051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8f7938f8-26b3-489f-8b0a-b504eedf9e11 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.152617 Jul 14 10:12:20.911633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1264/2531] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:20 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:21.732711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-38a91407-bbf6-4a1b-a254-8a8fed49c66a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:21.733321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-38a91407-bbf6-4a1b-a254-8a8fed49c66a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:21.739906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a91407-bbf6-4a1b-a254-8a8fed49c66a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:21.740352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a91407-bbf6-4a1b-a254-8a8fed49c66a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:21.741118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a91407-bbf6-4a1b-a254-8a8fed49c66a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:21.741547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38a91407-bbf6-4a1b-a254-8a8fed49c66a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:21.800859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0fa9a25a-9b9e-4ea4-a5e8-442f6d7ab1a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:21.801480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0fa9a25a-9b9e-4ea4-a5e8-442f6d7ab1a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:21.808200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0fa9a25a-9b9e-4ea4-a5e8-442f6d7ab1a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:21.808731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0fa9a25a-9b9e-4ea4-a5e8-442f6d7ab1a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:21.809568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0fa9a25a-9b9e-4ea4-a5e8-442f6d7ab1a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:21.810073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0fa9a25a-9b9e-4ea4-a5e8-442f6d7ab1a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:21.875775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0fa9a25a-9b9e-4ea4-a5e8-442f6d7ab1a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:21.883756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0fa9a25a-9b9e-4ea4-a5e8-442f6d7ab1a7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087131 Jul 14 10:12:21.884324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1265/2532] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:21 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:21.896968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38a91407-bbf6-4a1b-a254-8a8fed49c66a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:21.904960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-38a91407-bbf6-4a1b-a254-8a8fed49c66a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.176147 Jul 14 10:12:21.905519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1268/2533] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:21 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:21.928871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a1ba88e6-c93f-4ad8-988e-01ed920b8433 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:21.929478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a1ba88e6-c93f-4ad8-988e-01ed920b8433 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:21.935806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1ba88e6-c93f-4ad8-988e-01ed920b8433 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:21.936251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1ba88e6-c93f-4ad8-988e-01ed920b8433 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:21.936997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1ba88e6-c93f-4ad8-988e-01ed920b8433 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:21.937425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a1ba88e6-c93f-4ad8-988e-01ed920b8433 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:22.071713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a1ba88e6-c93f-4ad8-988e-01ed920b8433 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:22.079892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a1ba88e6-c93f-4ad8-988e-01ed920b8433 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.154989 Jul 14 10:12:22.080452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1266/2534] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:21 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:22.901084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-de6f9047-caea-40d4-8a80-7d528c840c2b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:22.901645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-de6f9047-caea-40d4-8a80-7d528c840c2b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:22.908774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de6f9047-caea-40d4-8a80-7d528c840c2b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:22.909216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de6f9047-caea-40d4-8a80-7d528c840c2b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:22.909965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de6f9047-caea-40d4-8a80-7d528c840c2b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:22.910426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de6f9047-caea-40d4-8a80-7d528c840c2b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:22.921896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-84a06ebd-bb72-4edf-9ce3-e1d973b0a473 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:22.922577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-84a06ebd-bb72-4edf-9ce3-e1d973b0a473 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:22.929445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84a06ebd-bb72-4edf-9ce3-e1d973b0a473 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:22.929895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84a06ebd-bb72-4edf-9ce3-e1d973b0a473 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:22.930695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84a06ebd-bb72-4edf-9ce3-e1d973b0a473 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:22.931135 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84a06ebd-bb72-4edf-9ce3-e1d973b0a473 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:22.981854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-de6f9047-caea-40d4-8a80-7d528c840c2b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:22.990821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-de6f9047-caea-40d4-8a80-7d528c840c2b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.093664 Jul 14 10:12:22.991389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1269/2535] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:22 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:23.069476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-84a06ebd-bb72-4edf-9ce3-e1d973b0a473 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:23.077547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-84a06ebd-bb72-4edf-9ce3-e1d973b0a473 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.159456 Jul 14 10:12:23.078115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1267/2536] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:22 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:23.096751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-642f2ace-2cc1-4065-8e92-721568d0287a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:23.097349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-642f2ace-2cc1-4065-8e92-721568d0287a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:23.103354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-642f2ace-2cc1-4065-8e92-721568d0287a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:23.103784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-642f2ace-2cc1-4065-8e92-721568d0287a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:23.104551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-642f2ace-2cc1-4065-8e92-721568d0287a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:23.104973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-642f2ace-2cc1-4065-8e92-721568d0287a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:23.238588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-642f2ace-2cc1-4065-8e92-721568d0287a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:23.246615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-642f2ace-2cc1-4065-8e92-721568d0287a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153713 Jul 14 10:12:23.247187 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1270/2537] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:23 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:24.008453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c0de3640-451f-406f-bc4b-bfd262cb6a78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:24.009057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c0de3640-451f-406f-bc4b-bfd262cb6a78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:24.015590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0de3640-451f-406f-bc4b-bfd262cb6a78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:24.016034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0de3640-451f-406f-bc4b-bfd262cb6a78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:24.016792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0de3640-451f-406f-bc4b-bfd262cb6a78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:24.017222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c0de3640-451f-406f-bc4b-bfd262cb6a78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:24.079112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c0de3640-451f-406f-bc4b-bfd262cb6a78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:24.087275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c0de3640-451f-406f-bc4b-bfd262cb6a78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083174 Jul 14 10:12:24.087834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1268/2538] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:24 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:24.096179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9ac9c7e3-de26-41da-a25e-09a4c7fa21f6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:24.096787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9ac9c7e3-de26-41da-a25e-09a4c7fa21f6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:24.104617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ac9c7e3-de26-41da-a25e-09a4c7fa21f6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:24.104617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ac9c7e3-de26-41da-a25e-09a4c7fa21f6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:24.104901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ac9c7e3-de26-41da-a25e-09a4c7fa21f6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:24.105083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9ac9c7e3-de26-41da-a25e-09a4c7fa21f6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:24.235383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9ac9c7e3-de26-41da-a25e-09a4c7fa21f6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:24.243315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9ac9c7e3-de26-41da-a25e-09a4c7fa21f6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.151508 Jul 14 10:12:24.243882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1271/2539] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:24 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:24.264160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-335bf360-37ea-4610-aed9-c12036b8b0b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:24.264704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-335bf360-37ea-4610-aed9-c12036b8b0b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:24.271480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-335bf360-37ea-4610-aed9-c12036b8b0b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:24.271936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-335bf360-37ea-4610-aed9-c12036b8b0b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:24.272703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-335bf360-37ea-4610-aed9-c12036b8b0b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:24.273143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-335bf360-37ea-4610-aed9-c12036b8b0b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:24.410165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-335bf360-37ea-4610-aed9-c12036b8b0b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:24.418132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-335bf360-37ea-4610-aed9-c12036b8b0b5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.157964 Jul 14 10:12:24.418720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1269/2540] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:24 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:25.105166 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-27821b1b-8f51-4a36-9858-54c7eecb874f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:25.105723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-27821b1b-8f51-4a36-9858-54c7eecb874f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:25.112847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27821b1b-8f51-4a36-9858-54c7eecb874f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:25.113294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27821b1b-8f51-4a36-9858-54c7eecb874f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:25.114086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27821b1b-8f51-4a36-9858-54c7eecb874f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:25.114554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27821b1b-8f51-4a36-9858-54c7eecb874f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:25.180163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-27821b1b-8f51-4a36-9858-54c7eecb874f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:25.188618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-27821b1b-8f51-4a36-9858-54c7eecb874f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.087532 Jul 14 10:12:25.189172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1272/2541] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:25 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:25.260475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5aa7f690-4221-4050-a036-be86c1d563e7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:25.261090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5aa7f690-4221-4050-a036-be86c1d563e7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:25.267759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5aa7f690-4221-4050-a036-be86c1d563e7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:25.268202 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5aa7f690-4221-4050-a036-be86c1d563e7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:25.268971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5aa7f690-4221-4050-a036-be86c1d563e7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:25.269405 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5aa7f690-4221-4050-a036-be86c1d563e7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:25.399020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5aa7f690-4221-4050-a036-be86c1d563e7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:25.407410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5aa7f690-4221-4050-a036-be86c1d563e7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.150904 Jul 14 10:12:25.407974 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1270/2542] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:25 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:25.435327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9d653484-d613-4527-a0b7-66046f093a20 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:25.435942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9d653484-d613-4527-a0b7-66046f093a20 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:25.442115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d653484-d613-4527-a0b7-66046f093a20 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:25.442613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d653484-d613-4527-a0b7-66046f093a20 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:25.443370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d653484-d613-4527-a0b7-66046f093a20 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:25.443827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9d653484-d613-4527-a0b7-66046f093a20 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:25.572235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9d653484-d613-4527-a0b7-66046f093a20 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:25.580726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9d653484-d613-4527-a0b7-66046f093a20 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149250 Jul 14 10:12:25.581301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1273/2543] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:25 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:26.205537 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7940db80-178c-4dcb-bd45-15878bb5bd0e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:26.206148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7940db80-178c-4dcb-bd45-15878bb5bd0e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:26.212238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7940db80-178c-4dcb-bd45-15878bb5bd0e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:26.212713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7940db80-178c-4dcb-bd45-15878bb5bd0e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:26.213631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7940db80-178c-4dcb-bd45-15878bb5bd0e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:26.213966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7940db80-178c-4dcb-bd45-15878bb5bd0e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:26.275255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7940db80-178c-4dcb-bd45-15878bb5bd0e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:26.283825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7940db80-178c-4dcb-bd45-15878bb5bd0e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082215 Jul 14 10:12:26.284397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1271/2544] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:26 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:26.425699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-96ea1d67-4847-4ce9-8638-2b779fc2bf26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:26.426327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-96ea1d67-4847-4ce9-8638-2b779fc2bf26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:26.432800 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96ea1d67-4847-4ce9-8638-2b779fc2bf26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:26.433240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96ea1d67-4847-4ce9-8638-2b779fc2bf26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:26.433987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96ea1d67-4847-4ce9-8638-2b779fc2bf26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:26.434438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96ea1d67-4847-4ce9-8638-2b779fc2bf26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:26.568479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-96ea1d67-4847-4ce9-8638-2b779fc2bf26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:26.576447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-96ea1d67-4847-4ce9-8638-2b779fc2bf26 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.155107 Jul 14 10:12:26.577003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1274/2545] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:26 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:26.596960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d63f9518-b452-47d7-b85a-cf05d8281cb9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:26.597576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d63f9518-b452-47d7-b85a-cf05d8281cb9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:26.603643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d63f9518-b452-47d7-b85a-cf05d8281cb9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:26.604098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d63f9518-b452-47d7-b85a-cf05d8281cb9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:26.604867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d63f9518-b452-47d7-b85a-cf05d8281cb9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:26.605307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d63f9518-b452-47d7-b85a-cf05d8281cb9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:26.735527 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d63f9518-b452-47d7-b85a-cf05d8281cb9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:26.743451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d63f9518-b452-47d7-b85a-cf05d8281cb9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150544 Jul 14 10:12:26.744014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1272/2546] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:26 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:27.300912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-83300d70-d9c0-4f87-88f5-88fbd121ee7b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:27.301516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-83300d70-d9c0-4f87-88f5-88fbd121ee7b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:27.307644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83300d70-d9c0-4f87-88f5-88fbd121ee7b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:27.308087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83300d70-d9c0-4f87-88f5-88fbd121ee7b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:27.308842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83300d70-d9c0-4f87-88f5-88fbd121ee7b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:27.309273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83300d70-d9c0-4f87-88f5-88fbd121ee7b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:27.378748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-83300d70-d9c0-4f87-88f5-88fbd121ee7b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:27.386609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-83300d70-d9c0-4f87-88f5-88fbd121ee7b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089821 Jul 14 10:12:27.387160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1275/2547] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:27 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:27.592805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-63a096ae-ea18-4513-b53d-2df5f4aa08df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:27.593422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-63a096ae-ea18-4513-b53d-2df5f4aa08df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:27.600033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63a096ae-ea18-4513-b53d-2df5f4aa08df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:27.600487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63a096ae-ea18-4513-b53d-2df5f4aa08df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:27.601249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63a096ae-ea18-4513-b53d-2df5f4aa08df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:27.601683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-63a096ae-ea18-4513-b53d-2df5f4aa08df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:27.732740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-63a096ae-ea18-4513-b53d-2df5f4aa08df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:27.741284 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-63a096ae-ea18-4513-b53d-2df5f4aa08df tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152288 Jul 14 10:12:27.741849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1273/2548] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:27.760855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bedf8b55-467b-4752-b2d8-bc1642e8b280 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:27.761465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bedf8b55-467b-4752-b2d8-bc1642e8b280 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:27.768681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bedf8b55-467b-4752-b2d8-bc1642e8b280 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:27.769123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bedf8b55-467b-4752-b2d8-bc1642e8b280 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:27.769878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bedf8b55-467b-4752-b2d8-bc1642e8b280 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:27.770352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bedf8b55-467b-4752-b2d8-bc1642e8b280 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:27.785389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:27.901793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bedf8b55-467b-4752-b2d8-bc1642e8b280 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:27.909924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bedf8b55-467b-4752-b2d8-bc1642e8b280 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.153001 Jul 14 10:12:27.910512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1276/2549] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:27 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:28.403996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-27b369b3-4f37-4fe2-a28e-128e321e6677 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:28.404608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-27b369b3-4f37-4fe2-a28e-128e321e6677 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:28.410745 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27b369b3-4f37-4fe2-a28e-128e321e6677 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:28.411199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27b369b3-4f37-4fe2-a28e-128e321e6677 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:28.411957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27b369b3-4f37-4fe2-a28e-128e321e6677 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:28.412393 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27b369b3-4f37-4fe2-a28e-128e321e6677 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:28.478817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-27b369b3-4f37-4fe2-a28e-128e321e6677 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:28.486778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-27b369b3-4f37-4fe2-a28e-128e321e6677 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086610 Jul 14 10:12:28.487345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1274/2550] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:28 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:28.758638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-76cdb935-6bcc-4f42-81e5-f53621a90b42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:28.759240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-76cdb935-6bcc-4f42-81e5-f53621a90b42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:28.765803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76cdb935-6bcc-4f42-81e5-f53621a90b42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:28.766454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76cdb935-6bcc-4f42-81e5-f53621a90b42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:28.767161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76cdb935-6bcc-4f42-81e5-f53621a90b42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:28.767624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76cdb935-6bcc-4f42-81e5-f53621a90b42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:28.898805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-76cdb935-6bcc-4f42-81e5-f53621a90b42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:28.907248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-76cdb935-6bcc-4f42-81e5-f53621a90b42 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.152343 Jul 14 10:12:28.907826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1277/2551] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:28.928148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f2065fe6-3d0a-44fa-9ea2-94ce371da268 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:28.928148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f2065fe6-3d0a-44fa-9ea2-94ce371da268 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:28.935164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2065fe6-3d0a-44fa-9ea2-94ce371da268 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:28.935613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2065fe6-3d0a-44fa-9ea2-94ce371da268 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:28.936388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2065fe6-3d0a-44fa-9ea2-94ce371da268 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:28.936823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2065fe6-3d0a-44fa-9ea2-94ce371da268 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:28.952525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:29.066287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f2065fe6-3d0a-44fa-9ea2-94ce371da268 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:29.074316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f2065fe6-3d0a-44fa-9ea2-94ce371da268 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.150877 Jul 14 10:12:29.074879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1275/2552] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:28 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:29.503433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-06007904-bf6f-4862-aa9e-ab287a989fd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:29.504034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-06007904-bf6f-4862-aa9e-ab287a989fd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:29.510341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06007904-bf6f-4862-aa9e-ab287a989fd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:29.510786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06007904-bf6f-4862-aa9e-ab287a989fd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:29.511546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06007904-bf6f-4862-aa9e-ab287a989fd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:29.511975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-06007904-bf6f-4862-aa9e-ab287a989fd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:29.590337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-06007904-bf6f-4862-aa9e-ab287a989fd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:29.599467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-06007904-bf6f-4862-aa9e-ab287a989fd7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.099841 Jul 14 10:12:29.600027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1278/2553] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:29 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:29.925493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9a5ff704-ff0b-4008-b26f-8846ca56e38d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:29.926054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9a5ff704-ff0b-4008-b26f-8846ca56e38d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:29.932816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a5ff704-ff0b-4008-b26f-8846ca56e38d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:29.933391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a5ff704-ff0b-4008-b26f-8846ca56e38d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:29.933998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a5ff704-ff0b-4008-b26f-8846ca56e38d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:29.934479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a5ff704-ff0b-4008-b26f-8846ca56e38d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:30.069704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9a5ff704-ff0b-4008-b26f-8846ca56e38d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:30.078009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9a5ff704-ff0b-4008-b26f-8846ca56e38d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.156927 Jul 14 10:12:30.079328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1276/2554] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:30.091094 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7dc73a47-a4b8-4be6-9997-4fbf7db22eae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:30.091697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7dc73a47-a4b8-4be6-9997-4fbf7db22eae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:30.098350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dc73a47-a4b8-4be6-9997-4fbf7db22eae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:30.098781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dc73a47-a4b8-4be6-9997-4fbf7db22eae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:30.099535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dc73a47-a4b8-4be6-9997-4fbf7db22eae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:30.099964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7dc73a47-a4b8-4be6-9997-4fbf7db22eae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:30.228338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7dc73a47-a4b8-4be6-9997-4fbf7db22eae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:30.236861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7dc73a47-a4b8-4be6-9997-4fbf7db22eae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.149573 Jul 14 10:12:30.237423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1279/2555] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:30 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:30.616037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2cb59c82-9daf-4f74-bed3-872a09016702 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:30.616650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2cb59c82-9daf-4f74-bed3-872a09016702 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:30.622880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cb59c82-9daf-4f74-bed3-872a09016702 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:30.623336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cb59c82-9daf-4f74-bed3-872a09016702 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:30.624100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cb59c82-9daf-4f74-bed3-872a09016702 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:30.624541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2cb59c82-9daf-4f74-bed3-872a09016702 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:30.689157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2cb59c82-9daf-4f74-bed3-872a09016702 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:30.697174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2cb59c82-9daf-4f74-bed3-872a09016702 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085063 Jul 14 10:12:30.697729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1277/2556] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:30 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:31.096168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-44e5cac4-1444-4508-83f6-bd143b3b7a5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:31.096770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-44e5cac4-1444-4508-83f6-bd143b3b7a5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:31.103677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44e5cac4-1444-4508-83f6-bd143b3b7a5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:31.104117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44e5cac4-1444-4508-83f6-bd143b3b7a5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:31.104878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44e5cac4-1444-4508-83f6-bd143b3b7a5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:31.105309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-44e5cac4-1444-4508-83f6-bd143b3b7a5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:31.232998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-44e5cac4-1444-4508-83f6-bd143b3b7a5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:31.241503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-44e5cac4-1444-4508-83f6-bd143b3b7a5e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.149229 Jul 14 10:12:31.242067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1280/2557] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:31.253276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-624b6131-f52b-4fb2-9c89-15b58d02e997 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:31.253888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-624b6131-f52b-4fb2-9c89-15b58d02e997 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:31.260609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-624b6131-f52b-4fb2-9c89-15b58d02e997 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:31.261057 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-624b6131-f52b-4fb2-9c89-15b58d02e997 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:31.261811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-624b6131-f52b-4fb2-9c89-15b58d02e997 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:31.262274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-624b6131-f52b-4fb2-9c89-15b58d02e997 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:31.392693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-624b6131-f52b-4fb2-9c89-15b58d02e997 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:31.400627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-624b6131-f52b-4fb2-9c89-15b58d02e997 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.151788 Jul 14 10:12:31.401180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1278/2558] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:31 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:31.714395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef1a4f16-9612-4a18-af95-7ae512ac05f6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:31.714999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ef1a4f16-9612-4a18-af95-7ae512ac05f6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:31.721562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef1a4f16-9612-4a18-af95-7ae512ac05f6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:31.721994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef1a4f16-9612-4a18-af95-7ae512ac05f6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:31.722769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef1a4f16-9612-4a18-af95-7ae512ac05f6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:31.723190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef1a4f16-9612-4a18-af95-7ae512ac05f6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:31.787776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ef1a4f16-9612-4a18-af95-7ae512ac05f6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:31.795646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ef1a4f16-9612-4a18-af95-7ae512ac05f6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085347 Jul 14 10:12:31.796207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1281/2559] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:31 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:32.259455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c6c4c809-c247-4f68-a941-111624e82661 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:32.260069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c6c4c809-c247-4f68-a941-111624e82661 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:32.262706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=82 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:32.268784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c6c4c809-c247-4f68-a941-111624e82661 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:32.269224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c6c4c809-c247-4f68-a941-111624e82661 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:32.269994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c6c4c809-c247-4f68-a941-111624e82661 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:32.270460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c6c4c809-c247-4f68-a941-111624e82661 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:32.403996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c6c4c809-c247-4f68-a941-111624e82661 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:32.418044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c6c4c809-c247-4f68-a941-111624e82661 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.162511 Jul 14 10:12:32.418983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b44f2be0-3b80-4f68-8e23-57559963b48e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:32.418983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b44f2be0-3b80-4f68-8e23-57559963b48e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:32.419535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1279/2560] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:32.426007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b44f2be0-3b80-4f68-8e23-57559963b48e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:32.426474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b44f2be0-3b80-4f68-8e23-57559963b48e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:32.427272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b44f2be0-3b80-4f68-8e23-57559963b48e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:32.427702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b44f2be0-3b80-4f68-8e23-57559963b48e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:32.566016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b44f2be0-3b80-4f68-8e23-57559963b48e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:32.574045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b44f2be0-3b80-4f68-8e23-57559963b48e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.159769 Jul 14 10:12:32.574651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1282/2561] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:32 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:32.813076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f2f6f373-3873-4dbd-bd44-2037a4a26fea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:32.813585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f2f6f373-3873-4dbd-bd44-2037a4a26fea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:32.819672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2f6f373-3873-4dbd-bd44-2037a4a26fea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:32.820123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2f6f373-3873-4dbd-bd44-2037a4a26fea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:32.820884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2f6f373-3873-4dbd-bd44-2037a4a26fea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:32.821325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f2f6f373-3873-4dbd-bd44-2037a4a26fea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:32.886263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f2f6f373-3873-4dbd-bd44-2037a4a26fea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:32.894412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f2f6f373-3873-4dbd-bd44-2037a4a26fea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085368 Jul 14 10:12:32.894978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1280/2562] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:32 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:33.436129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0ba7dd5a-2862-461d-b7bb-e676ebaa77c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:33.436734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0ba7dd5a-2862-461d-b7bb-e676ebaa77c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:33.444034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ba7dd5a-2862-461d-b7bb-e676ebaa77c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:33.444474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ba7dd5a-2862-461d-b7bb-e676ebaa77c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:33.445233 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ba7dd5a-2862-461d-b7bb-e676ebaa77c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:33.445663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0ba7dd5a-2862-461d-b7bb-e676ebaa77c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:33.590816 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dd9a2aed-bd04-43da-87d7-959b4b84ff87 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:33.591443 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dd9a2aed-bd04-43da-87d7-959b4b84ff87 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:33.598879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd9a2aed-bd04-43da-87d7-959b4b84ff87 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:33.599322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd9a2aed-bd04-43da-87d7-959b4b84ff87 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:33.600100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd9a2aed-bd04-43da-87d7-959b4b84ff87 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:33.600531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dd9a2aed-bd04-43da-87d7-959b4b84ff87 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:33.888405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0ba7dd5a-2862-461d-b7bb-e676ebaa77c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:33.896991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0ba7dd5a-2862-461d-b7bb-e676ebaa77c4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.464984 Jul 14 10:12:33.897558 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1283/2563] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:33.911388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f682dfb0-191e-445a-8d53-90bd049d2bf9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:33.911996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f682dfb0-191e-445a-8d53-90bd049d2bf9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:33.913086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dd9a2aed-bd04-43da-87d7-959b4b84ff87 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:33.917989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f682dfb0-191e-445a-8d53-90bd049d2bf9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:33.918469 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f682dfb0-191e-445a-8d53-90bd049d2bf9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:33.919228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f682dfb0-191e-445a-8d53-90bd049d2bf9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:33.919654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f682dfb0-191e-445a-8d53-90bd049d2bf9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:33.921089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dd9a2aed-bd04-43da-87d7-959b4b84ff87 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.334233 Jul 14 10:12:33.921662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1281/2564] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:33 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:33.980773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f682dfb0-191e-445a-8d53-90bd049d2bf9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:33.990641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f682dfb0-191e-445a-8d53-90bd049d2bf9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082823 Jul 14 10:12:33.991067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1284/2565] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:33 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:34.914242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-78fefd2d-b397-43d8-a37b-99b8f1bbebf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:34.914776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-78fefd2d-b397-43d8-a37b-99b8f1bbebf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:34.921335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78fefd2d-b397-43d8-a37b-99b8f1bbebf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:34.921789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78fefd2d-b397-43d8-a37b-99b8f1bbebf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:34.923151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78fefd2d-b397-43d8-a37b-99b8f1bbebf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:34.923588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-78fefd2d-b397-43d8-a37b-99b8f1bbebf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:34.939896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-96a2672b-2ad4-4116-967f-dab64d704994 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:34.940509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-96a2672b-2ad4-4116-967f-dab64d704994 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:34.947045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96a2672b-2ad4-4116-967f-dab64d704994 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:34.947515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96a2672b-2ad4-4116-967f-dab64d704994 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:34.948280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96a2672b-2ad4-4116-967f-dab64d704994 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:34.948711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-96a2672b-2ad4-4116-967f-dab64d704994 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:35.122548 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-78fefd2d-b397-43d8-a37b-99b8f1bbebf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:35.129420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-96a2672b-2ad4-4116-967f-dab64d704994 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:35.131068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-78fefd2d-b397-43d8-a37b-99b8f1bbebf1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.220747 Jul 14 10:12:35.131739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1282/2566] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:35.136529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7d33de2f-782a-46a2-9c84-7f594b7ad279 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:35.137224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7d33de2f-782a-46a2-9c84-7f594b7ad279 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:35.138228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-96a2672b-2ad4-4116-967f-dab64d704994 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.202755 Jul 14 10:12:35.138946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1285/2567] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:34 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:35.144216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d33de2f-782a-46a2-9c84-7f594b7ad279 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:35.144801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d33de2f-782a-46a2-9c84-7f594b7ad279 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:35.145837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d33de2f-782a-46a2-9c84-7f594b7ad279 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:35.146385 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d33de2f-782a-46a2-9c84-7f594b7ad279 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:35.208799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7d33de2f-782a-46a2-9c84-7f594b7ad279 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:35.216646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7d33de2f-782a-46a2-9c84-7f594b7ad279 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.083903 Jul 14 10:12:35.217198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1283/2568] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:35 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:36.152080 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6a8f46b2-00c1-4f0e-9a10-3442fbcecac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:36.152743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6a8f46b2-00c1-4f0e-9a10-3442fbcecac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:36.159341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a8f46b2-00c1-4f0e-9a10-3442fbcecac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:36.159782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a8f46b2-00c1-4f0e-9a10-3442fbcecac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:36.160536 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a8f46b2-00c1-4f0e-9a10-3442fbcecac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:36.160670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a04726d4-b695-4a35-8a70-e95d43fc6a5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:36.161116 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a8f46b2-00c1-4f0e-9a10-3442fbcecac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:36.161216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a04726d4-b695-4a35-8a70-e95d43fc6a5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:36.167905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a04726d4-b695-4a35-8a70-e95d43fc6a5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:36.168361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a04726d4-b695-4a35-8a70-e95d43fc6a5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:36.169131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a04726d4-b695-4a35-8a70-e95d43fc6a5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:36.169572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a04726d4-b695-4a35-8a70-e95d43fc6a5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:36.356930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6a8f46b2-00c1-4f0e-9a10-3442fbcecac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:36.360699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a04726d4-b695-4a35-8a70-e95d43fc6a5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:36.365642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6a8f46b2-00c1-4f0e-9a10-3442fbcecac4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.217380 Jul 14 10:12:36.366327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1286/2569] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:36.369058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a04726d4-b695-4a35-8a70-e95d43fc6a5b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.212195 Jul 14 10:12:36.372889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1284/2570] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:36 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:36.373059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d933a6d7-6e1a-4a56-8eb0-eb0e6d0f1eff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:36.373059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d933a6d7-6e1a-4a56-8eb0-eb0e6d0f1eff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:36.377898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d933a6d7-6e1a-4a56-8eb0-eb0e6d0f1eff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:36.378393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d933a6d7-6e1a-4a56-8eb0-eb0e6d0f1eff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:36.379160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d933a6d7-6e1a-4a56-8eb0-eb0e6d0f1eff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:36.379593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d933a6d7-6e1a-4a56-8eb0-eb0e6d0f1eff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:36.441076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d933a6d7-6e1a-4a56-8eb0-eb0e6d0f1eff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:36.448931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d933a6d7-6e1a-4a56-8eb0-eb0e6d0f1eff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081662 Jul 14 10:12:36.449480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1287/2571] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:36 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:37.383746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9d5f15cc-5dea-4df9-941d-15d80156fc97 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:37.384360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9d5f15cc-5dea-4df9-941d-15d80156fc97 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:37.385513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-356adb6a-07cd-4682-a11a-b54da9add802 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:37.386117 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-356adb6a-07cd-4682-a11a-b54da9add802 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:37.391840 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d5f15cc-5dea-4df9-941d-15d80156fc97 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:37.392436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d5f15cc-5dea-4df9-941d-15d80156fc97 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:37.393218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d5f15cc-5dea-4df9-941d-15d80156fc97 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:37.393343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-356adb6a-07cd-4682-a11a-b54da9add802 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:37.393664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d5f15cc-5dea-4df9-941d-15d80156fc97 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:37.393830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-356adb6a-07cd-4682-a11a-b54da9add802 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:37.394576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-356adb6a-07cd-4682-a11a-b54da9add802 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:37.395011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-356adb6a-07cd-4682-a11a-b54da9add802 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:37.592717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9d5f15cc-5dea-4df9-941d-15d80156fc97 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:37.596769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-356adb6a-07cd-4682-a11a-b54da9add802 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:37.600956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9d5f15cc-5dea-4df9-941d-15d80156fc97 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.221046 Jul 14 10:12:37.601517 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1285/2572] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:37.604782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-356adb6a-07cd-4682-a11a-b54da9add802 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.222948 Jul 14 10:12:37.605524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1288/2573] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:37 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:37.606570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-478a9311-496c-486b-b379-c4b414bbb644 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:37.607181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-478a9311-496c-486b-b379-c4b414bbb644 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:37.613757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-478a9311-496c-486b-b379-c4b414bbb644 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:37.614225 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-478a9311-496c-486b-b379-c4b414bbb644 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:37.614990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-478a9311-496c-486b-b379-c4b414bbb644 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:37.615419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-478a9311-496c-486b-b379-c4b414bbb644 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:37.677190 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-478a9311-496c-486b-b379-c4b414bbb644 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:37.685181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-478a9311-496c-486b-b379-c4b414bbb644 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082735 Jul 14 10:12:37.685752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1286/2574] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:37 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:38.617727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5af0eb14-5121-45cf-8515-3697ca2f1399 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:38.618574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5af0eb14-5121-45cf-8515-3697ca2f1399 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:38.621071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-37caac89-976c-476c-b56f-0056bfa1ee50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:38.621721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-37caac89-976c-476c-b56f-0056bfa1ee50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:38.625106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5af0eb14-5121-45cf-8515-3697ca2f1399 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:38.625548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5af0eb14-5121-45cf-8515-3697ca2f1399 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:38.626344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5af0eb14-5121-45cf-8515-3697ca2f1399 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:38.626772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5af0eb14-5121-45cf-8515-3697ca2f1399 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:38.628323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37caac89-976c-476c-b56f-0056bfa1ee50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:38.628777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37caac89-976c-476c-b56f-0056bfa1ee50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:38.629552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37caac89-976c-476c-b56f-0056bfa1ee50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:38.629993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-37caac89-976c-476c-b56f-0056bfa1ee50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:38.825909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5af0eb14-5121-45cf-8515-3697ca2f1399 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:38.830815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-37caac89-976c-476c-b56f-0056bfa1ee50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:38.834722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5af0eb14-5121-45cf-8515-3697ca2f1399 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.220809 Jul 14 10:12:38.835312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1289/2575] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:38.838791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-37caac89-976c-476c-b56f-0056bfa1ee50 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.221440 Jul 14 10:12:38.839491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1287/2576] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:38 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:38.840037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-74cf66f1-0e2d-4fd9-9403-941bee9443c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:38.840844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-74cf66f1-0e2d-4fd9-9403-941bee9443c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:38.848053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-74cf66f1-0e2d-4fd9-9403-941bee9443c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:38.848504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-74cf66f1-0e2d-4fd9-9403-941bee9443c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:38.849276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-74cf66f1-0e2d-4fd9-9403-941bee9443c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:38.849712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-74cf66f1-0e2d-4fd9-9403-941bee9443c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:38.919128 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-74cf66f1-0e2d-4fd9-9403-941bee9443c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:38.927534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-74cf66f1-0e2d-4fd9-9403-941bee9443c9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091253 Jul 14 10:12:38.928111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1290/2577] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:38 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:39.852671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f9ab83ba-2940-428d-b7a3-5b1d7e577071 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:39.853230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f9ab83ba-2940-428d-b7a3-5b1d7e577071 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:39.856053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b77c3ecf-a919-4f61-8cec-8c5f465d28d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:39.856659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b77c3ecf-a919-4f61-8cec-8c5f465d28d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:39.861154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9ab83ba-2940-428d-b7a3-5b1d7e577071 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:39.861624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9ab83ba-2940-428d-b7a3-5b1d7e577071 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:39.862426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9ab83ba-2940-428d-b7a3-5b1d7e577071 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:39.862854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9ab83ba-2940-428d-b7a3-5b1d7e577071 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:39.864525 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b77c3ecf-a919-4f61-8cec-8c5f465d28d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:39.864988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b77c3ecf-a919-4f61-8cec-8c5f465d28d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:39.865751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b77c3ecf-a919-4f61-8cec-8c5f465d28d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:39.866176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b77c3ecf-a919-4f61-8cec-8c5f465d28d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:40.056987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f9ab83ba-2940-428d-b7a3-5b1d7e577071 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:40.064191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b77c3ecf-a919-4f61-8cec-8c5f465d28d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:40.065266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f9ab83ba-2940-428d-b7a3-5b1d7e577071 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.216714 Jul 14 10:12:40.065852 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1288/2578] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:40.071948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0e3a1562-2c5e-4063-8f5f-6e48fe36d5f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:40.072796 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0e3a1562-2c5e-4063-8f5f-6e48fe36d5f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:40.073036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b77c3ecf-a919-4f61-8cec-8c5f465d28d0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.220803 Jul 14 10:12:40.073951 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1291/2579] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:39 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:40.080918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3a1562-2c5e-4063-8f5f-6e48fe36d5f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:40.081440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3a1562-2c5e-4063-8f5f-6e48fe36d5f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:40.082235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3a1562-2c5e-4063-8f5f-6e48fe36d5f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:40.082673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e3a1562-2c5e-4063-8f5f-6e48fe36d5f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:40.147735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0e3a1562-2c5e-4063-8f5f-6e48fe36d5f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:40.156982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0e3a1562-2c5e-4063-8f5f-6e48fe36d5f0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089213 Jul 14 10:12:40.157658 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1289/2580] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:40 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:41.082767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7a3459dc-97b7-4092-b402-359d37c372e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:41.083425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7a3459dc-97b7-4092-b402-359d37c372e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:41.089961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7a3459dc-97b7-4092-b402-359d37c372e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:41.090430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7a3459dc-97b7-4092-b402-359d37c372e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:41.091181 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7a3459dc-97b7-4092-b402-359d37c372e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:41.091317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7667111e-edc0-46c8-a294-a96bebc68fe4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:41.091747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7a3459dc-97b7-4092-b402-359d37c372e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:41.091928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7667111e-edc0-46c8-a294-a96bebc68fe4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:41.098711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7667111e-edc0-46c8-a294-a96bebc68fe4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:41.099163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7667111e-edc0-46c8-a294-a96bebc68fe4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:41.099932 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7667111e-edc0-46c8-a294-a96bebc68fe4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:41.100370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7667111e-edc0-46c8-a294-a96bebc68fe4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:41.287171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7a3459dc-97b7-4092-b402-359d37c372e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:41.290224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7667111e-edc0-46c8-a294-a96bebc68fe4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:41.295121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7a3459dc-97b7-4092-b402-359d37c372e6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.216215 Jul 14 10:12:41.295704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1292/2581] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:41 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:41.299876 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7667111e-edc0-46c8-a294-a96bebc68fe4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.212242 Jul 14 10:12:41.300591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1290/2582] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:41 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:41.301388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-07a1d7ef-e1d6-4635-b0b4-8f041e1e6c86 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:41.301993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-07a1d7ef-e1d6-4635-b0b4-8f041e1e6c86 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:41.307926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07a1d7ef-e1d6-4635-b0b4-8f041e1e6c86 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:41.308364 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07a1d7ef-e1d6-4635-b0b4-8f041e1e6c86 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:41.309115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07a1d7ef-e1d6-4635-b0b4-8f041e1e6c86 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:41.309539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-07a1d7ef-e1d6-4635-b0b4-8f041e1e6c86 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:41.313394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:41.370764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-07a1d7ef-e1d6-4635-b0b4-8f041e1e6c86 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:41.378574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-07a1d7ef-e1d6-4635-b0b4-8f041e1e6c86 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081915 Jul 14 10:12:41.379136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1293/2583] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:42.313152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9542fe7f-d706-4975-b850-798bddd702a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:42.313702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9542fe7f-d706-4975-b850-798bddd702a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:42.315774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43851f1b-0b5e-4879-8556-e6a2a0d9552d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:42.316689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-43851f1b-0b5e-4879-8556-e6a2a0d9552d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:42.319034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=80 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:42.321857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9542fe7f-d706-4975-b850-798bddd702a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:42.322671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9542fe7f-d706-4975-b850-798bddd702a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:42.324007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9542fe7f-d706-4975-b850-798bddd702a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:42.324519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43851f1b-0b5e-4879-8556-e6a2a0d9552d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:42.324748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9542fe7f-d706-4975-b850-798bddd702a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:42.324946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43851f1b-0b5e-4879-8556-e6a2a0d9552d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:42.325701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43851f1b-0b5e-4879-8556-e6a2a0d9552d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:42.326125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43851f1b-0b5e-4879-8556-e6a2a0d9552d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:42.529330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9542fe7f-d706-4975-b850-798bddd702a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:42.542044 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43851f1b-0b5e-4879-8556-e6a2a0d9552d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:42.542567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9542fe7f-d706-4975-b850-798bddd702a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.233012 Jul 14 10:12:42.544004 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1291/2584] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:42 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:42.551857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-df161d46-9162-473d-a071-c4eedd0f2910 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:42.552895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-df161d46-9162-473d-a071-c4eedd0f2910 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:42.556619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-43851f1b-0b5e-4879-8556-e6a2a0d9552d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.244130 Jul 14 10:12:42.557609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1294/2585] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:42 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:42.561179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df161d46-9162-473d-a071-c4eedd0f2910 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:42.562085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df161d46-9162-473d-a071-c4eedd0f2910 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:42.562436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df161d46-9162-473d-a071-c4eedd0f2910 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:42.563453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-df161d46-9162-473d-a071-c4eedd0f2910 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:42.566107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:42.627375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-df161d46-9162-473d-a071-c4eedd0f2910 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:42.635380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-df161d46-9162-473d-a071-c4eedd0f2910 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090126 Jul 14 10:12:42.635947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1292/2586] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:42 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:43.560308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e1b23101-9d2e-46ba-8d70-1c3b8486064d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:43.560956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e1b23101-9d2e-46ba-8d70-1c3b8486064d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:43.567725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1b23101-9d2e-46ba-8d70-1c3b8486064d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:43.569588 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1b23101-9d2e-46ba-8d70-1c3b8486064d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:43.570424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1b23101-9d2e-46ba-8d70-1c3b8486064d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:43.570862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e1b23101-9d2e-46ba-8d70-1c3b8486064d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:43.574437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1382e07d-aa03-45bc-bc93-b8f97b07d156 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:43.575054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1382e07d-aa03-45bc-bc93-b8f97b07d156 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:43.581615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1382e07d-aa03-45bc-bc93-b8f97b07d156 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:43.582067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1382e07d-aa03-45bc-bc93-b8f97b07d156 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:43.582880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1382e07d-aa03-45bc-bc93-b8f97b07d156 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:43.583314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1382e07d-aa03-45bc-bc93-b8f97b07d156 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:43.772273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e1b23101-9d2e-46ba-8d70-1c3b8486064d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:43.776194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1382e07d-aa03-45bc-bc93-b8f97b07d156 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:43.780390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e1b23101-9d2e-46ba-8d70-1c3b8486064d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.223936 Jul 14 10:12:43.780962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1295/2587] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:43.785438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1382e07d-aa03-45bc-bc93-b8f97b07d156 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.214853 Jul 14 10:12:43.786213 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1293/2588] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:43 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:43.787062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-16d8d04b-b663-426a-94ad-36b90a96e83b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:43.787655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-16d8d04b-b663-426a-94ad-36b90a96e83b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:43.793493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16d8d04b-b663-426a-94ad-36b90a96e83b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:43.793933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16d8d04b-b663-426a-94ad-36b90a96e83b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:43.794712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16d8d04b-b663-426a-94ad-36b90a96e83b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:43.795141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-16d8d04b-b663-426a-94ad-36b90a96e83b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:43.856690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-16d8d04b-b663-426a-94ad-36b90a96e83b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:43.864554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-16d8d04b-b663-426a-94ad-36b90a96e83b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081800 Jul 14 10:12:43.865107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1296/2589] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:44.799384 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3f37ae5a-e9dd-4ec4-bd46-68452e8b120e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:44.800001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3f37ae5a-e9dd-4ec4-bd46-68452e8b120e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:44.803168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3e931590-0526-4395-8885-1f40036c85be tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:44.803601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3e931590-0526-4395-8885-1f40036c85be tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:44.806323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f37ae5a-e9dd-4ec4-bd46-68452e8b120e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:44.806772 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f37ae5a-e9dd-4ec4-bd46-68452e8b120e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:44.807529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f37ae5a-e9dd-4ec4-bd46-68452e8b120e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:44.807962 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f37ae5a-e9dd-4ec4-bd46-68452e8b120e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:44.809992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e931590-0526-4395-8885-1f40036c85be tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:44.810426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e931590-0526-4395-8885-1f40036c85be tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:44.811180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e931590-0526-4395-8885-1f40036c85be tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:44.811611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e931590-0526-4395-8885-1f40036c85be tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:45.007780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3e931590-0526-4395-8885-1f40036c85be tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:45.016236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3e931590-0526-4395-8885-1f40036c85be tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.217417 Jul 14 10:12:45.019708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3f37ae5a-e9dd-4ec4-bd46-68452e8b120e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:45.023608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1297/2590] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:44 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:45.028371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1715da25-eb87-4d67-b938-8fdafcd49040 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:45.029390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1715da25-eb87-4d67-b938-8fdafcd49040 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:45.029909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3f37ae5a-e9dd-4ec4-bd46-68452e8b120e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.235104 Jul 14 10:12:45.031055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1294/2591] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:45.041634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1715da25-eb87-4d67-b938-8fdafcd49040 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:45.041891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1715da25-eb87-4d67-b938-8fdafcd49040 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:45.043081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1715da25-eb87-4d67-b938-8fdafcd49040 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:45.043534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1715da25-eb87-4d67-b938-8fdafcd49040 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:45.091425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4fdc7a6d-c6d9-438b-8dcc-8d3e5b95f716 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:45.092103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4fdc7a6d-c6d9-438b-8dcc-8d3e5b95f716 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:45.099304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4fdc7a6d-c6d9-438b-8dcc-8d3e5b95f716 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:45.099756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4fdc7a6d-c6d9-438b-8dcc-8d3e5b95f716 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:45.100531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4fdc7a6d-c6d9-438b-8dcc-8d3e5b95f716 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:45.100971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4fdc7a6d-c6d9-438b-8dcc-8d3e5b95f716 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:45.113815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1715da25-eb87-4d67-b938-8fdafcd49040 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:45.122050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1715da25-eb87-4d67-b938-8fdafcd49040 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.097216 Jul 14 10:12:45.122661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1298/2592] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:45 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:45.127839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4fdc7a6d-c6d9-438b-8dcc-8d3e5b95f716 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:12:45.207305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4fdc7a6d-c6d9-438b-8dcc-8d3e5b95f716 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 204 len: 0 microversion: 2.1 time: 0.119485 Jul 14 10:12:45.207902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1295/2593] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:12:45 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 10:12:45.216316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0c198484-90ee-44b4-bae3-88fa26feacdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:45.216923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0c198484-90ee-44b4-bae3-88fa26feacdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:45.223825 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c198484-90ee-44b4-bae3-88fa26feacdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:45.224264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c198484-90ee-44b4-bae3-88fa26feacdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:45.225007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c198484-90ee-44b4-bae3-88fa26feacdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:45.225433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c198484-90ee-44b4-bae3-88fa26feacdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:45.355154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0c198484-90ee-44b4-bae3-88fa26feacdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:45.363075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0c198484-90ee-44b4-bae3-88fa26feacdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.150689 Jul 14 10:12:45.363632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1299/2594] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:45 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:46.041029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b189353f-32fa-402f-a522-4afba8044a4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:46.041640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b189353f-32fa-402f-a522-4afba8044a4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:46.047972 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7929f5d5-9ac1-4467-9a1e-ace6c198f6fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:46.048587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7929f5d5-9ac1-4467-9a1e-ace6c198f6fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:46.049000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b189353f-32fa-402f-a522-4afba8044a4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:46.049697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b189353f-32fa-402f-a522-4afba8044a4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:46.050482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b189353f-32fa-402f-a522-4afba8044a4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:46.050913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b189353f-32fa-402f-a522-4afba8044a4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:46.055386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7929f5d5-9ac1-4467-9a1e-ace6c198f6fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:46.055832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7929f5d5-9ac1-4467-9a1e-ace6c198f6fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:46.056600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7929f5d5-9ac1-4467-9a1e-ace6c198f6fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:46.057033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7929f5d5-9ac1-4467-9a1e-ace6c198f6fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:46.249650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b189353f-32fa-402f-a522-4afba8044a4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:46.253589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7929f5d5-9ac1-4467-9a1e-ace6c198f6fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:46.258617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b189353f-32fa-402f-a522-4afba8044a4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.221875 Jul 14 10:12:46.259300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1296/2595] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:46 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:46.261776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7929f5d5-9ac1-4467-9a1e-ace6c198f6fa tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.218108 Jul 14 10:12:46.262529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1300/2596] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:46 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:46.264676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bcb46d2d-be42-4f67-91d5-fe40d4c2e1f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:46.265286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bcb46d2d-be42-4f67-91d5-fe40d4c2e1f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:46.271358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bcb46d2d-be42-4f67-91d5-fe40d4c2e1f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:46.271808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bcb46d2d-be42-4f67-91d5-fe40d4c2e1f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:46.272575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bcb46d2d-be42-4f67-91d5-fe40d4c2e1f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:46.273016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bcb46d2d-be42-4f67-91d5-fe40d4c2e1f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:46.333818 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bcb46d2d-be42-4f67-91d5-fe40d4c2e1f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:46.342404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bcb46d2d-be42-4f67-91d5-fe40d4c2e1f3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.081374 Jul 14 10:12:46.342976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1297/2597] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:46 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:46.381050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43a917ce-a988-4779-a0f0-980624b97edb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:46.381658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-43a917ce-a988-4779-a0f0-980624b97edb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:46.387699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a917ce-a988-4779-a0f0-980624b97edb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:46.388142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a917ce-a988-4779-a0f0-980624b97edb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:46.388899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a917ce-a988-4779-a0f0-980624b97edb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:46.389339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43a917ce-a988-4779-a0f0-980624b97edb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:46.517362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43a917ce-a988-4779-a0f0-980624b97edb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:46.525396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-43a917ce-a988-4779-a0f0-980624b97edb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.148551 Jul 14 10:12:46.525962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1301/2598] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:46 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:47.276551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c2c60549-98a8-4c07-ad91-98584174c3a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:47.277186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c2c60549-98a8-4c07-ad91-98584174c3a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:47.278968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-50610dcf-0fe8-4a9e-ade2-01fd727909f9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:47.279577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-50610dcf-0fe8-4a9e-ade2-01fd727909f9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:47.284502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2c60549-98a8-4c07-ad91-98584174c3a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:47.284945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2c60549-98a8-4c07-ad91-98584174c3a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:47.285700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2c60549-98a8-4c07-ad91-98584174c3a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:47.286130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2c60549-98a8-4c07-ad91-98584174c3a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:47.287186 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50610dcf-0fe8-4a9e-ade2-01fd727909f9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:47.287633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50610dcf-0fe8-4a9e-ade2-01fd727909f9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:47.288496 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50610dcf-0fe8-4a9e-ade2-01fd727909f9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:47.288820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50610dcf-0fe8-4a9e-ade2-01fd727909f9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:47.483103 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c2c60549-98a8-4c07-ad91-98584174c3a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:47.486177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-50610dcf-0fe8-4a9e-ade2-01fd727909f9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:47.491521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c2c60549-98a8-4c07-ad91-98584174c3a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.218830 Jul 14 10:12:47.492096 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1298/2599] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:47 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:47.495225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-50610dcf-0fe8-4a9e-ade2-01fd727909f9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.220124 Jul 14 10:12:47.495978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1302/2600] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:47.496555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4baa17aa-8820-4a26-a1d0-a2175d1d3ee9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:47.497317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4baa17aa-8820-4a26-a1d0-a2175d1d3ee9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:47.503211 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4baa17aa-8820-4a26-a1d0-a2175d1d3ee9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:47.503660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4baa17aa-8820-4a26-a1d0-a2175d1d3ee9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:47.504418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4baa17aa-8820-4a26-a1d0-a2175d1d3ee9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:47.504850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4baa17aa-8820-4a26-a1d0-a2175d1d3ee9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:47.543134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-81a5472f-0045-457a-82bb-8741893dac2f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:47.543657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-81a5472f-0045-457a-82bb-8741893dac2f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:47.550085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81a5472f-0045-457a-82bb-8741893dac2f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:47.550566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81a5472f-0045-457a-82bb-8741893dac2f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:47.551362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81a5472f-0045-457a-82bb-8741893dac2f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:47.551799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-81a5472f-0045-457a-82bb-8741893dac2f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:47.568051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4baa17aa-8820-4a26-a1d0-a2175d1d3ee9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:47.575843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4baa17aa-8820-4a26-a1d0-a2175d1d3ee9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.082789 Jul 14 10:12:47.576417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1299/2601] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:47.682524 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-81a5472f-0045-457a-82bb-8741893dac2f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:47.690478 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-81a5472f-0045-457a-82bb-8741893dac2f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.151273 Jul 14 10:12:47.691040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1303/2602] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:47 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:48.509189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6b3b5c52-4cfc-4d53-b8d9-1d8201e911b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:48.509788 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6b3b5c52-4cfc-4d53-b8d9-1d8201e911b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:48.512246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ad3f2cad-73b1-4d82-ac93-45323fb3df9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:48.512860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ad3f2cad-73b1-4d82-ac93-45323fb3df9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:48.516379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b3b5c52-4cfc-4d53-b8d9-1d8201e911b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:48.516823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b3b5c52-4cfc-4d53-b8d9-1d8201e911b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:48.517579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b3b5c52-4cfc-4d53-b8d9-1d8201e911b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:48.518009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6b3b5c52-4cfc-4d53-b8d9-1d8201e911b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:48.519323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad3f2cad-73b1-4d82-ac93-45323fb3df9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:48.519765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad3f2cad-73b1-4d82-ac93-45323fb3df9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:48.520527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad3f2cad-73b1-4d82-ac93-45323fb3df9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:48.520958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ad3f2cad-73b1-4d82-ac93-45323fb3df9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:48.717248 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6b3b5c52-4cfc-4d53-b8d9-1d8201e911b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:48.721829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ad3f2cad-73b1-4d82-ac93-45323fb3df9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:48.726503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6b3b5c52-4cfc-4d53-b8d9-1d8201e911b1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.221359 Jul 14 10:12:48.727303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1300/2603] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:48 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:48.732158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2eefbda4-c916-4e6f-a650-cfb6ed0fd94d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:48.732760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2eefbda4-c916-4e6f-a650-cfb6ed0fd94d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:48.739442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ad3f2cad-73b1-4d82-ac93-45323fb3df9a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.231002 Jul 14 10:12:48.739675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2eefbda4-c916-4e6f-a650-cfb6ed0fd94d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:48.739909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2eefbda4-c916-4e6f-a650-cfb6ed0fd94d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:48.740672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2eefbda4-c916-4e6f-a650-cfb6ed0fd94d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:48.741183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2eefbda4-c916-4e6f-a650-cfb6ed0fd94d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:48.750303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1304/2604] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:48.755172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-30f54936-8410-4399-bbc6-847724290831 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:48.755812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-30f54936-8410-4399-bbc6-847724290831 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:48.761852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-30f54936-8410-4399-bbc6-847724290831 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:48.762251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-30f54936-8410-4399-bbc6-847724290831 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:48.763007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-30f54936-8410-4399-bbc6-847724290831 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:48.763438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-30f54936-8410-4399-bbc6-847724290831 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:48.810554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2eefbda4-c916-4e6f-a650-cfb6ed0fd94d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:48.819286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2eefbda4-c916-4e6f-a650-cfb6ed0fd94d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090601 Jul 14 10:12:48.819865 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1301/2605] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:48 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:48.906254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-30f54936-8410-4399-bbc6-847724290831 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:48.914618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-30f54936-8410-4399-bbc6-847724290831 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.163200 Jul 14 10:12:48.915183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1305/2606] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:48 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:49.744153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-51e98fec-9ecb-4eae-91a7-6710cce09f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:49.744798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-51e98fec-9ecb-4eae-91a7-6710cce09f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:49.751389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51e98fec-9ecb-4eae-91a7-6710cce09f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:49.751850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51e98fec-9ecb-4eae-91a7-6710cce09f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:49.752620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51e98fec-9ecb-4eae-91a7-6710cce09f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:49.753061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51e98fec-9ecb-4eae-91a7-6710cce09f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:49.756416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a6a674cb-5191-4a3a-a309-f189812df3b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:49.757395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a6a674cb-5191-4a3a-a309-f189812df3b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:49.763650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6a674cb-5191-4a3a-a309-f189812df3b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:49.764089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6a674cb-5191-4a3a-a309-f189812df3b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:49.764847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6a674cb-5191-4a3a-a309-f189812df3b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:49.765278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6a674cb-5191-4a3a-a309-f189812df3b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:49.964104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51e98fec-9ecb-4eae-91a7-6710cce09f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:49.967024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a6a674cb-5191-4a3a-a309-f189812df3b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:49.972973 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-51e98fec-9ecb-4eae-91a7-6710cce09f58 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.232661 Jul 14 10:12:49.973544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1302/2607] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:49 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:49.975640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a6a674cb-5191-4a3a-a309-f189812df3b0 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.222965 Jul 14 10:12:49.985019 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1306/2608] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:49.985241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2362494e-978d-4543-abd7-296b93b5fb18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:49.985241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2362494e-978d-4543-abd7-296b93b5fb18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:49.985446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-36db0246-f1c1-42a6-8786-4455189f5098 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:49.985446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-36db0246-f1c1-42a6-8786-4455189f5098 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:49.985655 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2362494e-978d-4543-abd7-296b93b5fb18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:49.986072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2362494e-978d-4543-abd7-296b93b5fb18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:49.986858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2362494e-978d-4543-abd7-296b93b5fb18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:49.987287 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2362494e-978d-4543-abd7-296b93b5fb18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:49.987726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36db0246-f1c1-42a6-8786-4455189f5098 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:49.988171 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36db0246-f1c1-42a6-8786-4455189f5098 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:49.988956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36db0246-f1c1-42a6-8786-4455189f5098 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:49.989383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36db0246-f1c1-42a6-8786-4455189f5098 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:50.076759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2362494e-978d-4543-abd7-296b93b5fb18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:50.086316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2362494e-978d-4543-abd7-296b93b5fb18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.111752 Jul 14 10:12:50.086901 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1303/2609] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:49 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:50.145639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-36db0246-f1c1-42a6-8786-4455189f5098 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:50.154098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-36db0246-f1c1-42a6-8786-4455189f5098 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.176553 Jul 14 10:12:50.154818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1307/2610] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:49 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:50.990995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f40a38a9-3854-452e-b00e-e072943aa318 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:50.991595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f40a38a9-3854-452e-b00e-e072943aa318 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:50.992022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-073719b8-acc8-4525-b19c-eabd9bc72104 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:50.992657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-073719b8-acc8-4525-b19c-eabd9bc72104 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:50.998263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f40a38a9-3854-452e-b00e-e072943aa318 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:50.998718 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f40a38a9-3854-452e-b00e-e072943aa318 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:50.999107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-073719b8-acc8-4525-b19c-eabd9bc72104 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:50.999476 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f40a38a9-3854-452e-b00e-e072943aa318 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:50.999591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-073719b8-acc8-4525-b19c-eabd9bc72104 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:50.999915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f40a38a9-3854-452e-b00e-e072943aa318 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:51.000489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-073719b8-acc8-4525-b19c-eabd9bc72104 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:51.000721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-073719b8-acc8-4525-b19c-eabd9bc72104 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:51.193852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-073719b8-acc8-4525-b19c-eabd9bc72104 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:51.197800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f40a38a9-3854-452e-b00e-e072943aa318 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:51.201982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-073719b8-acc8-4525-b19c-eabd9bc72104 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.213748 Jul 14 10:12:51.202577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1308/2611] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:50 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:51.206440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f40a38a9-3854-452e-b00e-e072943aa318 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.219336 Jul 14 10:12:51.212705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1304/2612] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:50 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:51.282519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2067ff67-7f7c-41e3-9e17-dc1f84b917bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:51.283131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2067ff67-7f7c-41e3-9e17-dc1f84b917bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:51.284428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-51632446-2b0a-471c-8362-4473dba4cd43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:51.285040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-51632446-2b0a-471c-8362-4473dba4cd43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:51.289241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2067ff67-7f7c-41e3-9e17-dc1f84b917bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:51.289687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2067ff67-7f7c-41e3-9e17-dc1f84b917bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:51.290471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2067ff67-7f7c-41e3-9e17-dc1f84b917bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:51.290910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2067ff67-7f7c-41e3-9e17-dc1f84b917bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:51.291229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51632446-2b0a-471c-8362-4473dba4cd43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:51.291671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51632446-2b0a-471c-8362-4473dba4cd43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:51.292454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51632446-2b0a-471c-8362-4473dba4cd43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:51.292910 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51632446-2b0a-471c-8362-4473dba4cd43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:51.375600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2067ff67-7f7c-41e3-9e17-dc1f84b917bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:51.377763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:51.384643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2067ff67-7f7c-41e3-9e17-dc1f84b917bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.180296 Jul 14 10:12:51.385224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1309/2613] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:51 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:51.443090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51632446-2b0a-471c-8362-4473dba4cd43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:51.451051 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-51632446-2b0a-471c-8362-4473dba4cd43 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.243130 Jul 14 10:12:51.451608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1305/2614] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:51 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:52.220231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-71c6423b-d4aa-40a2-aeb4-7f4eb4d59e9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:52.220822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-71c6423b-d4aa-40a2-aeb4-7f4eb4d59e9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:52.224101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-acfa3121-e98e-4867-a498-332fee98b72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:52.224706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-acfa3121-e98e-4867-a498-332fee98b72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:52.227339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-71c6423b-d4aa-40a2-aeb4-7f4eb4d59e9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:52.227783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-71c6423b-d4aa-40a2-aeb4-7f4eb4d59e9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:52.228819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-71c6423b-d4aa-40a2-aeb4-7f4eb4d59e9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:52.229246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-71c6423b-d4aa-40a2-aeb4-7f4eb4d59e9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:52.231143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-acfa3121-e98e-4867-a498-332fee98b72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:52.231585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-acfa3121-e98e-4867-a498-332fee98b72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:52.232332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-acfa3121-e98e-4867-a498-332fee98b72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:52.232762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-acfa3121-e98e-4867-a498-332fee98b72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:52.421161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-71c6423b-d4aa-40a2-aeb4-7f4eb4d59e9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:52.426072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-acfa3121-e98e-4867-a498-332fee98b72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:52.430562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-71c6423b-d4aa-40a2-aeb4-7f4eb4d59e9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.214502 Jul 14 10:12:52.431230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1310/2615] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:52 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:52.434457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-acfa3121-e98e-4867-a498-332fee98b72b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.214059 Jul 14 10:12:52.435189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1306/2616] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:52 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:52.435858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d7262206-9ebc-47b4-a800-59ffdd5a8114 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:52.436492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d7262206-9ebc-47b4-a800-59ffdd5a8114 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:52.442387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7262206-9ebc-47b4-a800-59ffdd5a8114 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:52.442846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7262206-9ebc-47b4-a800-59ffdd5a8114 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:52.443611 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7262206-9ebc-47b4-a800-59ffdd5a8114 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:52.444046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d7262206-9ebc-47b4-a800-59ffdd5a8114 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:52.468856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-66e14dc3-773a-4efa-af61-4ad9d50293a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:52.470155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-66e14dc3-773a-4efa-af61-4ad9d50293a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:52.476354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-66e14dc3-773a-4efa-af61-4ad9d50293a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:52.476801 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-66e14dc3-773a-4efa-af61-4ad9d50293a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:52.477565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-66e14dc3-773a-4efa-af61-4ad9d50293a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:52.478001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-66e14dc3-773a-4efa-af61-4ad9d50293a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:52.480843 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:12:52.509443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d7262206-9ebc-47b4-a800-59ffdd5a8114 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:52.517986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d7262206-9ebc-47b4-a800-59ffdd5a8114 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085686 Jul 14 10:12:52.518610 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1311/2617] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:52 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:52.618709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-66e14dc3-773a-4efa-af61-4ad9d50293a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:52.626961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-66e14dc3-773a-4efa-af61-4ad9d50293a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.161929 Jul 14 10:12:52.627530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1307/2618] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:52 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:53.447645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bc4df257-b595-41d9-a60f-b956a3512373 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:53.448259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bc4df257-b595-41d9-a60f-b956a3512373 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:53.451348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eb0d963e-f901-4e08-9b3a-82f21c0bc7e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:53.452030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-eb0d963e-f901-4e08-9b3a-82f21c0bc7e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:53.455660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc4df257-b595-41d9-a60f-b956a3512373 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:53.456110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc4df257-b595-41d9-a60f-b956a3512373 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:53.456897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc4df257-b595-41d9-a60f-b956a3512373 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:53.457345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc4df257-b595-41d9-a60f-b956a3512373 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:53.458657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eb0d963e-f901-4e08-9b3a-82f21c0bc7e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:53.459108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eb0d963e-f901-4e08-9b3a-82f21c0bc7e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:53.459882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eb0d963e-f901-4e08-9b3a-82f21c0bc7e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:53.460319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-eb0d963e-f901-4e08-9b3a-82f21c0bc7e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:53.656173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bc4df257-b595-41d9-a60f-b956a3512373 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:53.659397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-eb0d963e-f901-4e08-9b3a-82f21c0bc7e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:53.665215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bc4df257-b595-41d9-a60f-b956a3512373 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.221695 Jul 14 10:12:53.665888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1312/2619] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:53 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:53.667473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eb0d963e-f901-4e08-9b3a-82f21c0bc7e7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.219962 Jul 14 10:12:53.668036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1308/2620] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:53 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:53.670360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-898a0690-436f-4ae7-a286-98393c936591 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:53.670963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-898a0690-436f-4ae7-a286-98393c936591 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:53.673471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e8898e44-f071-42f0-84e6-0690d3a387fb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:53.674271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e8898e44-f071-42f0-84e6-0690d3a387fb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:53.677867 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-898a0690-436f-4ae7-a286-98393c936591 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:53.678340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-898a0690-436f-4ae7-a286-98393c936591 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:53.679102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-898a0690-436f-4ae7-a286-98393c936591 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:53.679532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-898a0690-436f-4ae7-a286-98393c936591 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:53.680961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e8898e44-f071-42f0-84e6-0690d3a387fb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:53.681419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e8898e44-f071-42f0-84e6-0690d3a387fb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:53.682209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e8898e44-f071-42f0-84e6-0690d3a387fb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:53.682649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e8898e44-f071-42f0-84e6-0690d3a387fb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:53.765840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-898a0690-436f-4ae7-a286-98393c936591 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:53.774090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-898a0690-436f-4ae7-a286-98393c936591 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.107174 Jul 14 10:12:53.774728 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1313/2621] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:53 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:53.830176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e8898e44-f071-42f0-84e6-0690d3a387fb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:53.838263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e8898e44-f071-42f0-84e6-0690d3a387fb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.169045 Jul 14 10:12:53.838832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1309/2622] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:53 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:54.684550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9677fe14-4cdb-4974-9ac2-33506aea1214 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:54.685145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9677fe14-4cdb-4974-9ac2-33506aea1214 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:54.685494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8c59033e-2135-45a7-bb3c-230cb40cb770 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:54.686101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8c59033e-2135-45a7-bb3c-230cb40cb770 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:54.692598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9677fe14-4cdb-4974-9ac2-33506aea1214 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:54.693036 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9677fe14-4cdb-4974-9ac2-33506aea1214 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:54.693164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c59033e-2135-45a7-bb3c-230cb40cb770 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:54.693524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c59033e-2135-45a7-bb3c-230cb40cb770 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:54.693788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9677fe14-4cdb-4974-9ac2-33506aea1214 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:54.694238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9677fe14-4cdb-4974-9ac2-33506aea1214 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:54.694374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c59033e-2135-45a7-bb3c-230cb40cb770 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:54.694724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8c59033e-2135-45a7-bb3c-230cb40cb770 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:54.889990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9677fe14-4cdb-4974-9ac2-33506aea1214 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:54.897242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8c59033e-2135-45a7-bb3c-230cb40cb770 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:54.898698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9677fe14-4cdb-4974-9ac2-33506aea1214 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.218245 Jul 14 10:12:54.899281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1314/2623] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:54 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:54.903770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fe080dca-e6f5-4ed9-a1b0-44713e901b74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:54.904370 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fe080dca-e6f5-4ed9-a1b0-44713e901b74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:54.905673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8c59033e-2135-45a7-bb3c-230cb40cb770 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.223933 Jul 14 10:12:54.906247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1310/2624] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:54 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:54.912051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe080dca-e6f5-4ed9-a1b0-44713e901b74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:54.912247 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7269cd5e-0bb2-479b-8c8d-47584caf66bd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:54.912781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7269cd5e-0bb2-479b-8c8d-47584caf66bd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:54.912909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe080dca-e6f5-4ed9-a1b0-44713e901b74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:54.913791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe080dca-e6f5-4ed9-a1b0-44713e901b74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:54.914250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fe080dca-e6f5-4ed9-a1b0-44713e901b74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:54.918948 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7269cd5e-0bb2-479b-8c8d-47584caf66bd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:54.919408 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7269cd5e-0bb2-479b-8c8d-47584caf66bd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:54.920158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7269cd5e-0bb2-479b-8c8d-47584caf66bd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:54.920594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7269cd5e-0bb2-479b-8c8d-47584caf66bd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:54.993606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fe080dca-e6f5-4ed9-a1b0-44713e901b74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:55.002851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fe080dca-e6f5-4ed9-a1b0-44713e901b74 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.102565 Jul 14 10:12:55.003427 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1315/2625] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:54 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:55.075387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7269cd5e-0bb2-479b-8c8d-47584caf66bd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:55.083684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7269cd5e-0bb2-479b-8c8d-47584caf66bd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.175455 Jul 14 10:12:55.084293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1311/2626] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:54 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:55.916731 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-641b039e-61c3-489c-ba9d-45f80c2186a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:55.917297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-641b039e-61c3-489c-ba9d-45f80c2186a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:55.923900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-641b039e-61c3-489c-ba9d-45f80c2186a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:55.924179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-22e8d721-9642-44d2-b882-53a5b8fcecc1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:55.924876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-641b039e-61c3-489c-ba9d-45f80c2186a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:55.925065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-22e8d721-9642-44d2-b882-53a5b8fcecc1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:55.925332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-641b039e-61c3-489c-ba9d-45f80c2186a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:55.925759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-641b039e-61c3-489c-ba9d-45f80c2186a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:55.931635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22e8d721-9642-44d2-b882-53a5b8fcecc1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:55.932087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22e8d721-9642-44d2-b882-53a5b8fcecc1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:55.932850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22e8d721-9642-44d2-b882-53a5b8fcecc1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:55.933292 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22e8d721-9642-44d2-b882-53a5b8fcecc1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:56.118352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-641b039e-61c3-489c-ba9d-45f80c2186a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:56.122398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-22e8d721-9642-44d2-b882-53a5b8fcecc1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:56.127235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-641b039e-61c3-489c-ba9d-45f80c2186a9 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.214583 Jul 14 10:12:56.128098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1316/2627] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:55 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:56.131513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-22e8d721-9642-44d2-b882-53a5b8fcecc1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.211166 Jul 14 10:12:56.136830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1312/2628] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:55 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:56.137015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9221d871-b951-447c-98e1-a2a9cccf94ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:56.137015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9221d871-b951-447c-98e1-a2a9cccf94ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:56.137217 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-70b92c26-4f75-41f7-93a8-8b218aa4dfca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:56.137478 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-70b92c26-4f75-41f7-93a8-8b218aa4dfca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:56.139829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9221d871-b951-447c-98e1-a2a9cccf94ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:56.140646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9221d871-b951-447c-98e1-a2a9cccf94ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:56.141919 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9221d871-b951-447c-98e1-a2a9cccf94ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:56.142552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9221d871-b951-447c-98e1-a2a9cccf94ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:56.144425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-70b92c26-4f75-41f7-93a8-8b218aa4dfca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:56.144870 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-70b92c26-4f75-41f7-93a8-8b218aa4dfca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:56.145623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-70b92c26-4f75-41f7-93a8-8b218aa4dfca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:56.146050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-70b92c26-4f75-41f7-93a8-8b218aa4dfca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:56.227081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9221d871-b951-447c-98e1-a2a9cccf94ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:56.235184 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9221d871-b951-447c-98e1-a2a9cccf94ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.106342 Jul 14 10:12:56.235791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1317/2629] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:56 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:56.297009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-70b92c26-4f75-41f7-93a8-8b218aa4dfca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:56.305238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-70b92c26-4f75-41f7-93a8-8b218aa4dfca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.172218 Jul 14 10:12:56.305794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1313/2630] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:56 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:57.145043 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2129aac2-f33e-4ed5-b1af-2caceb10cc3e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:57.145644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2129aac2-f33e-4ed5-b1af-2caceb10cc3e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:57.148613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9fdfa76f-5458-4d59-82cd-91c86faefcef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:57.149223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9fdfa76f-5458-4d59-82cd-91c86faefcef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:57.152416 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2129aac2-f33e-4ed5-b1af-2caceb10cc3e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:57.152862 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2129aac2-f33e-4ed5-b1af-2caceb10cc3e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:57.153655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2129aac2-f33e-4ed5-b1af-2caceb10cc3e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:57.154083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2129aac2-f33e-4ed5-b1af-2caceb10cc3e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:57.155680 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9fdfa76f-5458-4d59-82cd-91c86faefcef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:57.156127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9fdfa76f-5458-4d59-82cd-91c86faefcef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:57.157647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9fdfa76f-5458-4d59-82cd-91c86faefcef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:57.158076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9fdfa76f-5458-4d59-82cd-91c86faefcef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:57.347323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2129aac2-f33e-4ed5-b1af-2caceb10cc3e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:57.351300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9fdfa76f-5458-4d59-82cd-91c86faefcef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:57.355269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2129aac2-f33e-4ed5-b1af-2caceb10cc3e tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.214636 Jul 14 10:12:57.355831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1318/2631] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:57 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:57.359207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9fdfa76f-5458-4d59-82cd-91c86faefcef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.214323 Jul 14 10:12:57.360048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1314/2632] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:57 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:57.363517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ecbf5a3c-7448-425d-8737-cb7cacea4cfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:57.364222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3a3a35dc-e4d6-47dd-b380-dd00f3eed8ec tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:57.364561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ecbf5a3c-7448-425d-8737-cb7cacea4cfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:57.364961 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3a3a35dc-e4d6-47dd-b380-dd00f3eed8ec tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:57.370821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a3a35dc-e4d6-47dd-b380-dd00f3eed8ec tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:57.371060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ecbf5a3c-7448-425d-8737-cb7cacea4cfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:57.371263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a3a35dc-e4d6-47dd-b380-dd00f3eed8ec tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:57.371508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ecbf5a3c-7448-425d-8737-cb7cacea4cfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:57.372015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a3a35dc-e4d6-47dd-b380-dd00f3eed8ec tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:57.372263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ecbf5a3c-7448-425d-8737-cb7cacea4cfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:57.372444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a3a35dc-e4d6-47dd-b380-dd00f3eed8ec tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:57.372884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ecbf5a3c-7448-425d-8737-cb7cacea4cfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:57.458923 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ecbf5a3c-7448-425d-8737-cb7cacea4cfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:57.466671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ecbf5a3c-7448-425d-8737-cb7cacea4cfd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.109902 Jul 14 10:12:57.467242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1319/2633] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:57 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:57.525935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a3a35dc-e4d6-47dd-b380-dd00f3eed8ec tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:57.533967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3a3a35dc-e4d6-47dd-b380-dd00f3eed8ec tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.173153 Jul 14 10:12:57.534562 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1315/2634] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:57 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:58.372085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c8fab912-f18f-4ead-bbbd-939244da2db2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:58.372790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c8fab912-f18f-4ead-bbbd-939244da2db2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:58.375810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-25856348-328b-4d2d-ad00-c76ae5f7bba4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:58.376423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-25856348-328b-4d2d-ad00-c76ae5f7bba4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:58.379711 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8fab912-f18f-4ead-bbbd-939244da2db2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:58.380379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8fab912-f18f-4ead-bbbd-939244da2db2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:58.381135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8fab912-f18f-4ead-bbbd-939244da2db2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:58.381566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c8fab912-f18f-4ead-bbbd-939244da2db2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:58.382856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25856348-328b-4d2d-ad00-c76ae5f7bba4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:58.383305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25856348-328b-4d2d-ad00-c76ae5f7bba4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:58.384066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25856348-328b-4d2d-ad00-c76ae5f7bba4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:58.384501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25856348-328b-4d2d-ad00-c76ae5f7bba4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:58.577822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c8fab912-f18f-4ead-bbbd-939244da2db2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:58.581565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-25856348-328b-4d2d-ad00-c76ae5f7bba4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:58.586015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c8fab912-f18f-4ead-bbbd-939244da2db2 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.217694 Jul 14 10:12:58.586606 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1320/2635] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:58 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:58.591077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-25856348-328b-4d2d-ad00-c76ae5f7bba4 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.219012 Jul 14 10:12:58.591352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8516f791-a846-4ee0-9fb0-804f5c44f8ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:58.591839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1316/2636] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:58 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:58.592035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8516f791-a846-4ee0-9fb0-804f5c44f8ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:58.598809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8516f791-a846-4ee0-9fb0-804f5c44f8ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:58.599256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8516f791-a846-4ee0-9fb0-804f5c44f8ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:58.600017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8516f791-a846-4ee0-9fb0-804f5c44f8ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:58.600449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8516f791-a846-4ee0-9fb0-804f5c44f8ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:58.605375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f1e9af0e-4801-438f-87fe-d1261ca032ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:58.605988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f1e9af0e-4801-438f-87fe-d1261ca032ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:58.612553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1e9af0e-4801-438f-87fe-d1261ca032ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:58.613007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1e9af0e-4801-438f-87fe-d1261ca032ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:58.613773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1e9af0e-4801-438f-87fe-d1261ca032ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:58.614250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1e9af0e-4801-438f-87fe-d1261ca032ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:58.671498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8516f791-a846-4ee0-9fb0-804f5c44f8ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:58.680129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8516f791-a846-4ee0-9fb0-804f5c44f8ec tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.092367 Jul 14 10:12:58.680702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1321/2637] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:58 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:58.760457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f1e9af0e-4801-438f-87fe-d1261ca032ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:58.768824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f1e9af0e-4801-438f-87fe-d1261ca032ea tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.167097 Jul 14 10:12:58.769397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1317/2638] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:58 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:59.603866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2a1344a5-3e6f-469c-a871-2543b01deb56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:59.604472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2a1344a5-3e6f-469c-a871-2543b01deb56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:59.608395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-51526e20-750b-4dcf-b608-c3e5a22a8817 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:59.609009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-51526e20-750b-4dcf-b608-c3e5a22a8817 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:59.611721 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a1344a5-3e6f-469c-a871-2543b01deb56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:59.612160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a1344a5-3e6f-469c-a871-2543b01deb56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:59.612920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a1344a5-3e6f-469c-a871-2543b01deb56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:59.613343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2a1344a5-3e6f-469c-a871-2543b01deb56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:59.615968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51526e20-750b-4dcf-b608-c3e5a22a8817 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:59.616416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51526e20-750b-4dcf-b608-c3e5a22a8817 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:59.617175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51526e20-750b-4dcf-b608-c3e5a22a8817 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:59.617612 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-51526e20-750b-4dcf-b608-c3e5a22a8817 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:59.808775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2a1344a5-3e6f-469c-a871-2543b01deb56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:59.812020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-51526e20-750b-4dcf-b608-c3e5a22a8817 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:59.816884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2a1344a5-3e6f-469c-a871-2543b01deb56 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.217165 Jul 14 10:12:59.817548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1322/2639] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:59 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:59.821662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-51526e20-750b-4dcf-b608-c3e5a22a8817 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.217209 Jul 14 10:12:59.821993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-48fb5018-e7e5-40f6-8a5c-24d6f5ec1694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:59.826543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1318/2640] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:59 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:12:59.826710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-48fb5018-e7e5-40f6-8a5c-24d6f5ec1694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:59.827524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1b5cb5fb-7ad5-4558-ad03-2292a33a10e6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:12:59.828208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1b5cb5fb-7ad5-4558-ad03-2292a33a10e6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:12:59.828656 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48fb5018-e7e5-40f6-8a5c-24d6f5ec1694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:59.829099 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48fb5018-e7e5-40f6-8a5c-24d6f5ec1694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:59.829859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48fb5018-e7e5-40f6-8a5c-24d6f5ec1694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:59.830353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-48fb5018-e7e5-40f6-8a5c-24d6f5ec1694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:59.834861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b5cb5fb-7ad5-4558-ad03-2292a33a10e6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:59.835379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b5cb5fb-7ad5-4558-ad03-2292a33a10e6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:59.836241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b5cb5fb-7ad5-4558-ad03-2292a33a10e6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:12:59.836739 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1b5cb5fb-7ad5-4558-ad03-2292a33a10e6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:12:59.899545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-48fb5018-e7e5-40f6-8a5c-24d6f5ec1694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:59.908061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-48fb5018-e7e5-40f6-8a5c-24d6f5ec1694 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.089535 Jul 14 10:12:59.908623 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1323/2641] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:59 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:12:59.982574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1b5cb5fb-7ad5-4558-ad03-2292a33a10e6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:12:59.991584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1b5cb5fb-7ad5-4558-ad03-2292a33a10e6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.168079 Jul 14 10:12:59.992164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1319/2642] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:12:59 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:00.834517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-075b50bf-4918-40e7-9cbe-e0f48ba938cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:00.835087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-075b50bf-4918-40e7-9cbe-e0f48ba938cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:00.838724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-556a3176-047b-4618-8013-48ed5e048a3b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:00.839580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-556a3176-047b-4618-8013-48ed5e048a3b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:00.841998 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-075b50bf-4918-40e7-9cbe-e0f48ba938cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:00.842484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-075b50bf-4918-40e7-9cbe-e0f48ba938cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:00.843249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-075b50bf-4918-40e7-9cbe-e0f48ba938cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:00.843681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-075b50bf-4918-40e7-9cbe-e0f48ba938cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:00.846671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-556a3176-047b-4618-8013-48ed5e048a3b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:00.847121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-556a3176-047b-4618-8013-48ed5e048a3b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:00.847880 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-556a3176-047b-4618-8013-48ed5e048a3b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:00.848321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-556a3176-047b-4618-8013-48ed5e048a3b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:01.040574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-075b50bf-4918-40e7-9cbe-e0f48ba938cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:01.043647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-556a3176-047b-4618-8013-48ed5e048a3b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:01.049330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-075b50bf-4918-40e7-9cbe-e0f48ba938cf tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.218971 Jul 14 10:13:01.050523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1324/2643] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:00 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:01.052716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-556a3176-047b-4618-8013-48ed5e048a3b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.217640 Jul 14 10:13:01.053302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1320/2644] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:00 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:01.062765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3951c36b-ef64-4c0e-9320-542a7fb68402 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:01.062765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3951c36b-ef64-4c0e-9320-542a7fb68402 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:01.063123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-25dabc9d-fd42-4690-a325-4ae026ed56e8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:01.063123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-25dabc9d-fd42-4690-a325-4ae026ed56e8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:01.063352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3951c36b-ef64-4c0e-9320-542a7fb68402 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:01.063352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3951c36b-ef64-4c0e-9320-542a7fb68402 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:01.063768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3951c36b-ef64-4c0e-9320-542a7fb68402 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:01.064202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3951c36b-ef64-4c0e-9320-542a7fb68402 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:01.065113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25dabc9d-fd42-4690-a325-4ae026ed56e8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:01.065559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25dabc9d-fd42-4690-a325-4ae026ed56e8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:01.066357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25dabc9d-fd42-4690-a325-4ae026ed56e8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:01.066792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-25dabc9d-fd42-4690-a325-4ae026ed56e8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:01.137347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3951c36b-ef64-4c0e-9320-542a7fb68402 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:01.146161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3951c36b-ef64-4c0e-9320-542a7fb68402 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.094779 Jul 14 10:13:01.146766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1325/2645] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:01 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:01.220231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-25dabc9d-fd42-4690-a325-4ae026ed56e8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:01.228321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-25dabc9d-fd42-4690-a325-4ae026ed56e8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.174065 Jul 14 10:13:01.228902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1321/2646] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:01 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:01.985692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:13:01.986553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:13:02.067419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b005566d-80c7-4ac4-8d3e-33bc74cd0e0d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:02.068064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b005566d-80c7-4ac4-8d3e-33bc74cd0e0d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:02.070274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3a2d6f99-6627-490b-97ca-c2ae8720257a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:02.070897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3a2d6f99-6627-490b-97ca-c2ae8720257a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:02.076866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b005566d-80c7-4ac4-8d3e-33bc74cd0e0d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:02.077312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b005566d-80c7-4ac4-8d3e-33bc74cd0e0d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:02.077435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a2d6f99-6627-490b-97ca-c2ae8720257a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:02.077887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a2d6f99-6627-490b-97ca-c2ae8720257a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:02.078079 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b005566d-80c7-4ac4-8d3e-33bc74cd0e0d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:02.078956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b005566d-80c7-4ac4-8d3e-33bc74cd0e0d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:02.079104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a2d6f99-6627-490b-97ca-c2ae8720257a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:02.079210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3a2d6f99-6627-490b-97ca-c2ae8720257a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:02.095141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:02.280433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b005566d-80c7-4ac4-8d3e-33bc74cd0e0d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:02.286544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3a2d6f99-6627-490b-97ca-c2ae8720257a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:02.291544 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b005566d-80c7-4ac4-8d3e-33bc74cd0e0d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.227938 Jul 14 10:13:02.292122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1326/2647] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:02 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:02.296613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d98e2d59-bd2c-42a2-b4b1-564fb873b2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:02.297775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d98e2d59-bd2c-42a2-b4b1-564fb873b2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:02.304170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d98e2d59-bd2c-42a2-b4b1-564fb873b2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:02.304614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d98e2d59-bd2c-42a2-b4b1-564fb873b2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:02.304975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3a2d6f99-6627-490b-97ca-c2ae8720257a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.238469 Jul 14 10:13:02.305661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d98e2d59-bd2c-42a2-b4b1-564fb873b2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:02.305811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1322/2648] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:02 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:02.305908 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d98e2d59-bd2c-42a2-b4b1-564fb873b2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:02.309905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9081e326-c493-4a23-91b8-7b3e4bc5e47e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:02.310528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9081e326-c493-4a23-91b8-7b3e4bc5e47e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:02.312856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:02.319417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9081e326-c493-4a23-91b8-7b3e4bc5e47e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:02.319854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9081e326-c493-4a23-91b8-7b3e4bc5e47e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:02.320616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9081e326-c493-4a23-91b8-7b3e4bc5e47e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:02.321044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9081e326-c493-4a23-91b8-7b3e4bc5e47e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:02.381511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d98e2d59-bd2c-42a2-b4b1-564fb873b2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:02.389576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d98e2d59-bd2c-42a2-b4b1-564fb873b2b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.096487 Jul 14 10:13:02.390150 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1327/2649] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:02 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:02.463719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9081e326-c493-4a23-91b8-7b3e4bc5e47e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:02.465881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:02.473511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9081e326-c493-4a23-91b8-7b3e4bc5e47e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.167113 Jul 14 10:13:02.474072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1323/2650] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:02 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:03.310063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-71909b79-9a78-4ebc-8155-4bef4fc3862c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:03.310738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-71909b79-9a78-4ebc-8155-4bef4fc3862c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:03.318258 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-71909b79-9a78-4ebc-8155-4bef4fc3862c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:03.318700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-71909b79-9a78-4ebc-8155-4bef4fc3862c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:03.319455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-71909b79-9a78-4ebc-8155-4bef4fc3862c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:03.319886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-71909b79-9a78-4ebc-8155-4bef4fc3862c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:03.322388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a206ef47-f5ee-44f8-810f-6b9f8b444f39 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:03.323012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a206ef47-f5ee-44f8-810f-6b9f8b444f39 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:03.329786 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a206ef47-f5ee-44f8-810f-6b9f8b444f39 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:03.330256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a206ef47-f5ee-44f8-810f-6b9f8b444f39 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:03.331394 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a206ef47-f5ee-44f8-810f-6b9f8b444f39 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:03.331546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a206ef47-f5ee-44f8-810f-6b9f8b444f39 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:03.525771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a206ef47-f5ee-44f8-810f-6b9f8b444f39 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:03.528402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-71909b79-9a78-4ebc-8155-4bef4fc3862c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:03.534526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a206ef47-f5ee-44f8-810f-6b9f8b444f39 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.216041 Jul 14 10:13:03.535307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1324/2651] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:03 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:03.537553 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-71909b79-9a78-4ebc-8155-4bef4fc3862c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.231329 Jul 14 10:13:03.538126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1328/2652] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:03 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:03.542283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c03c8a08-af41-42fe-b646-0b769677d89a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:03.542686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b9a21ca2-320b-4816-94c6-af977261eae8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:03.543290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b9a21ca2-320b-4816-94c6-af977261eae8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:03.543440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c03c8a08-af41-42fe-b646-0b769677d89a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:03.550532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a21ca2-320b-4816-94c6-af977261eae8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:03.550743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c03c8a08-af41-42fe-b646-0b769677d89a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:03.550976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a21ca2-320b-4816-94c6-af977261eae8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:03.551315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c03c8a08-af41-42fe-b646-0b769677d89a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:03.551742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a21ca2-320b-4816-94c6-af977261eae8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:03.552082 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c03c8a08-af41-42fe-b646-0b769677d89a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:03.552203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a21ca2-320b-4816-94c6-af977261eae8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:03.552518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c03c8a08-af41-42fe-b646-0b769677d89a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:03.638233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c03c8a08-af41-42fe-b646-0b769677d89a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:03.646300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c03c8a08-af41-42fe-b646-0b769677d89a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.108872 Jul 14 10:13:03.647093 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1325/2653] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:03 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:03.708217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b9a21ca2-320b-4816-94c6-af977261eae8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:03.716392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b9a21ca2-320b-4816-94c6-af977261eae8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.177245 Jul 14 10:13:03.716974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1329/2654] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:03 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:04.552179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7f346956-eb52-427a-b322-ae9d9df9685b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:04.552792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7f346956-eb52-427a-b322-ae9d9df9685b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:04.554539 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-387ae5c0-568c-4748-ae60-6d840f05a58d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:04.555149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-387ae5c0-568c-4748-ae60-6d840f05a58d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:04.559578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f346956-eb52-427a-b322-ae9d9df9685b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:04.559906 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f346956-eb52-427a-b322-ae9d9df9685b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:04.560672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f346956-eb52-427a-b322-ae9d9df9685b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:04.561108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f346956-eb52-427a-b322-ae9d9df9685b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:04.561767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-387ae5c0-568c-4748-ae60-6d840f05a58d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:04.562232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-387ae5c0-568c-4748-ae60-6d840f05a58d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:04.563726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-387ae5c0-568c-4748-ae60-6d840f05a58d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:04.564315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-387ae5c0-568c-4748-ae60-6d840f05a58d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:05.011752 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7f346956-eb52-427a-b322-ae9d9df9685b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:05.023658 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-387ae5c0-568c-4748-ae60-6d840f05a58d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:05.025708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7f346956-eb52-427a-b322-ae9d9df9685b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.477571 Jul 14 10:13:05.026316 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1326/2655] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:04 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:05.030766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c135af39-b413-414a-90d7-4abbc5d4e5d6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:05.031926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c135af39-b413-414a-90d7-4abbc5d4e5d6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:05.032520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-387ae5c0-568c-4748-ae60-6d840f05a58d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.481649 Jul 14 10:13:05.033269 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1330/2656] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:04 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:05.038072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c135af39-b413-414a-90d7-4abbc5d4e5d6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:05.038283 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3212a5c2-7817-43c4-b517-4f6a072c958a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:05.038551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c135af39-b413-414a-90d7-4abbc5d4e5d6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:05.038935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3212a5c2-7817-43c4-b517-4f6a072c958a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:05.039321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c135af39-b413-414a-90d7-4abbc5d4e5d6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:05.039758 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c135af39-b413-414a-90d7-4abbc5d4e5d6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:05.044788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3212a5c2-7817-43c4-b517-4f6a072c958a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:05.045226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3212a5c2-7817-43c4-b517-4f6a072c958a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:05.045978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3212a5c2-7817-43c4-b517-4f6a072c958a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:05.046433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3212a5c2-7817-43c4-b517-4f6a072c958a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:05.110782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c135af39-b413-414a-90d7-4abbc5d4e5d6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:05.119462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c135af39-b413-414a-90d7-4abbc5d4e5d6 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.092173 Jul 14 10:13:05.120036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1327/2657] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:05 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:05.198472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3212a5c2-7817-43c4-b517-4f6a072c958a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:05.206599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3212a5c2-7817-43c4-b517-4f6a072c958a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.172208 Jul 14 10:13:05.207163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1331/2658] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:05 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:06.043700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bd0a416e-ce94-48a6-ae24-ff195cb4399a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:06.044364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bd0a416e-ce94-48a6-ae24-ff195cb4399a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:06.050735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e38f1518-e902-4d38-9912-537237e622c3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:06.051388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd0a416e-ce94-48a6-ae24-ff195cb4399a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:06.051541 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e38f1518-e902-4d38-9912-537237e622c3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:06.051841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd0a416e-ce94-48a6-ae24-ff195cb4399a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:06.052605 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd0a416e-ce94-48a6-ae24-ff195cb4399a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:06.053044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd0a416e-ce94-48a6-ae24-ff195cb4399a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:06.057925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e38f1518-e902-4d38-9912-537237e622c3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:06.058415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e38f1518-e902-4d38-9912-537237e622c3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:06.059450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e38f1518-e902-4d38-9912-537237e622c3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:06.059886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e38f1518-e902-4d38-9912-537237e622c3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:06.249662 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-bd0a416e-ce94-48a6-ae24-ff195cb4399a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:06.253994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e38f1518-e902-4d38-9912-537237e622c3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:06.258761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bd0a416e-ce94-48a6-ae24-ff195cb4399a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.218850 Jul 14 10:13:06.266437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1328/2659] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:06 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:06.266437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3c425e50-7ae4-4b69-9baf-ab1548f61b4d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:06.266437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3c425e50-7ae4-4b69-9baf-ab1548f61b4d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:06.268986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e38f1518-e902-4d38-9912-537237e622c3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.222280 Jul 14 10:13:06.271987 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c425e50-7ae4-4b69-9baf-ab1548f61b4d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:06.272489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c425e50-7ae4-4b69-9baf-ab1548f61b4d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:06.273189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c425e50-7ae4-4b69-9baf-ab1548f61b4d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:06.273624 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3c425e50-7ae4-4b69-9baf-ab1548f61b4d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:06.279511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1332/2660] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:06 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:06.284316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7f3770c4-c9ef-4e46-965f-0695db548f83 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:06.284934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7f3770c4-c9ef-4e46-965f-0695db548f83 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:06.291767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f3770c4-c9ef-4e46-965f-0695db548f83 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:06.292217 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f3770c4-c9ef-4e46-965f-0695db548f83 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:06.292986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f3770c4-c9ef-4e46-965f-0695db548f83 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:06.293419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f3770c4-c9ef-4e46-965f-0695db548f83 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:06.355348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3c425e50-7ae4-4b69-9baf-ab1548f61b4d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:06.364012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3c425e50-7ae4-4b69-9baf-ab1548f61b4d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.103527 Jul 14 10:13:06.364969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1329/2661] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:06 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:06.446579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7f3770c4-c9ef-4e46-965f-0695db548f83 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:06.455585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7f3770c4-c9ef-4e46-965f-0695db548f83 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.175644 Jul 14 10:13:06.456367 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1333/2662] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:06 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:07.276402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b02aa11d-5ab2-4109-ab35-1b2407bb8074 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:07.277015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b02aa11d-5ab2-4109-ab35-1b2407bb8074 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:07.284447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b02aa11d-5ab2-4109-ab35-1b2407bb8074 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:07.284877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b02aa11d-5ab2-4109-ab35-1b2407bb8074 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:07.285635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b02aa11d-5ab2-4109-ab35-1b2407bb8074 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:07.286067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b02aa11d-5ab2-4109-ab35-1b2407bb8074 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:07.286488 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c7c427d2-4cc2-4d62-9a8b-94b0860b8ede tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:07.287096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c7c427d2-4cc2-4d62-9a8b-94b0860b8ede tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:07.293653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7c427d2-4cc2-4d62-9a8b-94b0860b8ede tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:07.294097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7c427d2-4cc2-4d62-9a8b-94b0860b8ede tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:07.294893 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7c427d2-4cc2-4d62-9a8b-94b0860b8ede tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:07.295323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c7c427d2-4cc2-4d62-9a8b-94b0860b8ede tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:07.487312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b02aa11d-5ab2-4109-ab35-1b2407bb8074 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:07.490530 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c7c427d2-4cc2-4d62-9a8b-94b0860b8ede tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:07.495890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b02aa11d-5ab2-4109-ab35-1b2407bb8074 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.223244 Jul 14 10:13:07.496457 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1330/2663] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:07 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:07.498852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c7c427d2-4cc2-4d62-9a8b-94b0860b8ede tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.216676 Jul 14 10:13:07.499620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1334/2664] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:07 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:07.501442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0f9b4da6-e427-4d04-b984-51afe1b3ff18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:07.502043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0f9b4da6-e427-4d04-b984-51afe1b3ff18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:07.504423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c78940bb-77ef-4363-8763-33e4031600a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:07.505111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c78940bb-77ef-4363-8763-33e4031600a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:07.508343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f9b4da6-e427-4d04-b984-51afe1b3ff18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:07.508795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f9b4da6-e427-4d04-b984-51afe1b3ff18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:07.509558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f9b4da6-e427-4d04-b984-51afe1b3ff18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:07.510032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f9b4da6-e427-4d04-b984-51afe1b3ff18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:07.511383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c78940bb-77ef-4363-8763-33e4031600a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:07.511847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c78940bb-77ef-4363-8763-33e4031600a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:07.512691 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c78940bb-77ef-4363-8763-33e4031600a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:07.513190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c78940bb-77ef-4363-8763-33e4031600a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:07.597668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0f9b4da6-e427-4d04-b984-51afe1b3ff18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:07.605708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0f9b4da6-e427-4d04-b984-51afe1b3ff18 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.108287 Jul 14 10:13:07.606600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1331/2665] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:07 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:07.665492 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c78940bb-77ef-4363-8763-33e4031600a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:07.673504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c78940bb-77ef-4363-8763-33e4031600a1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.173023 Jul 14 10:13:07.674073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1335/2666] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:07 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:08.268591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:13:08.268864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:13:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:13:08.516280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1da87be5-ee24-49d4-9c8e-bfa83747a99d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:08.516879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1da87be5-ee24-49d4-9c8e-bfa83747a99d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:08.522112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-67e60a27-9d28-4b15-9999-fac7a73c3291 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:08.522705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-67e60a27-9d28-4b15-9999-fac7a73c3291 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:08.523435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1da87be5-ee24-49d4-9c8e-bfa83747a99d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:08.523878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1da87be5-ee24-49d4-9c8e-bfa83747a99d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:08.524675 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1da87be5-ee24-49d4-9c8e-bfa83747a99d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:08.525106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1da87be5-ee24-49d4-9c8e-bfa83747a99d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:08.529398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67e60a27-9d28-4b15-9999-fac7a73c3291 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:08.529844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67e60a27-9d28-4b15-9999-fac7a73c3291 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:08.530649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67e60a27-9d28-4b15-9999-fac7a73c3291 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:08.531074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67e60a27-9d28-4b15-9999-fac7a73c3291 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:08.546012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:13:08.546326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:13:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d (ip 10.222.0.40) !!! Jul 14 10:13:08.732842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1da87be5-ee24-49d4-9c8e-bfa83747a99d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:08.739348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-67e60a27-9d28-4b15-9999-fac7a73c3291 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:08.741889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1da87be5-ee24-49d4-9c8e-bfa83747a99d tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.229495 Jul 14 10:13:08.752902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1332/2667] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:08 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:08.752902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-da6d76c4-de81-48b2-b769-0d75628131ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:08.752902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-da6d76c4-de81-48b2-b769-0d75628131ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:08.753319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-67e60a27-9d28-4b15-9999-fac7a73c3291 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.230066 Jul 14 10:13:08.753319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1336/2668] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:08 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:08.754855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6d76c4-de81-48b2-b769-0d75628131ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:08.755073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dd29d418-5832-49a7-bc5f-2512e53a2db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:08.755368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6d76c4-de81-48b2-b769-0d75628131ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:08.755639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dd29d418-5832-49a7-bc5f-2512e53a2db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:08.756068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6d76c4-de81-48b2-b769-0d75628131ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:08.756505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-da6d76c4-de81-48b2-b769-0d75628131ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:08.761574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd29d418-5832-49a7-bc5f-2512e53a2db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:08.762011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd29d418-5832-49a7-bc5f-2512e53a2db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:08.762965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd29d418-5832-49a7-bc5f-2512e53a2db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:08.763390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd29d418-5832-49a7-bc5f-2512e53a2db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:08.852281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-da6d76c4-de81-48b2-b769-0d75628131ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:08.860892 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-da6d76c4-de81-48b2-b769-0d75628131ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.116539 Jul 14 10:13:08.861454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1333/2669] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:08 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:08.924421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dd29d418-5832-49a7-bc5f-2512e53a2db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:08.932542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dd29d418-5832-49a7-bc5f-2512e53a2db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.182717 Jul 14 10:13:08.933093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1337/2670] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:08 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:09.760395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1dc357b6-3b88-47ad-b9b4-3f5d65af9fe3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:09.761041 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1dc357b6-3b88-47ad-b9b4-3f5d65af9fe3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:09.768289 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1dc357b6-3b88-47ad-b9b4-3f5d65af9fe3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:09.768534 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-75caadb8-82ea-45d1-99e8-b78aa1c81662 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:09.769003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1dc357b6-3b88-47ad-b9b4-3f5d65af9fe3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:09.769101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-75caadb8-82ea-45d1-99e8-b78aa1c81662 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:09.769855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1dc357b6-3b88-47ad-b9b4-3f5d65af9fe3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:09.769950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1dc357b6-3b88-47ad-b9b4-3f5d65af9fe3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:09.775786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75caadb8-82ea-45d1-99e8-b78aa1c81662 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:09.776275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75caadb8-82ea-45d1-99e8-b78aa1c81662 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:09.776975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75caadb8-82ea-45d1-99e8-b78aa1c81662 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:09.777406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75caadb8-82ea-45d1-99e8-b78aa1c81662 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:09.963904 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1dc357b6-3b88-47ad-b9b4-3f5d65af9fe3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:09.967901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-75caadb8-82ea-45d1-99e8-b78aa1c81662 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:09.971990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1dc357b6-3b88-47ad-b9b4-3f5d65af9fe3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.215410 Jul 14 10:13:09.972584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1334/2671] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:09 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:09.975819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-75caadb8-82ea-45d1-99e8-b78aa1c81662 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.212032 Jul 14 10:13:09.976545 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1338/2672] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:09 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:09.980708 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-de877004-5f0d-49bd-92ee-55aae00155e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:09.981303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-de877004-5f0d-49bd-92ee-55aae00155e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:09.982432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1f45062a-00dc-4801-8a96-4554511338f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:09.983059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1f45062a-00dc-4801-8a96-4554511338f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:09.987900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de877004-5f0d-49bd-92ee-55aae00155e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:09.988338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de877004-5f0d-49bd-92ee-55aae00155e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:09.989089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de877004-5f0d-49bd-92ee-55aae00155e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:09.989516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de877004-5f0d-49bd-92ee-55aae00155e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:09.989781 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f45062a-00dc-4801-8a96-4554511338f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:09.990252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f45062a-00dc-4801-8a96-4554511338f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:09.991016 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f45062a-00dc-4801-8a96-4554511338f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:09.991453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1f45062a-00dc-4801-8a96-4554511338f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:10.081487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1f45062a-00dc-4801-8a96-4554511338f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:10.089602 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1f45062a-00dc-4801-8a96-4554511338f8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.116046 Jul 14 10:13:10.090182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1335/2673] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:09 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:10.146750 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-de877004-5f0d-49bd-92ee-55aae00155e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:10.155337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-de877004-5f0d-49bd-92ee-55aae00155e1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.177950 Jul 14 10:13:10.156231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1339/2674] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:09 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:10.988858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c6c23ac-ed7d-42e7-962e-705f730626f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:10.989473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1c6c23ac-ed7d-42e7-962e-705f730626f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:10.993175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c9c1010b-9d0f-4555-b20d-2934822f4920 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:10.993873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c9c1010b-9d0f-4555-b20d-2934822f4920 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:10.995777 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c6c23ac-ed7d-42e7-962e-705f730626f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:10.996281 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c6c23ac-ed7d-42e7-962e-705f730626f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:10.997046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c6c23ac-ed7d-42e7-962e-705f730626f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:10.997477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1c6c23ac-ed7d-42e7-962e-705f730626f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:11.001528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9c1010b-9d0f-4555-b20d-2934822f4920 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:11.002027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9c1010b-9d0f-4555-b20d-2934822f4920 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:11.002819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9c1010b-9d0f-4555-b20d-2934822f4920 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:11.003242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9c1010b-9d0f-4555-b20d-2934822f4920 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:11.194553 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1c6c23ac-ed7d-42e7-962e-705f730626f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:11.201636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9c1010b-9d0f-4555-b20d-2934822f4920 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:11.202648 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c6c23ac-ed7d-42e7-962e-705f730626f1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.217771 Jul 14 10:13:11.203618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1336/2675] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:10 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:11.210216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e62461ae-cb50-4704-90b6-55e08c45f2bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:11.210927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e62461ae-cb50-4704-90b6-55e08c45f2bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:11.211062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c9c1010b-9d0f-4555-b20d-2934822f4920 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.222085 Jul 14 10:13:11.221123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1340/2676] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:10 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:11.221123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6bfa5c17-861f-4fc0-b6de-a52cb63f91c1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:11.221123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6bfa5c17-861f-4fc0-b6de-a52cb63f91c1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:11.221555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e62461ae-cb50-4704-90b6-55e08c45f2bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:11.221555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e62461ae-cb50-4704-90b6-55e08c45f2bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:11.221555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e62461ae-cb50-4704-90b6-55e08c45f2bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:11.221555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e62461ae-cb50-4704-90b6-55e08c45f2bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:11.222783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bfa5c17-861f-4fc0-b6de-a52cb63f91c1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:11.223222 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bfa5c17-861f-4fc0-b6de-a52cb63f91c1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:11.223978 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bfa5c17-861f-4fc0-b6de-a52cb63f91c1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:11.224432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6bfa5c17-861f-4fc0-b6de-a52cb63f91c1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:11.289312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e62461ae-cb50-4704-90b6-55e08c45f2bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:11.297299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e62461ae-cb50-4704-90b6-55e08c45f2bf tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090778 Jul 14 10:13:11.297895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1337/2677] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:11 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:11.374350 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6bfa5c17-861f-4fc0-b6de-a52cb63f91c1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:11.382956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6bfa5c17-861f-4fc0-b6de-a52cb63f91c1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.170394 Jul 14 10:13:11.383510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1341/2678] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:11 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:12.223846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-212778de-85e4-4af8-869d-f0e76c78d3f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:12.224452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-212778de-85e4-4af8-869d-f0e76c78d3f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:12.228462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0333bc80-dcbc-4e99-82c2-8efb50cf04a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:12.229070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0333bc80-dcbc-4e99-82c2-8efb50cf04a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:12.231252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-212778de-85e4-4af8-869d-f0e76c78d3f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:12.231696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-212778de-85e4-4af8-869d-f0e76c78d3f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:12.232453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-212778de-85e4-4af8-869d-f0e76c78d3f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:12.232909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-212778de-85e4-4af8-869d-f0e76c78d3f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:12.235996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0333bc80-dcbc-4e99-82c2-8efb50cf04a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:12.236440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0333bc80-dcbc-4e99-82c2-8efb50cf04a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:12.238686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0333bc80-dcbc-4e99-82c2-8efb50cf04a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:12.238686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0333bc80-dcbc-4e99-82c2-8efb50cf04a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:12.427304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-212778de-85e4-4af8-869d-f0e76c78d3f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:12.430799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0333bc80-dcbc-4e99-82c2-8efb50cf04a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:12.435322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-212778de-85e4-4af8-869d-f0e76c78d3f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.215294 Jul 14 10:13:12.435900 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1338/2679] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:12 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:12.440170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0333bc80-dcbc-4e99-82c2-8efb50cf04a8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.215482 Jul 14 10:13:12.441168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-59736fb8-4169-42ae-b881-a3327f268840 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:12.441310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1342/2680] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:12 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:12.445884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ed316b6f-2b0d-4b53-8163-5de5210d9875 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:12.446056 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-59736fb8-4169-42ae-b881-a3327f268840 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:12.446562 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ed316b6f-2b0d-4b53-8163-5de5210d9875 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:12.448421 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=98 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:12.452787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59736fb8-4169-42ae-b881-a3327f268840 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:12.453227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59736fb8-4169-42ae-b881-a3327f268840 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:12.454031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59736fb8-4169-42ae-b881-a3327f268840 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:12.454147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ed316b6f-2b0d-4b53-8163-5de5210d9875 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:12.454516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59736fb8-4169-42ae-b881-a3327f268840 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:12.454655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ed316b6f-2b0d-4b53-8163-5de5210d9875 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:12.455315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ed316b6f-2b0d-4b53-8163-5de5210d9875 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:12.455743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ed316b6f-2b0d-4b53-8163-5de5210d9875 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:12.458577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:12.543044 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-59736fb8-4169-42ae-b881-a3327f268840 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:12.552000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-59736fb8-4169-42ae-b881-a3327f268840 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.115123 Jul 14 10:13:12.552572 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1339/2681] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:12 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:12.612489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ed316b6f-2b0d-4b53-8163-5de5210d9875 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:12.620354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ed316b6f-2b0d-4b53-8163-5de5210d9875 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.178274 Jul 14 10:13:12.620906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1343/2682] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:12 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:13.452958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-22123f14-f4a5-41d2-9000-5400b65047cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:13.453578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-22123f14-f4a5-41d2-9000-5400b65047cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:13.457282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-11b69a78-e561-4674-80e7-284cc8150539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:13.457890 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-11b69a78-e561-4674-80e7-284cc8150539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:13.461259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22123f14-f4a5-41d2-9000-5400b65047cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:13.461398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22123f14-f4a5-41d2-9000-5400b65047cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:13.462114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22123f14-f4a5-41d2-9000-5400b65047cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:13.462587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-22123f14-f4a5-41d2-9000-5400b65047cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:13.464309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11b69a78-e561-4674-80e7-284cc8150539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:13.464748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11b69a78-e561-4674-80e7-284cc8150539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:13.465509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11b69a78-e561-4674-80e7-284cc8150539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:13.465932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11b69a78-e561-4674-80e7-284cc8150539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:13.477850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:13.657360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-22123f14-f4a5-41d2-9000-5400b65047cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:13.665786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-11b69a78-e561-4674-80e7-284cc8150539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:13.666009 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-22123f14-f4a5-41d2-9000-5400b65047cd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.216889 Jul 14 10:13:13.666708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1340/2683] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:13 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:13.671313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-77e86101-da46-4345-a0bd-8be0b42675e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:13.671963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-77e86101-da46-4345-a0bd-8be0b42675e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:13.674526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-11b69a78-e561-4674-80e7-284cc8150539 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.221653 Jul 14 10:13:13.677068 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1344/2684] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:13 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:13.679073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-77e86101-da46-4345-a0bd-8be0b42675e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:13.679664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-77e86101-da46-4345-a0bd-8be0b42675e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:13.680362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f38e2957-f7e3-4b0f-abd7-861cb70fe7fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:13.680526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-77e86101-da46-4345-a0bd-8be0b42675e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:13.680946 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f38e2957-f7e3-4b0f-abd7-861cb70fe7fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:13.681084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-77e86101-da46-4345-a0bd-8be0b42675e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:13.686895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f38e2957-f7e3-4b0f-abd7-861cb70fe7fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:13.687337 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f38e2957-f7e3-4b0f-abd7-861cb70fe7fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:13.688085 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f38e2957-f7e3-4b0f-abd7-861cb70fe7fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:13.689243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f38e2957-f7e3-4b0f-abd7-861cb70fe7fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:13.756215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-77e86101-da46-4345-a0bd-8be0b42675e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:13.764426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-77e86101-da46-4345-a0bd-8be0b42675e0 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.096637 Jul 14 10:13:13.765007 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1341/2685] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:13 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:13.845661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f38e2957-f7e3-4b0f-abd7-861cb70fe7fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:13.853636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f38e2957-f7e3-4b0f-abd7-861cb70fe7fc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.176845 Jul 14 10:13:13.854225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1345/2686] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:13 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:14.684577 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b01376eb-eb06-4e20-8d82-535c8247edfd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:14.685183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b01376eb-eb06-4e20-8d82-535c8247edfd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:14.692132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b01376eb-eb06-4e20-8d82-535c8247edfd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:14.692304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-29eff3d8-8669-4ecd-895b-d070348524fc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:14.692714 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b01376eb-eb06-4e20-8d82-535c8247edfd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:14.692846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-29eff3d8-8669-4ecd-895b-d070348524fc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:14.693334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b01376eb-eb06-4e20-8d82-535c8247edfd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:14.693773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b01376eb-eb06-4e20-8d82-535c8247edfd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:14.700237 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29eff3d8-8669-4ecd-895b-d070348524fc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:14.700680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29eff3d8-8669-4ecd-895b-d070348524fc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:14.701440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29eff3d8-8669-4ecd-895b-d070348524fc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:14.701871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-29eff3d8-8669-4ecd-895b-d070348524fc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:14.891467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b01376eb-eb06-4e20-8d82-535c8247edfd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:14.898324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-29eff3d8-8669-4ecd-895b-d070348524fc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:14.899995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b01376eb-eb06-4e20-8d82-535c8247edfd tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.219261 Jul 14 10:13:14.900808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1342/2687] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:14 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:14.905037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a59e7b2b-37aa-4b7d-b4f7-0f3f3cf2705e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:14.905633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a59e7b2b-37aa-4b7d-b4f7-0f3f3cf2705e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:14.906695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-29eff3d8-8669-4ecd-895b-d070348524fc tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.218119 Jul 14 10:13:14.916683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1346/2688] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:14 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:14.916894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a59e7b2b-37aa-4b7d-b4f7-0f3f3cf2705e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:14.916894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a59e7b2b-37aa-4b7d-b4f7-0f3f3cf2705e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:14.917123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dbf11f5f-acd1-4bc4-85c0-8f2c5f87cb12 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:14.917123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dbf11f5f-acd1-4bc4-85c0-8f2c5f87cb12 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:14.917311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a59e7b2b-37aa-4b7d-b4f7-0f3f3cf2705e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:14.917311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a59e7b2b-37aa-4b7d-b4f7-0f3f3cf2705e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:14.919417 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dbf11f5f-acd1-4bc4-85c0-8f2c5f87cb12 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:14.919859 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dbf11f5f-acd1-4bc4-85c0-8f2c5f87cb12 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:14.920698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dbf11f5f-acd1-4bc4-85c0-8f2c5f87cb12 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:14.921127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dbf11f5f-acd1-4bc4-85c0-8f2c5f87cb12 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:14.988080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a59e7b2b-37aa-4b7d-b4f7-0f3f3cf2705e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:14.996120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a59e7b2b-37aa-4b7d-b4f7-0f3f3cf2705e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.094589 Jul 14 10:13:14.996684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1343/2689] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:14 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:15.070517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dbf11f5f-acd1-4bc4-85c0-8f2c5f87cb12 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:15.078605 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dbf11f5f-acd1-4bc4-85c0-8f2c5f87cb12 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.169758 Jul 14 10:13:15.079090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1347/2690] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:14 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:15.917919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7328dfba-853b-4529-8b98-390c9e1825f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:15.918603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7328dfba-853b-4529-8b98-390c9e1825f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:15.925564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8b64988a-883d-4f25-8e27-b767720c9a48 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:15.926155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7328dfba-853b-4529-8b98-390c9e1825f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:15.926297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8b64988a-883d-4f25-8e27-b767720c9a48 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:15.926570 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7328dfba-853b-4529-8b98-390c9e1825f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:15.927338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7328dfba-853b-4529-8b98-390c9e1825f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:15.927845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7328dfba-853b-4529-8b98-390c9e1825f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:15.933503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b64988a-883d-4f25-8e27-b767720c9a48 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:15.933945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b64988a-883d-4f25-8e27-b767720c9a48 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:15.934739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b64988a-883d-4f25-8e27-b767720c9a48 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:15.935410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8b64988a-883d-4f25-8e27-b767720c9a48 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:16.128959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7328dfba-853b-4529-8b98-390c9e1825f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:16.131991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8b64988a-883d-4f25-8e27-b767720c9a48 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:16.137938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7328dfba-853b-4529-8b98-390c9e1825f8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.223862 Jul 14 10:13:16.138862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1344/2691] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:15 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:16.143805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8740367e-5112-4761-9757-ffa8478002a4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:16.144081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8740367e-5112-4761-9757-ffa8478002a4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:16.149586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8b64988a-883d-4f25-8e27-b767720c9a48 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.229232 Jul 14 10:13:16.149844 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8740367e-5112-4761-9757-ffa8478002a4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:16.150321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8740367e-5112-4761-9757-ffa8478002a4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:16.151097 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8740367e-5112-4761-9757-ffa8478002a4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:16.151555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8740367e-5112-4761-9757-ffa8478002a4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:16.159027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1348/2692] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:15 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:16.163956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-930aef62-6645-4671-9865-d7f668403e6e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:16.164561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-930aef62-6645-4671-9865-d7f668403e6e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:16.170791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-930aef62-6645-4671-9865-d7f668403e6e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:16.171249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-930aef62-6645-4671-9865-d7f668403e6e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:16.172024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-930aef62-6645-4671-9865-d7f668403e6e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:16.172471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-930aef62-6645-4671-9865-d7f668403e6e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:16.224224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8740367e-5112-4761-9757-ffa8478002a4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:16.233254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8740367e-5112-4761-9757-ffa8478002a4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.093468 Jul 14 10:13:16.234150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1345/2693] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:16 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:16.322905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-930aef62-6645-4671-9865-d7f668403e6e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:16.331155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-930aef62-6645-4671-9865-d7f668403e6e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.170982 Jul 14 10:13:16.332058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1349/2694] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:16 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:16.778119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-32b0473f-64bc-4b96-bd88-0cfda5e6cbcf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:16.778641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-32b0473f-64bc-4b96-bd88-0cfda5e6cbcf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:16.785721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32b0473f-64bc-4b96-bd88-0cfda5e6cbcf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:16.786168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32b0473f-64bc-4b96-bd88-0cfda5e6cbcf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:16.786946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32b0473f-64bc-4b96-bd88-0cfda5e6cbcf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:16.787374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32b0473f-64bc-4b96-bd88-0cfda5e6cbcf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:16.812193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-32b0473f-64bc-4b96-bd88-0cfda5e6cbcf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:13:16.886688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-32b0473f-64bc-4b96-bd88-0cfda5e6cbcf tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 204 len: 0 microversion: 2.20 time: 0.112669 Jul 14 10:13:16.887267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1346/2695] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:13:16 2022] DELETE /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:13:16.896064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:16.896665 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:16.902636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:16.903070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:16.903811 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:16.904238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.036227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:17.046064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:17.047618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:17.048779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1ed79db2-2f2c-4633-acd1-36d365995142 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1723 microversion: 2.20 time: 0.157219 Jul 14 10:13:17.049335 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1350/2696] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:13:16 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:13:17.156073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-62f275c6-dc2a-4d46-948e-3531e25298ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:17.156764 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-62f275c6-dc2a-4d46-948e-3531e25298ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:17.163326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62f275c6-dc2a-4d46-948e-3531e25298ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:17.168968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62f275c6-dc2a-4d46-948e-3531e25298ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.168968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62f275c6-dc2a-4d46-948e-3531e25298ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:17.168968 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62f275c6-dc2a-4d46-948e-3531e25298ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.169332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c2b65415-2b1f-4416-ae73-300ab467b253 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:17.169332 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c2b65415-2b1f-4416-ae73-300ab467b253 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:17.173134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c2b65415-2b1f-4416-ae73-300ab467b253 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:17.173580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c2b65415-2b1f-4416-ae73-300ab467b253 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.174402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c2b65415-2b1f-4416-ae73-300ab467b253 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:17.174858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c2b65415-2b1f-4416-ae73-300ab467b253 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.360425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-62f275c6-dc2a-4d46-948e-3531e25298ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:17.367296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c2b65415-2b1f-4416-ae73-300ab467b253 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:17.368447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-62f275c6-dc2a-4d46-948e-3531e25298ce tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.216796 Jul 14 10:13:17.370230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1347/2697] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:17 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:17.373513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a36cdda3-ead0-47fa-b485-8710a141fd1f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:17.374283 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a36cdda3-ead0-47fa-b485-8710a141fd1f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:17.376438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c2b65415-2b1f-4416-ae73-300ab467b253 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.213344 Jul 14 10:13:17.377075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1351/2698] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:17 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:17.381918 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a36cdda3-ead0-47fa-b485-8710a141fd1f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:17.382101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2c82a854-0c05-451d-99ce-09620a12201a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:17.382399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a36cdda3-ead0-47fa-b485-8710a141fd1f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.382804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2c82a854-0c05-451d-99ce-09620a12201a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:17.383163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a36cdda3-ead0-47fa-b485-8710a141fd1f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:17.383595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a36cdda3-ead0-47fa-b485-8710a141fd1f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.388871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c82a854-0c05-451d-99ce-09620a12201a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:17.389312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c82a854-0c05-451d-99ce-09620a12201a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.390122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c82a854-0c05-451d-99ce-09620a12201a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:17.390722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c82a854-0c05-451d-99ce-09620a12201a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:17.454279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a36cdda3-ead0-47fa-b485-8710a141fd1f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:17.462208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a36cdda3-ead0-47fa-b485-8710a141fd1f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.092188 Jul 14 10:13:17.462789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1348/2699] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:17 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:17.540586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2c82a854-0c05-451d-99ce-09620a12201a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:17.549101 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2c82a854-0c05-451d-99ce-09620a12201a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.170953 Jul 14 10:13:17.549678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1352/2700] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:17 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:18.067634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:18.068244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:18.074401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.074854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.075649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.076089 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.211326 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:18.219403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:18.221621 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:18.222923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4588b7cc-c1cf-4fbf-b016-fc5ff714d237 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1723 microversion: 2.20 time: 0.159239 Jul 14 10:13:18.223566 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1349/2701] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:13:18 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:13:18.386674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eae218af-725f-442d-9e35-f0b3140fc2a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:18.387291 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eae218af-725f-442d-9e35-f0b3140fc2a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:18.393336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-50213d5f-1fe5-4471-a51c-ddc6d2731b15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:18.394167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-50213d5f-1fe5-4471-a51c-ddc6d2731b15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:18.397411 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eae218af-725f-442d-9e35-f0b3140fc2a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.397744 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eae218af-725f-442d-9e35-f0b3140fc2a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.398624 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eae218af-725f-442d-9e35-f0b3140fc2a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.399152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eae218af-725f-442d-9e35-f0b3140fc2a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.400455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50213d5f-1fe5-4471-a51c-ddc6d2731b15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.400909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50213d5f-1fe5-4471-a51c-ddc6d2731b15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.401785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50213d5f-1fe5-4471-a51c-ddc6d2731b15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.402234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-50213d5f-1fe5-4471-a51c-ddc6d2731b15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.601105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-50213d5f-1fe5-4471-a51c-ddc6d2731b15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:18.605136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-eae218af-725f-442d-9e35-f0b3140fc2a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:18.609132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-50213d5f-1fe5-4471-a51c-ddc6d2731b15 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.220209 Jul 14 10:13:18.609712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1350/2702] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:18 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:18.613487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eae218af-725f-442d-9e35-f0b3140fc2a6 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.230679 Jul 14 10:13:18.614179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7f906b54-7097-478d-8402-2d07fc55a353 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:18.614850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7f906b54-7097-478d-8402-2d07fc55a353 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:18.620912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f906b54-7097-478d-8402-2d07fc55a353 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.621361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f906b54-7097-478d-8402-2d07fc55a353 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.622115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f906b54-7097-478d-8402-2d07fc55a353 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.622616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7f906b54-7097-478d-8402-2d07fc55a353 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.623133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1353/2703] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:18 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:18.628352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0c419d4a-78bb-4194-b297-17f4ec8d7d66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:18.628962 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0c419d4a-78bb-4194-b297-17f4ec8d7d66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:18.634973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c419d4a-78bb-4194-b297-17f4ec8d7d66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.635360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c419d4a-78bb-4194-b297-17f4ec8d7d66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.636120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c419d4a-78bb-4194-b297-17f4ec8d7d66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:18.636556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0c419d4a-78bb-4194-b297-17f4ec8d7d66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:18.695640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7f906b54-7097-478d-8402-2d07fc55a353 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:18.706779 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7f906b54-7097-478d-8402-2d07fc55a353 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.096006 Jul 14 10:13:18.707715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1351/2704] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:18 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:18.792373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0c419d4a-78bb-4194-b297-17f4ec8d7d66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:18.802618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0c419d4a-78bb-4194-b297-17f4ec8d7d66 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.178256 Jul 14 10:13:18.803264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1354/2705] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:18 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:19.241444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:19.242136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:19.249458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.249902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.251388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.251830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.385194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:19.393237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:19.394774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:19.395923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-959d8d7e-b4e8-404e-900a-6c9fd74a0415 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1723 microversion: 2.20 time: 0.158510 Jul 14 10:13:19.396480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1352/2706] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:13:19 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:13:19.636504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-50a2ed67-7d63-44d9-ae48-41dc7fde9b6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:19.637912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-64773ef9-636b-4f00-98b5-a304effe251c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:19.638647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-64773ef9-636b-4f00-98b5-a304effe251c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:19.642413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-50a2ed67-7d63-44d9-ae48-41dc7fde9b6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:19.646026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-64773ef9-636b-4f00-98b5-a304effe251c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.646606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-64773ef9-636b-4f00-98b5-a304effe251c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.647498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-64773ef9-636b-4f00-98b5-a304effe251c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.648029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-64773ef9-636b-4f00-98b5-a304effe251c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.648991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50a2ed67-7d63-44d9-ae48-41dc7fde9b6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.649435 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50a2ed67-7d63-44d9-ae48-41dc7fde9b6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.650236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50a2ed67-7d63-44d9-ae48-41dc7fde9b6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.650660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50a2ed67-7d63-44d9-ae48-41dc7fde9b6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.839669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-64773ef9-636b-4f00-98b5-a304effe251c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:19.851050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-64773ef9-636b-4f00-98b5-a304effe251c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.224000 Jul 14 10:13:19.851984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1353/2707] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:19 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:19.857643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-49410ecd-26c4-4187-a9a6-dedd180224fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:19.858487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-49410ecd-26c4-4187-a9a6-dedd180224fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:19.865286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49410ecd-26c4-4187-a9a6-dedd180224fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.865898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49410ecd-26c4-4187-a9a6-dedd180224fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.866026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-50a2ed67-7d63-44d9-ae48-41dc7fde9b6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:19.866702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49410ecd-26c4-4187-a9a6-dedd180224fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.867134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-49410ecd-26c4-4187-a9a6-dedd180224fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.877931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-50a2ed67-7d63-44d9-ae48-41dc7fde9b6f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.253830 Jul 14 10:13:19.879422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1355/2708] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:19 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:19.884297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bb25c353-08e8-45a0-9149-86ec6727effc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:19.886404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bb25c353-08e8-45a0-9149-86ec6727effc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:19.894465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb25c353-08e8-45a0-9149-86ec6727effc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.894706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb25c353-08e8-45a0-9149-86ec6727effc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.896183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb25c353-08e8-45a0-9149-86ec6727effc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.896791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bb25c353-08e8-45a0-9149-86ec6727effc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:19.956021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-49410ecd-26c4-4187-a9a6-dedd180224fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:19.966616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-49410ecd-26c4-4187-a9a6-dedd180224fb tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.113195 Jul 14 10:13:19.967194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1354/2709] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:19 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:19.974270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-225603e0-25a4-4912-a5e0-af35fc6f1f30 req-56e44713-0d4d-4f17-b013-7b7386b76875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a1cd68-ca43-4d4c-9bcf-6b1552e945cc", "name": "network-vif-deleted", "tag": "a2043256-8dca-4e80-a796-080a18c21591"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:19.989500 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-225603e0-25a4-4912-a5e0-af35fc6f1f30 req-56e44713-0d4d-4f17-b013-7b7386b76875 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:19.989939 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-225603e0-25a4-4912-a5e0-af35fc6f1f30 req-56e44713-0d4d-4f17-b013-7b7386b76875 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:20.005774 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-225603e0-25a4-4912-a5e0-af35fc6f1f30 req-56e44713-0d4d-4f17-b013-7b7386b76875 service nova] Creating event network-vif-deleted:a2043256-8dca-4e80-a796-080a18c21591 for instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc on hv-cinder-82549 Jul 14 10:13:20.011996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-225603e0-25a4-4912-a5e0-af35fc6f1f30 req-56e44713-0d4d-4f17-b013-7b7386b76875 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042943 Jul 14 10:13:20.012780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1355/2710] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:13:20.056143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bb25c353-08e8-45a0-9149-86ec6727effc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:20.067404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bb25c353-08e8-45a0-9149-86ec6727effc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.185456 Jul 14 10:13:20.068021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1356/2711] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:19 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:20.415299 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:20.416181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:20.422420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:20.423413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:20.424177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:20.424618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:20.437791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:20.469720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:20.470038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:20.470528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lazy-loading 'fault' on Instance uuid 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:13:20.519238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:20.532515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:20.534002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f50c3855aa764c2fb86c48c90eb9e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d87102c8234c7f9ba0c1a6299ba3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:20.535210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b9cedcb1-7811-4736-ab61-6b44e91f6c12 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 200 len: 1371 microversion: 2.20 time: 0.124896 Jul 14 10:13:20.535967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1356/2712] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:13:20 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:13:20.876597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ebe1b85f-84dd-473f-bbe6-dac1c94e17f7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:20.877265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ebe1b85f-84dd-473f-bbe6-dac1c94e17f7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:20.885240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ebe1b85f-84dd-473f-bbe6-dac1c94e17f7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:20.885712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ebe1b85f-84dd-473f-bbe6-dac1c94e17f7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:20.886513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ebe1b85f-84dd-473f-bbe6-dac1c94e17f7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:20.886948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ebe1b85f-84dd-473f-bbe6-dac1c94e17f7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:20.895784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72ee02c4-153d-486a-95ec-6378c7f77925 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:20.896395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-72ee02c4-153d-486a-95ec-6378c7f77925 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:20.903068 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72ee02c4-153d-486a-95ec-6378c7f77925 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:20.903524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72ee02c4-153d-486a-95ec-6378c7f77925 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:20.904290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72ee02c4-153d-486a-95ec-6378c7f77925 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:20.904912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72ee02c4-153d-486a-95ec-6378c7f77925 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:21.093093 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ebe1b85f-84dd-473f-bbe6-dac1c94e17f7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:21.102873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-72ee02c4-153d-486a-95ec-6378c7f77925 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:21.103122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ebe1b85f-84dd-473f-bbe6-dac1c94e17f7 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.230310 Jul 14 10:13:21.103472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1357/2713] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:20 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:21.108065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-78fbce73-76a5-4cd9-9d23-90167bfe453b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:21.108661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-78fbce73-76a5-4cd9-9d23-90167bfe453b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:21.115729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78fbce73-76a5-4cd9-9d23-90167bfe453b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:21.116173 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78fbce73-76a5-4cd9-9d23-90167bfe453b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:21.117424 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78fbce73-76a5-4cd9-9d23-90167bfe453b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:21.117865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-78fbce73-76a5-4cd9-9d23-90167bfe453b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:21.120908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-72ee02c4-153d-486a-95ec-6378c7f77925 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.229219 Jul 14 10:13:21.130664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1357/2714] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:20 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:21.136831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e8d65196-a539-4104-ba9a-9735e57e1e6c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:21.137439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e8d65196-a539-4104-ba9a-9735e57e1e6c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:21.144531 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e8d65196-a539-4104-ba9a-9735e57e1e6c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:21.144899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e8d65196-a539-4104-ba9a-9735e57e1e6c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:21.145657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e8d65196-a539-4104-ba9a-9735e57e1e6c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:21.146090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e8d65196-a539-4104-ba9a-9735e57e1e6c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:21.191049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-78fbce73-76a5-4cd9-9d23-90167bfe453b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:21.201470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-78fbce73-76a5-4cd9-9d23-90167bfe453b tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.096972 Jul 14 10:13:21.202056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1358/2715] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:21 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:21.286343 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e8d65196-a539-4104-ba9a-9735e57e1e6c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:21.294324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e8d65196-a539-4104-ba9a-9735e57e1e6c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.162277 Jul 14 10:13:21.294897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1358/2716] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:21 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:21.553660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:21.554300 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:21.560590 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:21.561038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:21.561797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:21.562255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:21.576449 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] HTTP exception thrown: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Request method failure captured: Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc HTTP/1.1 Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5wZKDg4aGJEw2vYv6cXSHrRsNTEK6aBFxZpUthC5Hm2uGIW-p0tW-oTs2B6M1VV8UkhjIwCegMji1mncxw9X-fC2pNUwGaAeelP6Md_nJJrPHjbP0k6TdVQYTBiGiJWlIJaVcU_SkF4QhPc3EPFqpEe0cXazGpInOCCmbCqctQhs Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:13:21.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f50c3855aa764c2fb86c48c90eb9e15c Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:21.580762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '73a1cd68-ca43-4d4c-9bcf-6b1552e945cc'} Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:21.581873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:21.583579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:21.585110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Returning 404 to user: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:21.585110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-41e25266-ebb0-4b92-b760-6f3c4f128e0e tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 404 len: 111 microversion: 2.20 time: 0.030678 Jul 14 10:13:21.585110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1359/2717] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:13:21 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:13:21.589003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-675d7e52-c57c-4d94-a058-2962c46b6d16 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '.version_select at 0x7f7da63ae430>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:21.608908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-675d7e52-c57c-4d94-a058-2962c46b6d16 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-257520433" status: 204 len: 0 microversion: 2.20 time: 0.023716 Jul 14 10:13:21.609464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1359/2718] 10.222.0.40 () {60 vars in 1258 bytes} [Thu Jul 14 10:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-257520433 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:13:22.126664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e64c037b-c5ba-4e21-bc18-7b5aa6dae8e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:22.127277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e64c037b-c5ba-4e21-bc18-7b5aa6dae8e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:22.135089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e64c037b-c5ba-4e21-bc18-7b5aa6dae8e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.135532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e64c037b-c5ba-4e21-bc18-7b5aa6dae8e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.136578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e64c037b-c5ba-4e21-bc18-7b5aa6dae8e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.136939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e64c037b-c5ba-4e21-bc18-7b5aa6dae8e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.140874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8944976f-3855-4f5a-9c5f-8acabeb7666b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:22.141601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8944976f-3855-4f5a-9c5f-8acabeb7666b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:22.148198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8944976f-3855-4f5a-9c5f-8acabeb7666b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.148645 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8944976f-3855-4f5a-9c5f-8acabeb7666b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.149409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8944976f-3855-4f5a-9c5f-8acabeb7666b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.149856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8944976f-3855-4f5a-9c5f-8acabeb7666b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.155288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:22.390702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8944976f-3855-4f5a-9c5f-8acabeb7666b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:22.394551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e64c037b-c5ba-4e21-bc18-7b5aa6dae8e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:22.399164 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8944976f-3855-4f5a-9c5f-8acabeb7666b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.262332 Jul 14 10:13:22.399734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1360/2719] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:22 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:22.404095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ee8295c5-3b6e-4bcb-8d05-cd9e283896f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:22.404700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ee8295c5-3b6e-4bcb-8d05-cd9e283896f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:22.408163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e64c037b-c5ba-4e21-bc18-7b5aa6dae8e4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.285484 Jul 14 10:13:22.417769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1360/2720] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:22 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:22.417990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee8295c5-3b6e-4bcb-8d05-cd9e283896f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.417990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee8295c5-3b6e-4bcb-8d05-cd9e283896f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.417990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee8295c5-3b6e-4bcb-8d05-cd9e283896f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.417990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ee8295c5-3b6e-4bcb-8d05-cd9e283896f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.418440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-80883fe8-441e-4563-8ffb-aaabbc806382 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:22.418440 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-80883fe8-441e-4563-8ffb-aaabbc806382 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:22.421749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80883fe8-441e-4563-8ffb-aaabbc806382 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.422353 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80883fe8-441e-4563-8ffb-aaabbc806382 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.423646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80883fe8-441e-4563-8ffb-aaabbc806382 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.424083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80883fe8-441e-4563-8ffb-aaabbc806382 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.482050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ee8295c5-3b6e-4bcb-8d05-cd9e283896f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:22.490946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ee8295c5-3b6e-4bcb-8d05-cd9e283896f4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.090166 Jul 14 10:13:22.498335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1361/2721] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:22 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:22.502539 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:22.503040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:22.509465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.509921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.510717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.511161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.525270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] HTTP exception thrown: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Request method failure captured: Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc HTTP/1.1 Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5wZKDg4aGJEw2vYv6cXSHrRsNTEK6aBFxZpUthC5Hm2uGIW-p0tW-oTs2B6M1VV8UkhjIwCegMji1mncxw9X-fC2pNUwGaAeelP6Md_nJJrPHjbP0k6TdVQYTBiGiJWlIJaVcU_SkF4QhPc3EPFqpEe0cXazGpInOCCmbCqctQhs Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:13:22.526885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f50c3855aa764c2fb86c48c90eb9e15c Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.528440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '73a1cd68-ca43-4d4c-9bcf-6b1552e945cc'} Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:22.529303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.530670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.532846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Returning 404 to user: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:22.532846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c9fe7129-4181-4e23-a0b1-7b2edd4553ff tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 404 len: 111 microversion: 2.20 time: 0.035830 Jul 14 10:13:22.532846 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1362/2722] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:13:22 2022] DELETE /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:13:22.538138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:22.538771 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:22.544921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.545371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.546131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:22.546643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:22.561431 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] HTTP exception thrown: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Request method failure captured: Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc HTTP/1.1 Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5wZKDg4aGJEw2vYv6cXSHrRsNTEK6aBFxZpUthC5Hm2uGIW-p0tW-oTs2B6M1VV8UkhjIwCegMji1mncxw9X-fC2pNUwGaAeelP6Md_nJJrPHjbP0k6TdVQYTBiGiJWlIJaVcU_SkF4QhPc3EPFqpEe0cXazGpInOCCmbCqctQhs Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:13:22.562993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f50c3855aa764c2fb86c48c90eb9e15c Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.564784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '73a1cd68-ca43-4d4c-9bcf-6b1552e945cc'} Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:22.565802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. Jul 14 10:13:22.567464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:22.568912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Returning 404 to user: Instance 73a1cd68-ca43-4d4c-9bcf-6b1552e945cc could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:22.568912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-333e965b-d64a-4064-a163-a27471e800ca tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc" status: 404 len: 111 microversion: 2.20 time: 0.030013 Jul 14 10:13:22.568912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1363/2723] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:13:22 2022] GET /compute/v2.1/servers/73a1cd68-ca43-4d4c-9bcf-6b1552e945cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:13:22.586126 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-80883fe8-441e-4563-8ffb-aaabbc806382 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:22.594221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-80883fe8-441e-4563-8ffb-aaabbc806382 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.183570 Jul 14 10:13:22.595352 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1361/2724] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:22 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:23.416872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1595adca-e2ed-4e4e-b5a4-ce4a9ae79db1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:23.417515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1595adca-e2ed-4e4e-b5a4-ce4a9ae79db1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:23.424850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1595adca-e2ed-4e4e-b5a4-ce4a9ae79db1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:23.425543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1595adca-e2ed-4e4e-b5a4-ce4a9ae79db1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:23.425680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-92847dfd-f782-4c2a-8f51-4257d53daf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:23.426249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-92847dfd-f782-4c2a-8f51-4257d53daf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:23.426380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1595adca-e2ed-4e4e-b5a4-ce4a9ae79db1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:23.426784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1595adca-e2ed-4e4e-b5a4-ce4a9ae79db1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:23.432671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-92847dfd-f782-4c2a-8f51-4257d53daf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:23.433109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-92847dfd-f782-4c2a-8f51-4257d53daf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:23.433856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-92847dfd-f782-4c2a-8f51-4257d53daf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:23.434319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-92847dfd-f782-4c2a-8f51-4257d53daf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:23.624590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1595adca-e2ed-4e4e-b5a4-ce4a9ae79db1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:23.628980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-92847dfd-f782-4c2a-8f51-4257d53daf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:23.633345 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1595adca-e2ed-4e4e-b5a4-ce4a9ae79db1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.220298 Jul 14 10:13:23.633938 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1364/2725] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:23 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:23.636936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-92847dfd-f782-4c2a-8f51-4257d53daf06 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.216057 Jul 14 10:13:23.637487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1362/2726] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:23 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:23.638515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2096d0a7-72d9-4a5f-add2-146f8aaecc1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:23.639186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2096d0a7-72d9-4a5f-add2-146f8aaecc1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:23.642926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e0ffaf16-21da-43da-bcbc-af9e05f9f067 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:23.643628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e0ffaf16-21da-43da-bcbc-af9e05f9f067 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:23.649199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2096d0a7-72d9-4a5f-add2-146f8aaecc1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:23.649540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e0ffaf16-21da-43da-bcbc-af9e05f9f067 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:23.649965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2096d0a7-72d9-4a5f-add2-146f8aaecc1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:23.650110 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e0ffaf16-21da-43da-bcbc-af9e05f9f067 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:23.650770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e0ffaf16-21da-43da-bcbc-af9e05f9f067 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:23.650889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2096d0a7-72d9-4a5f-add2-146f8aaecc1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:23.651201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e0ffaf16-21da-43da-bcbc-af9e05f9f067 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:23.651366 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2096d0a7-72d9-4a5f-add2-146f8aaecc1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:23.792026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e0ffaf16-21da-43da-bcbc-af9e05f9f067 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:23.801385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e0ffaf16-21da-43da-bcbc-af9e05f9f067 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.162565 Jul 14 10:13:23.801968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1363/2727] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:23 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:23.868147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2096d0a7-72d9-4a5f-add2-146f8aaecc1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:23.876145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2096d0a7-72d9-4a5f-add2-146f8aaecc1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.241156 Jul 14 10:13:23.876809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1365/2728] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:23 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:24.651214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cd0d08af-dbd4-4bf0-8b84-8d52b8002191 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:24.651796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cd0d08af-dbd4-4bf0-8b84-8d52b8002191 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:24.659788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd0d08af-dbd4-4bf0-8b84-8d52b8002191 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:24.660192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a9250a9f-11ed-4927-8585-58ad60ae558f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:24.660648 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd0d08af-dbd4-4bf0-8b84-8d52b8002191 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:24.660817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a9250a9f-11ed-4927-8585-58ad60ae558f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:24.661212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd0d08af-dbd4-4bf0-8b84-8d52b8002191 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:24.661640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cd0d08af-dbd4-4bf0-8b84-8d52b8002191 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:24.667661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9250a9f-11ed-4927-8585-58ad60ae558f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:24.668101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9250a9f-11ed-4927-8585-58ad60ae558f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:24.668883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9250a9f-11ed-4927-8585-58ad60ae558f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:24.669338 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a9250a9f-11ed-4927-8585-58ad60ae558f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:24.865765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cd0d08af-dbd4-4bf0-8b84-8d52b8002191 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:24.876072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a9250a9f-11ed-4927-8585-58ad60ae558f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:24.879841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cd0d08af-dbd4-4bf0-8b84-8d52b8002191 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.232211 Jul 14 10:13:24.880423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1364/2729] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:24 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:24.884957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-69896350-da1d-4239-b28c-4b1e59ed655b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:24.885561 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-69896350-da1d-4239-b28c-4b1e59ed655b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:24.885871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a9250a9f-11ed-4927-8585-58ad60ae558f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.230141 Jul 14 10:13:24.886757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1366/2730] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:24 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:24.892999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69896350-da1d-4239-b28c-4b1e59ed655b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:24.893446 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69896350-da1d-4239-b28c-4b1e59ed655b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:24.894234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69896350-da1d-4239-b28c-4b1e59ed655b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:24.894671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-69896350-da1d-4239-b28c-4b1e59ed655b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:24.900861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-46075610-87fb-4e5f-a5bc-7a478234fb84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:24.901469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-46075610-87fb-4e5f-a5bc-7a478234fb84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:24.908123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46075610-87fb-4e5f-a5bc-7a478234fb84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:24.908631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46075610-87fb-4e5f-a5bc-7a478234fb84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:24.909371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46075610-87fb-4e5f-a5bc-7a478234fb84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:24.909800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-46075610-87fb-4e5f-a5bc-7a478234fb84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:24.991518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-46075610-87fb-4e5f-a5bc-7a478234fb84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:24.999407 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-46075610-87fb-4e5f-a5bc-7a478234fb84 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.102410 Jul 14 10:13:24.999969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1367/2731] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:24 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:25.048805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-69896350-da1d-4239-b28c-4b1e59ed655b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:25.057076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-69896350-da1d-4239-b28c-4b1e59ed655b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.175673 Jul 14 10:13:25.057639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1365/2732] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:24 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:25.897058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6ffd47f5-5ab7-4f1b-9490-883ec018d331 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:25.897635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6ffd47f5-5ab7-4f1b-9490-883ec018d331 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:25.899882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:25.903097 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-de2e498e-4653-453e-b23c-dbd30b773cee tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:25.903703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-de2e498e-4653-453e-b23c-dbd30b773cee tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:25.905244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ffd47f5-5ab7-4f1b-9490-883ec018d331 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:25.905695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ffd47f5-5ab7-4f1b-9490-883ec018d331 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:25.906484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ffd47f5-5ab7-4f1b-9490-883ec018d331 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:25.907024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ffd47f5-5ab7-4f1b-9490-883ec018d331 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:25.910039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de2e498e-4653-453e-b23c-dbd30b773cee tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:25.910511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de2e498e-4653-453e-b23c-dbd30b773cee tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:25.911265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de2e498e-4653-453e-b23c-dbd30b773cee tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:25.911776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-de2e498e-4653-453e-b23c-dbd30b773cee tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:26.095869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6ffd47f5-5ab7-4f1b-9490-883ec018d331 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:26.104508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6ffd47f5-5ab7-4f1b-9490-883ec018d331 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.211298 Jul 14 10:13:26.105296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1368/2733] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:25 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:26.110060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-75dd2ec0-a6ba-47c6-b4ad-7743ee01f66d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:26.111362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-75dd2ec0-a6ba-47c6-b4ad-7743ee01f66d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:26.112063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-de2e498e-4653-453e-b23c-dbd30b773cee tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:26.117705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75dd2ec0-a6ba-47c6-b4ad-7743ee01f66d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:26.118151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75dd2ec0-a6ba-47c6-b4ad-7743ee01f66d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:26.118944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75dd2ec0-a6ba-47c6-b4ad-7743ee01f66d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:26.119380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-75dd2ec0-a6ba-47c6-b4ad-7743ee01f66d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:26.119861 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-de2e498e-4653-453e-b23c-dbd30b773cee tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.220520 Jul 14 10:13:26.120433 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1366/2734] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:25 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:26.124915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-8fbca770-648d-432a-8285-5d0b229fe8cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:26.125516 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-8fbca770-648d-432a-8285-5d0b229fe8cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:26.132357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fbca770-648d-432a-8285-5d0b229fe8cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:26.132795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fbca770-648d-432a-8285-5d0b229fe8cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:26.133647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fbca770-648d-432a-8285-5d0b229fe8cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:26.134380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-8fbca770-648d-432a-8285-5d0b229fe8cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:26.184024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-75dd2ec0-a6ba-47c6-b4ad-7743ee01f66d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:26.192339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-75dd2ec0-a6ba-47c6-b4ad-7743ee01f66d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.085979 Jul 14 10:13:26.192915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1369/2735] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:26 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:26.279664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-8fbca770-648d-432a-8285-5d0b229fe8cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:26.289369 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-8fbca770-648d-432a-8285-5d0b229fe8cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.167944 Jul 14 10:13:26.289939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1367/2736] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:26 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:27.122666 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-979be516-25b3-4c0b-a409-9b3e851964d3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:27.123340 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-979be516-25b3-4c0b-a409-9b3e851964d3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:27.130552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-979be516-25b3-4c0b-a409-9b3e851964d3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:27.131001 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-979be516-25b3-4c0b-a409-9b3e851964d3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:27.131797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-979be516-25b3-4c0b-a409-9b3e851964d3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:27.132237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-979be516-25b3-4c0b-a409-9b3e851964d3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:27.137077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dd80e37c-3c00-49c0-8973-97aaf264cab8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:27.137678 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dd80e37c-3c00-49c0-8973-97aaf264cab8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:27.144148 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd80e37c-3c00-49c0-8973-97aaf264cab8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:27.144586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd80e37c-3c00-49c0-8973-97aaf264cab8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:27.145338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd80e37c-3c00-49c0-8973-97aaf264cab8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:27.145762 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd80e37c-3c00-49c0-8973-97aaf264cab8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:27.330479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-979be516-25b3-4c0b-a409-9b3e851964d3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:27.334806 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dd80e37c-3c00-49c0-8973-97aaf264cab8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:27.338629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-979be516-25b3-4c0b-a409-9b3e851964d3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.219761 Jul 14 10:13:27.339218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1370/2737] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:27 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:27.343141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dd80e37c-3c00-49c0-8973-97aaf264cab8 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.209891 Jul 14 10:13:27.349691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f9a0fbd7-50fa-418d-b180-99d971f184b1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:27.349884 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1368/2738] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:27 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:27.349982 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f9a0fbd7-50fa-418d-b180-99d971f184b1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:27.350106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-bc2ec3fa-f36d-4e95-9cd4-caca463784cd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:27.350106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-bc2ec3fa-f36d-4e95-9cd4-caca463784cd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:27.351268 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9a0fbd7-50fa-418d-b180-99d971f184b1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:27.351724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9a0fbd7-50fa-418d-b180-99d971f184b1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:27.352494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9a0fbd7-50fa-418d-b180-99d971f184b1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:27.352940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f9a0fbd7-50fa-418d-b180-99d971f184b1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:27.355598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc2ec3fa-f36d-4e95-9cd4-caca463784cd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:27.356042 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc2ec3fa-f36d-4e95-9cd4-caca463784cd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:27.356815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc2ec3fa-f36d-4e95-9cd4-caca463784cd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:27.357252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-bc2ec3fa-f36d-4e95-9cd4-caca463784cd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:27.439291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f9a0fbd7-50fa-418d-b180-99d971f184b1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:27.447354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f9a0fbd7-50fa-418d-b180-99d971f184b1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.107191 Jul 14 10:13:27.447985 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1371/2739] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:27 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:27.505695 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-bc2ec3fa-f36d-4e95-9cd4-caca463784cd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:27.513621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-bc2ec3fa-f36d-4e95-9cd4-caca463784cd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.168993 Jul 14 10:13:27.514182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1369/2740] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:27 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:28.355836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-afc435ad-e775-435b-b730-d36fecd8c225 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:28.356481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-afc435ad-e775-435b-b730-d36fecd8c225 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:28.360598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a229e567-58e5-41fb-9192-0d3217ce694c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:28.361578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a229e567-58e5-41fb-9192-0d3217ce694c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:28.363890 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-afc435ad-e775-435b-b730-d36fecd8c225 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:28.364341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-afc435ad-e775-435b-b730-d36fecd8c225 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:28.365112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-afc435ad-e775-435b-b730-d36fecd8c225 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:28.365549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-afc435ad-e775-435b-b730-d36fecd8c225 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:28.369176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a229e567-58e5-41fb-9192-0d3217ce694c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:28.369617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a229e567-58e5-41fb-9192-0d3217ce694c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:28.370414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a229e567-58e5-41fb-9192-0d3217ce694c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:28.370844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a229e567-58e5-41fb-9192-0d3217ce694c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:28.827409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-afc435ad-e775-435b-b730-d36fecd8c225 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:28.835253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a229e567-58e5-41fb-9192-0d3217ce694c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:28.835613 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-afc435ad-e775-435b-b730-d36fecd8c225 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.483619 Jul 14 10:13:28.836413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1372/2741] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:28 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:28.840756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-27a4a820-20f2-4e7d-89b0-8a9e28dddf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:28.841367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-27a4a820-20f2-4e7d-89b0-8a9e28dddf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:28.847902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27a4a820-20f2-4e7d-89b0-8a9e28dddf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:28.848696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27a4a820-20f2-4e7d-89b0-8a9e28dddf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:28.849129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27a4a820-20f2-4e7d-89b0-8a9e28dddf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:28.849568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27a4a820-20f2-4e7d-89b0-8a9e28dddf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:28.854215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a229e567-58e5-41fb-9192-0d3217ce694c tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.497765 Jul 14 10:13:28.855050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1370/2742] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:28 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:28.859921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dde8fc98-a42c-49bc-8314-a59b3ff77a8a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:28.861122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dde8fc98-a42c-49bc-8314-a59b3ff77a8a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:28.867598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dde8fc98-a42c-49bc-8314-a59b3ff77a8a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:28.868134 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dde8fc98-a42c-49bc-8314-a59b3ff77a8a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:28.869030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dde8fc98-a42c-49bc-8314-a59b3ff77a8a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:28.869532 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dde8fc98-a42c-49bc-8314-a59b3ff77a8a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:28.926921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-27a4a820-20f2-4e7d-89b0-8a9e28dddf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:28.934991 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-27a4a820-20f2-4e7d-89b0-8a9e28dddf7f tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.097790 Jul 14 10:13:28.935574 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1373/2743] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:28 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:29.020902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dde8fc98-a42c-49bc-8314-a59b3ff77a8a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:29.028808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dde8fc98-a42c-49bc-8314-a59b3ff77a8a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.172521 Jul 14 10:13:29.029377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1371/2744] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:28 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:29.852919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-446b47f3-f64d-4b1d-8bc7-038b0e27c84b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:29.853436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-446b47f3-f64d-4b1d-8bc7-038b0e27c84b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:29.860155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-446b47f3-f64d-4b1d-8bc7-038b0e27c84b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:29.860609 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-446b47f3-f64d-4b1d-8bc7-038b0e27c84b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:29.861372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-446b47f3-f64d-4b1d-8bc7-038b0e27c84b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:29.861809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-446b47f3-f64d-4b1d-8bc7-038b0e27c84b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:29.872276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4445f002-325d-46e9-9389-5a5a38884729 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:29.872879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4445f002-325d-46e9-9389-5a5a38884729 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:29.880086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4445f002-325d-46e9-9389-5a5a38884729 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:29.880635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4445f002-325d-46e9-9389-5a5a38884729 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:29.881580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4445f002-325d-46e9-9389-5a5a38884729 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:29.882035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4445f002-325d-46e9-9389-5a5a38884729 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:30.059251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-446b47f3-f64d-4b1d-8bc7-038b0e27c84b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:30.061524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:30.066472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4445f002-325d-46e9-9389-5a5a38884729 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:30.069761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-446b47f3-f64d-4b1d-8bc7-038b0e27c84b tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.220756 Jul 14 10:13:30.070389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1374/2745] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:29 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:30.074690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4445f002-325d-46e9-9389-5a5a38884729 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.206146 Jul 14 10:13:30.075442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1372/2746] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:29 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:30.078473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c4e2d5db-89b6-415f-abfd-465cb212d268 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:30.079241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c4e2d5db-89b6-415f-abfd-465cb212d268 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:30.080672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a4004088-38db-4e87-bba2-3f7a9c6b07e3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:30.081511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a4004088-38db-4e87-bba2-3f7a9c6b07e3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:30.086075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4e2d5db-89b6-415f-abfd-465cb212d268 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:30.086573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4e2d5db-89b6-415f-abfd-465cb212d268 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:30.087339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4e2d5db-89b6-415f-abfd-465cb212d268 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:30.087462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a4004088-38db-4e87-bba2-3f7a9c6b07e3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:30.087769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c4e2d5db-89b6-415f-abfd-465cb212d268 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:30.087992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a4004088-38db-4e87-bba2-3f7a9c6b07e3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:30.088823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a4004088-38db-4e87-bba2-3f7a9c6b07e3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:30.089431 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a4004088-38db-4e87-bba2-3f7a9c6b07e3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:30.173501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c4e2d5db-89b6-415f-abfd-465cb212d268 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:30.182101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c4e2d5db-89b6-415f-abfd-465cb212d268 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.110636 Jul 14 10:13:30.182955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1375/2747] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:30 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:30.240457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a4004088-38db-4e87-bba2-3f7a9c6b07e3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:30.248735 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a4004088-38db-4e87-bba2-3f7a9c6b07e3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.172419 Jul 14 10:13:30.249309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1373/2748] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:30 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:31.087921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-abe89996-f625-40c8-94ed-ec4dd7b307a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:31.088525 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-abe89996-f625-40c8-94ed-ec4dd7b307a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:31.095308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-abe89996-f625-40c8-94ed-ec4dd7b307a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:31.095757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-abe89996-f625-40c8-94ed-ec4dd7b307a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:31.096521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-abe89996-f625-40c8-94ed-ec4dd7b307a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:31.096764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d601bc71-e01e-4275-8773-f50d3747b573 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:31.097215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-abe89996-f625-40c8-94ed-ec4dd7b307a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:31.097401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d601bc71-e01e-4275-8773-f50d3747b573 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:31.103992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d601bc71-e01e-4275-8773-f50d3747b573 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:31.104442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d601bc71-e01e-4275-8773-f50d3747b573 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:31.105208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d601bc71-e01e-4275-8773-f50d3747b573 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:31.105644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d601bc71-e01e-4275-8773-f50d3747b573 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:31.291373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-abe89996-f625-40c8-94ed-ec4dd7b307a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:31.295393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d601bc71-e01e-4275-8773-f50d3747b573 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:31.299520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-abe89996-f625-40c8-94ed-ec4dd7b307a6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.215491 Jul 14 10:13:31.300098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1376/2749] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:31 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:31.304817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-15af2e2c-24ed-4de7-b122-c4504e292e00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:31.305421 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-15af2e2c-24ed-4de7-b122-c4504e292e00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:31.310874 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d601bc71-e01e-4275-8773-f50d3747b573 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.217860 Jul 14 10:13:31.311222 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15af2e2c-24ed-4de7-b122-c4504e292e00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:31.311464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1374/2750] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:31 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:31.311730 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15af2e2c-24ed-4de7-b122-c4504e292e00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:31.312412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15af2e2c-24ed-4de7-b122-c4504e292e00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:31.312992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15af2e2c-24ed-4de7-b122-c4504e292e00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:31.317831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-38950091-a947-46ed-a964-abe824f78944 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:31.318598 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-38950091-a947-46ed-a964-abe824f78944 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:31.324386 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38950091-a947-46ed-a964-abe824f78944 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:31.324826 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38950091-a947-46ed-a964-abe824f78944 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:31.325573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38950091-a947-46ed-a964-abe824f78944 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:31.325997 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38950091-a947-46ed-a964-abe824f78944 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:31.379519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-15af2e2c-24ed-4de7-b122-c4504e292e00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:31.387740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-15af2e2c-24ed-4de7-b122-c4504e292e00 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.086375 Jul 14 10:13:31.388310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1377/2751] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:31 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:31.475712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38950091-a947-46ed-a964-abe824f78944 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:31.483501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-38950091-a947-46ed-a964-abe824f78944 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.171124 Jul 14 10:13:31.484059 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1375/2752] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:31 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:32.317493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0e0846f4-d7ef-4a01-ba15-ab967974b95a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:32.318133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0e0846f4-d7ef-4a01-ba15-ab967974b95a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:32.324711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e0846f4-d7ef-4a01-ba15-ab967974b95a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:32.325156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e0846f4-d7ef-4a01-ba15-ab967974b95a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:32.325905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e0846f4-d7ef-4a01-ba15-ab967974b95a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:32.326361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0e0846f4-d7ef-4a01-ba15-ab967974b95a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:32.328968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3d2880f7-8c15-4d34-bfdf-a16f5efbbfae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:32.330208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3d2880f7-8c15-4d34-bfdf-a16f5efbbfae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:32.337243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d2880f7-8c15-4d34-bfdf-a16f5efbbfae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:32.337683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d2880f7-8c15-4d34-bfdf-a16f5efbbfae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:32.338473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d2880f7-8c15-4d34-bfdf-a16f5efbbfae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:32.338900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3d2880f7-8c15-4d34-bfdf-a16f5efbbfae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:32.519888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0e0846f4-d7ef-4a01-ba15-ab967974b95a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:32.526794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3d2880f7-8c15-4d34-bfdf-a16f5efbbfae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:32.529942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0e0846f4-d7ef-4a01-ba15-ab967974b95a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.216812 Jul 14 10:13:32.530882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1378/2753] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:32 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:32.535727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7ca7640e-6d1b-4adb-9f80-1e779bf9ab4c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:32.536541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7ca7640e-6d1b-4adb-9f80-1e779bf9ab4c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:32.538377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3d2880f7-8c15-4d34-bfdf-a16f5efbbfae tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.213727 Jul 14 10:13:32.548531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1376/2754] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:32 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:32.548775 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ca7640e-6d1b-4adb-9f80-1e779bf9ab4c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:32.548886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c02f0281-078d-4979-ae75-62c2a6660a69 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:32.548990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ca7640e-6d1b-4adb-9f80-1e779bf9ab4c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:32.549095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c02f0281-078d-4979-ae75-62c2a6660a69 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:32.549191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ca7640e-6d1b-4adb-9f80-1e779bf9ab4c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:32.549191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7ca7640e-6d1b-4adb-9f80-1e779bf9ab4c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:32.550487 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c02f0281-078d-4979-ae75-62c2a6660a69 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:32.551187 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c02f0281-078d-4979-ae75-62c2a6660a69 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:32.551945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c02f0281-078d-4979-ae75-62c2a6660a69 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:32.552377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c02f0281-078d-4979-ae75-62c2a6660a69 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:32.557407 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:32.615724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7ca7640e-6d1b-4adb-9f80-1e779bf9ab4c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:32.623636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7ca7640e-6d1b-4adb-9f80-1e779bf9ab4c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091480 Jul 14 10:13:32.624199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1379/2755] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:32 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:32.699909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c02f0281-078d-4979-ae75-62c2a6660a69 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:32.707784 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c02f0281-078d-4979-ae75-62c2a6660a69 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.167913 Jul 14 10:13:32.708340 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1377/2756] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:32 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:33.547638 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a7cfa924-93cc-40cf-a63c-ea99129422f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:33.548324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a7cfa924-93cc-40cf-a63c-ea99129422f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:33.555460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a7cfa924-93cc-40cf-a63c-ea99129422f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:33.555907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a7cfa924-93cc-40cf-a63c-ea99129422f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:33.556613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-97115630-bef9-4182-9e02-dfd6df5ecfb4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:33.557037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a7cfa924-93cc-40cf-a63c-ea99129422f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:33.557130 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a7cfa924-93cc-40cf-a63c-ea99129422f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:33.557236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-97115630-bef9-4182-9e02-dfd6df5ecfb4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:33.564834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97115630-bef9-4182-9e02-dfd6df5ecfb4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:33.565273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97115630-bef9-4182-9e02-dfd6df5ecfb4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:33.566038 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97115630-bef9-4182-9e02-dfd6df5ecfb4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:33.566493 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-97115630-bef9-4182-9e02-dfd6df5ecfb4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:33.749197 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a7cfa924-93cc-40cf-a63c-ea99129422f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:33.757077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-97115630-bef9-4182-9e02-dfd6df5ecfb4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:33.757748 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a7cfa924-93cc-40cf-a63c-ea99129422f7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.213991 Jul 14 10:13:33.758363 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1380/2757] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:33 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:33.762953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e71cd8e8-705a-44d7-8aad-bac83db458e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:33.763557 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e71cd8e8-705a-44d7-8aad-bac83db458e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:33.765751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-97115630-bef9-4182-9e02-dfd6df5ecfb4 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.213053 Jul 14 10:13:33.767457 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1378/2758] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:33 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:33.770066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e71cd8e8-705a-44d7-8aad-bac83db458e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:33.770610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e71cd8e8-705a-44d7-8aad-bac83db458e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:33.771381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e71cd8e8-705a-44d7-8aad-bac83db458e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:33.771819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e71cd8e8-705a-44d7-8aad-bac83db458e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:33.772425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-efdfd455-11be-4a72-9542-b33ec4c01f27 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:33.773090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-efdfd455-11be-4a72-9542-b33ec4c01f27 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:33.779310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efdfd455-11be-4a72-9542-b33ec4c01f27 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:33.779747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efdfd455-11be-4a72-9542-b33ec4c01f27 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:33.780497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efdfd455-11be-4a72-9542-b33ec4c01f27 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:33.780920 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efdfd455-11be-4a72-9542-b33ec4c01f27 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:33.859449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e71cd8e8-705a-44d7-8aad-bac83db458e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:33.868094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e71cd8e8-705a-44d7-8aad-bac83db458e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.108753 Jul 14 10:13:33.868660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1381/2759] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:33 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:33.926802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-efdfd455-11be-4a72-9542-b33ec4c01f27 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:33.934739 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-efdfd455-11be-4a72-9542-b33ec4c01f27 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.166238 Jul 14 10:13:33.935304 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1379/2760] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:33 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:34.785341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1d061ae3-d0e6-4ead-84c1-89bdc8a4c0b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:34.786819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1d061ae3-d0e6-4ead-84c1-89bdc8a4c0b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:34.787010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9faa50c8-b4d4-4209-9b7d-7baff36c47d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:34.787925 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9faa50c8-b4d4-4209-9b7d-7baff36c47d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:34.793249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1d061ae3-d0e6-4ead-84c1-89bdc8a4c0b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:34.793688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1d061ae3-d0e6-4ead-84c1-89bdc8a4c0b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:34.794579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1d061ae3-d0e6-4ead-84c1-89bdc8a4c0b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:34.795054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1d061ae3-d0e6-4ead-84c1-89bdc8a4c0b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:34.795289 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9faa50c8-b4d4-4209-9b7d-7baff36c47d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:34.795738 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9faa50c8-b4d4-4209-9b7d-7baff36c47d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:34.796497 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9faa50c8-b4d4-4209-9b7d-7baff36c47d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:34.796921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9faa50c8-b4d4-4209-9b7d-7baff36c47d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:34.999766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9faa50c8-b4d4-4209-9b7d-7baff36c47d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:35.003481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1d061ae3-d0e6-4ead-84c1-89bdc8a4c0b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:35.008307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9faa50c8-b4d4-4209-9b7d-7baff36c47d8 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.226130 Jul 14 10:13:35.008958 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1380/2761] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:34 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:35.011685 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1d061ae3-d0e6-4ead-84c1-89bdc8a4c0b3 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.230559 Jul 14 10:13:35.012440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1382/2762] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:34 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:35.013870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f842ae7f-9e9d-41de-84df-821a614f34c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:35.014592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f842ae7f-9e9d-41de-84df-821a614f34c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:35.019176 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9cb1b555-af85-4544-9b47-8af62a66cc5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:35.020074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9cb1b555-af85-4544-9b47-8af62a66cc5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:35.021702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f842ae7f-9e9d-41de-84df-821a614f34c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:35.022238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f842ae7f-9e9d-41de-84df-821a614f34c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:35.023077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f842ae7f-9e9d-41de-84df-821a614f34c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:35.023576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f842ae7f-9e9d-41de-84df-821a614f34c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:35.026126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cb1b555-af85-4544-9b47-8af62a66cc5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:35.026620 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cb1b555-af85-4544-9b47-8af62a66cc5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:35.027387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cb1b555-af85-4544-9b47-8af62a66cc5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:35.027831 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cb1b555-af85-4544-9b47-8af62a66cc5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:35.093993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f842ae7f-9e9d-41de-84df-821a614f34c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:35.102872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f842ae7f-9e9d-41de-84df-821a614f34c7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.092474 Jul 14 10:13:35.103901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1381/2763] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:35 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:35.177616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9cb1b555-af85-4544-9b47-8af62a66cc5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:35.185670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9cb1b555-af85-4544-9b47-8af62a66cc5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.172046 Jul 14 10:13:35.186245 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1383/2764] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:35 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:36.026734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-04f49164-09e6-4980-af0f-d7c6a4688510 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:36.027329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-04f49164-09e6-4980-af0f-d7c6a4688510 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:36.029143 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-38206c17-3c58-45d6-9d0d-898ff31fb296 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:36.029759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-38206c17-3c58-45d6-9d0d-898ff31fb296 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:36.034699 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04f49164-09e6-4980-af0f-d7c6a4688510 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:36.035147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04f49164-09e6-4980-af0f-d7c6a4688510 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:36.035911 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04f49164-09e6-4980-af0f-d7c6a4688510 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:36.036344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04f49164-09e6-4980-af0f-d7c6a4688510 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:36.036971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38206c17-3c58-45d6-9d0d-898ff31fb296 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:36.037422 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38206c17-3c58-45d6-9d0d-898ff31fb296 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:36.038216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38206c17-3c58-45d6-9d0d-898ff31fb296 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:36.038811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-38206c17-3c58-45d6-9d0d-898ff31fb296 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:36.058771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:13:36.059060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:13:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 (ip 10.222.0.40) !!! Jul 14 10:13:36.232554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-38206c17-3c58-45d6-9d0d-898ff31fb296 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:36.235836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-04f49164-09e6-4980-af0f-d7c6a4688510 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:36.241092 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-38206c17-3c58-45d6-9d0d-898ff31fb296 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.215693 Jul 14 10:13:36.241671 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1384/2765] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:36 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:36.243650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-04f49164-09e6-4980-af0f-d7c6a4688510 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.221106 Jul 14 10:13:36.244376 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1382/2766] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:36 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:36.248639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a10b5c89-8a0f-42ae-9209-8db0a4095262 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:36.249235 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a10b5c89-8a0f-42ae-9209-8db0a4095262 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:36.254352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ea8298e7-2fe1-4181-8f93-a66f84c211ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:36.254966 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ea8298e7-2fe1-4181-8f93-a66f84c211ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:36.255797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a10b5c89-8a0f-42ae-9209-8db0a4095262 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:36.256142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a10b5c89-8a0f-42ae-9209-8db0a4095262 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:36.256910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a10b5c89-8a0f-42ae-9209-8db0a4095262 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:36.257344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a10b5c89-8a0f-42ae-9209-8db0a4095262 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:36.261033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea8298e7-2fe1-4181-8f93-a66f84c211ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:36.261488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea8298e7-2fe1-4181-8f93-a66f84c211ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:36.262272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea8298e7-2fe1-4181-8f93-a66f84c211ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:36.262712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea8298e7-2fe1-4181-8f93-a66f84c211ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:36.350020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ea8298e7-2fe1-4181-8f93-a66f84c211ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:36.358036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ea8298e7-2fe1-4181-8f93-a66f84c211ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.115357 Jul 14 10:13:36.358636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1385/2767] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:36 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:36.412754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a10b5c89-8a0f-42ae-9209-8db0a4095262 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:36.420724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a10b5c89-8a0f-42ae-9209-8db0a4095262 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.175596 Jul 14 10:13:36.421278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1383/2768] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:36 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:37.258776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-81056f76-0b00-4d33-8f19-3dbaf7233dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:37.259371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-81056f76-0b00-4d33-8f19-3dbaf7233dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:37.260447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ba5ab4e2-2281-4a46-84bb-22f7e302ac0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:37.261058 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ba5ab4e2-2281-4a46-84bb-22f7e302ac0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:37.265635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81056f76-0b00-4d33-8f19-3dbaf7233dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:37.266076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81056f76-0b00-4d33-8f19-3dbaf7233dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:37.267125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81056f76-0b00-4d33-8f19-3dbaf7233dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:37.267565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81056f76-0b00-4d33-8f19-3dbaf7233dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:37.267690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba5ab4e2-2281-4a46-84bb-22f7e302ac0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:37.268169 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba5ab4e2-2281-4a46-84bb-22f7e302ac0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:37.268928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba5ab4e2-2281-4a46-84bb-22f7e302ac0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:37.269360 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ba5ab4e2-2281-4a46-84bb-22f7e302ac0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:37.462590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-81056f76-0b00-4d33-8f19-3dbaf7233dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:37.471367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-81056f76-0b00-4d33-8f19-3dbaf7233dc1 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.216413 Jul 14 10:13:37.471943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1386/2769] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:37 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:37.474122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ba5ab4e2-2281-4a46-84bb-22f7e302ac0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:37.476388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ba0335b7-2cc1-41e4-bef2-9dc500e752da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:37.477219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ba0335b7-2cc1-41e4-bef2-9dc500e752da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:37.482766 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ba5ab4e2-2281-4a46-84bb-22f7e302ac0d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.226090 Jul 14 10:13:37.483379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba0335b7-2cc1-41e4-bef2-9dc500e752da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:37.483507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1384/2770] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:37 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:37.483825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba0335b7-2cc1-41e4-bef2-9dc500e752da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:37.484619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba0335b7-2cc1-41e4-bef2-9dc500e752da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:37.485062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ba0335b7-2cc1-41e4-bef2-9dc500e752da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:37.489447 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3666804d-d3d9-4c68-81e9-3040e815372d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:37.490063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3666804d-d3d9-4c68-81e9-3040e815372d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:37.495964 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3666804d-d3d9-4c68-81e9-3040e815372d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:37.496413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3666804d-d3d9-4c68-81e9-3040e815372d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:37.497176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3666804d-d3d9-4c68-81e9-3040e815372d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:37.497612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3666804d-d3d9-4c68-81e9-3040e815372d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:37.560170 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ba0335b7-2cc1-41e4-bef2-9dc500e752da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:37.568617 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ba0335b7-2cc1-41e4-bef2-9dc500e752da tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.095618 Jul 14 10:13:37.569221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1387/2771] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:37 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:37.654917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3666804d-d3d9-4c68-81e9-3040e815372d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:37.663619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3666804d-d3d9-4c68-81e9-3040e815372d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.179185 Jul 14 10:13:37.664176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1385/2772] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:37 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:38.488724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d5ab6951-8c53-462f-913c-62b3d16aa058 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:38.489467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d5ab6951-8c53-462f-913c-62b3d16aa058 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:38.496184 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5ab6951-8c53-462f-913c-62b3d16aa058 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:38.496636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5ab6951-8c53-462f-913c-62b3d16aa058 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:38.497402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5ab6951-8c53-462f-913c-62b3d16aa058 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:38.497841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d5ab6951-8c53-462f-913c-62b3d16aa058 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:38.500780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d1d9c6fc-8771-4660-8dfd-c3b72c08936a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:38.501382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d1d9c6fc-8771-4660-8dfd-c3b72c08936a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:38.507697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1d9c6fc-8771-4660-8dfd-c3b72c08936a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:38.508135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1d9c6fc-8771-4660-8dfd-c3b72c08936a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:38.508891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1d9c6fc-8771-4660-8dfd-c3b72c08936a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:38.509316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1d9c6fc-8771-4660-8dfd-c3b72c08936a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:38.697266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d5ab6951-8c53-462f-913c-62b3d16aa058 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:38.700471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d1d9c6fc-8771-4660-8dfd-c3b72c08936a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:38.706584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d5ab6951-8c53-462f-913c-62b3d16aa058 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.221689 Jul 14 10:13:38.707161 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1388/2773] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:38 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:38.709133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d1d9c6fc-8771-4660-8dfd-c3b72c08936a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.212205 Jul 14 10:13:38.709819 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1386/2774] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:38 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:38.717426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9698d5e4-075e-4270-b6e8-747617fb234d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:38.717426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9698d5e4-075e-4270-b6e8-747617fb234d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:38.717730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-270c5fb9-bf0d-42b1-a243-79ad83e4802d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:38.717730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-270c5fb9-bf0d-42b1-a243-79ad83e4802d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:38.718571 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9698d5e4-075e-4270-b6e8-747617fb234d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:38.719150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9698d5e4-075e-4270-b6e8-747617fb234d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:38.720491 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9698d5e4-075e-4270-b6e8-747617fb234d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:38.720923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9698d5e4-075e-4270-b6e8-747617fb234d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:38.721672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-270c5fb9-bf0d-42b1-a243-79ad83e4802d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:38.722119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-270c5fb9-bf0d-42b1-a243-79ad83e4802d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:38.722918 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-270c5fb9-bf0d-42b1-a243-79ad83e4802d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:38.723355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-270c5fb9-bf0d-42b1-a243-79ad83e4802d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:38.793631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9698d5e4-075e-4270-b6e8-747617fb234d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:38.802544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9698d5e4-075e-4270-b6e8-747617fb234d tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.094394 Jul 14 10:13:38.803111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1389/2775] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:38 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:38.876865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-270c5fb9-bf0d-42b1-a243-79ad83e4802d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:38.885030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-270c5fb9-bf0d-42b1-a243-79ad83e4802d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.174365 Jul 14 10:13:38.885601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1387/2776] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:38 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:39.724994 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0d56086d-e02b-40b3-92b8-772c69db5863 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:39.725615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0d56086d-e02b-40b3-92b8-772c69db5863 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:39.728464 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2151948f-951d-4f62-97af-f408cf9418ed tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:39.729078 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2151948f-951d-4f62-97af-f408cf9418ed tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:39.732780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d56086d-e02b-40b3-92b8-772c69db5863 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:39.733224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d56086d-e02b-40b3-92b8-772c69db5863 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:39.733980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d56086d-e02b-40b3-92b8-772c69db5863 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:39.734637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0d56086d-e02b-40b3-92b8-772c69db5863 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:39.736467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2151948f-951d-4f62-97af-f408cf9418ed tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:39.736912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2151948f-951d-4f62-97af-f408cf9418ed tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:39.737681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2151948f-951d-4f62-97af-f408cf9418ed tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:39.738111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2151948f-951d-4f62-97af-f408cf9418ed tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:39.929897 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0d56086d-e02b-40b3-92b8-772c69db5863 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:39.936520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2151948f-951d-4f62-97af-f408cf9418ed tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:39.938359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0d56086d-e02b-40b3-92b8-772c69db5863 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.217391 Jul 14 10:13:39.940495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1390/2777] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:39 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:39.945392 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3fe0c5e9-901b-4a72-9ee4-fa73dc331b55 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:39.945875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2151948f-951d-4f62-97af-f408cf9418ed tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.220913 Jul 14 10:13:39.946042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3fe0c5e9-901b-4a72-9ee4-fa73dc331b55 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:39.946556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1388/2778] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:39 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:39.953370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3fe0c5e9-901b-4a72-9ee4-fa73dc331b55 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:39.953824 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3fe0c5e9-901b-4a72-9ee4-fa73dc331b55 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:39.954657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3fe0c5e9-901b-4a72-9ee4-fa73dc331b55 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:39.955101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3fe0c5e9-901b-4a72-9ee4-fa73dc331b55 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:39.955643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d95dcf9d-4602-456d-91bf-9aa3b2cbda17 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:39.956224 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d95dcf9d-4602-456d-91bf-9aa3b2cbda17 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:39.962082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d95dcf9d-4602-456d-91bf-9aa3b2cbda17 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:39.962667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d95dcf9d-4602-456d-91bf-9aa3b2cbda17 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:39.963425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d95dcf9d-4602-456d-91bf-9aa3b2cbda17 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:39.963857 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d95dcf9d-4602-456d-91bf-9aa3b2cbda17 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:39.970230 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:40.025375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3fe0c5e9-901b-4a72-9ee4-fa73dc331b55 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:40.033565 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3fe0c5e9-901b-4a72-9ee4-fa73dc331b55 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.091866 Jul 14 10:13:40.034144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1391/2779] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:39 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:40.109795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d95dcf9d-4602-456d-91bf-9aa3b2cbda17 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:40.118242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d95dcf9d-4602-456d-91bf-9aa3b2cbda17 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.168123 Jul 14 10:13:40.118815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1389/2780] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:39 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:40.957832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e156b970-50de-41b1-bf56-756ee0561280 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:40.958474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e156b970-50de-41b1-bf56-756ee0561280 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:40.962634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-09fd3e08-8825-41d0-beff-08538259a9ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:40.963245 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-09fd3e08-8825-41d0-beff-08538259a9ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:40.964721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e156b970-50de-41b1-bf56-756ee0561280 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:40.965172 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e156b970-50de-41b1-bf56-756ee0561280 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:40.965926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e156b970-50de-41b1-bf56-756ee0561280 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:40.966391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e156b970-50de-41b1-bf56-756ee0561280 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:40.969679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09fd3e08-8825-41d0-beff-08538259a9ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:40.970832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09fd3e08-8825-41d0-beff-08538259a9ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:40.971593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09fd3e08-8825-41d0-beff-08538259a9ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:40.972029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-09fd3e08-8825-41d0-beff-08538259a9ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:41.164894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e156b970-50de-41b1-bf56-756ee0561280 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:41.167939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-09fd3e08-8825-41d0-beff-08538259a9ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:41.173023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e156b970-50de-41b1-bf56-756ee0561280 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.219583 Jul 14 10:13:41.173711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1392/2781] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:40 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:41.176201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-09fd3e08-8825-41d0-beff-08538259a9ae tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.217008 Jul 14 10:13:41.185612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1390/2782] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:40 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:41.185839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-84bcd19a-8a61-4717-a19f-a5d697e123d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:41.185839 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-84bcd19a-8a61-4717-a19f-a5d697e123d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:41.186049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-72ad32d9-5bdc-4017-afb7-afd203891d4a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:41.186049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-72ad32d9-5bdc-4017-afb7-afd203891d4a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:41.186344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84bcd19a-8a61-4717-a19f-a5d697e123d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:41.186344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84bcd19a-8a61-4717-a19f-a5d697e123d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:41.186623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84bcd19a-8a61-4717-a19f-a5d697e123d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:41.187126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-84bcd19a-8a61-4717-a19f-a5d697e123d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:41.187604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72ad32d9-5bdc-4017-afb7-afd203891d4a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:41.188039 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72ad32d9-5bdc-4017-afb7-afd203891d4a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:41.189303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72ad32d9-5bdc-4017-afb7-afd203891d4a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:41.189736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-72ad32d9-5bdc-4017-afb7-afd203891d4a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:41.260507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-84bcd19a-8a61-4717-a19f-a5d697e123d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:41.269127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-84bcd19a-8a61-4717-a19f-a5d697e123d9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.094404 Jul 14 10:13:41.269692 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1393/2783] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:41 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:41.344206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-72ad32d9-5bdc-4017-afb7-afd203891d4a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:41.352318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-72ad32d9-5bdc-4017-afb7-afd203891d4a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.174556 Jul 14 10:13:41.352899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1391/2784] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:41 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:42.190881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1cf5c44f-95ff-4682-8dae-4cff23a2d311 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:42.191584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1cf5c44f-95ff-4682-8dae-4cff23a2d311 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:42.193182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-0dc4f641-ad7d-44c1-9a0a-33e938c74bd3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:42.193797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-0dc4f641-ad7d-44c1-9a0a-33e938c74bd3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:42.198381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1cf5c44f-95ff-4682-8dae-4cff23a2d311 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:42.198832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1cf5c44f-95ff-4682-8dae-4cff23a2d311 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:42.199635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1cf5c44f-95ff-4682-8dae-4cff23a2d311 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:42.200064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1cf5c44f-95ff-4682-8dae-4cff23a2d311 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:42.201120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0dc4f641-ad7d-44c1-9a0a-33e938c74bd3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:42.201574 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0dc4f641-ad7d-44c1-9a0a-33e938c74bd3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:42.202356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0dc4f641-ad7d-44c1-9a0a-33e938c74bd3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:42.202789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-0dc4f641-ad7d-44c1-9a0a-33e938c74bd3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:42.393481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1cf5c44f-95ff-4682-8dae-4cff23a2d311 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:42.397647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-0dc4f641-ad7d-44c1-9a0a-33e938c74bd3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:42.401652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1cf5c44f-95ff-4682-8dae-4cff23a2d311 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.214751 Jul 14 10:13:42.402243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1394/2785] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:42 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:42.405775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-0dc4f641-ad7d-44c1-9a0a-33e938c74bd3 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.216974 Jul 14 10:13:42.407051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1392/2786] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:42 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:42.407196 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-860cad79-e856-4114-b7e3-a9376eb4c48c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:42.411875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f3ecbadd-948b-4e86-8df4-7d138ee1a0f2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:42.412533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f3ecbadd-948b-4e86-8df4-7d138ee1a0f2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:42.414278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:42.414896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-860cad79-e856-4114-b7e3-a9376eb4c48c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:42.419498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3ecbadd-948b-4e86-8df4-7d138ee1a0f2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:42.419940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3ecbadd-948b-4e86-8df4-7d138ee1a0f2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:42.420701 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3ecbadd-948b-4e86-8df4-7d138ee1a0f2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:42.420983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-860cad79-e856-4114-b7e3-a9376eb4c48c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:42.421445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-860cad79-e856-4114-b7e3-a9376eb4c48c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:42.421592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f3ecbadd-948b-4e86-8df4-7d138ee1a0f2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:42.422266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-860cad79-e856-4114-b7e3-a9376eb4c48c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:42.422704 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-860cad79-e856-4114-b7e3-a9376eb4c48c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:42.492337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-860cad79-e856-4114-b7e3-a9376eb4c48c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:42.500177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-860cad79-e856-4114-b7e3-a9376eb4c48c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.096978 Jul 14 10:13:42.500899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1395/2787] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:42 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:42.575127 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f3ecbadd-948b-4e86-8df4-7d138ee1a0f2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:42.577260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:42.585253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f3ecbadd-948b-4e86-8df4-7d138ee1a0f2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.177798 Jul 14 10:13:42.585838 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1393/2788] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:42 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:43.419873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6761ff97-8eb0-4902-8bfd-d4c3ccd3c054 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:43.420484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6761ff97-8eb0-4902-8bfd-d4c3ccd3c054 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:43.424595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-83caf4df-4493-441a-82f7-ba5fe323bf3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:43.425192 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-83caf4df-4493-441a-82f7-ba5fe323bf3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:43.428050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6761ff97-8eb0-4902-8bfd-d4c3ccd3c054 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:43.428502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6761ff97-8eb0-4902-8bfd-d4c3ccd3c054 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:43.429271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6761ff97-8eb0-4902-8bfd-d4c3ccd3c054 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:43.429703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6761ff97-8eb0-4902-8bfd-d4c3ccd3c054 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:43.431936 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83caf4df-4493-441a-82f7-ba5fe323bf3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:43.432377 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83caf4df-4493-441a-82f7-ba5fe323bf3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:43.433123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83caf4df-4493-441a-82f7-ba5fe323bf3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:43.434945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-83caf4df-4493-441a-82f7-ba5fe323bf3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:43.626922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6761ff97-8eb0-4902-8bfd-d4c3ccd3c054 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:43.630797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-83caf4df-4493-441a-82f7-ba5fe323bf3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:43.635154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6761ff97-8eb0-4902-8bfd-d4c3ccd3c054 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.219894 Jul 14 10:13:43.635732 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1396/2789] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:43 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:43.639216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-83caf4df-4493-441a-82f7-ba5fe323bf3d tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.219001 Jul 14 10:13:43.639984 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1394/2790] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:43 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:43.640218 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-362fa633-7ce1-4f49-9f1b-a48b095c40ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:43.640823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-362fa633-7ce1-4f49-9f1b-a48b095c40ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:43.647135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-88c74220-ccea-4ed9-99f7-66dc93b8fb87 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:43.647135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-88c74220-ccea-4ed9-99f7-66dc93b8fb87 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:43.647420 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-362fa633-7ce1-4f49-9f1b-a48b095c40ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:43.647668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-362fa633-7ce1-4f49-9f1b-a48b095c40ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:43.648398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-362fa633-7ce1-4f49-9f1b-a48b095c40ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:43.648833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-362fa633-7ce1-4f49-9f1b-a48b095c40ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:43.651538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88c74220-ccea-4ed9-99f7-66dc93b8fb87 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:43.651986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88c74220-ccea-4ed9-99f7-66dc93b8fb87 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:43.652746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88c74220-ccea-4ed9-99f7-66dc93b8fb87 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:43.653254 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-88c74220-ccea-4ed9-99f7-66dc93b8fb87 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:43.722971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-362fa633-7ce1-4f49-9f1b-a48b095c40ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:43.731296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-362fa633-7ce1-4f49-9f1b-a48b095c40ff tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.094607 Jul 14 10:13:43.731882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1397/2791] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:43 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:43.806734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-88c74220-ccea-4ed9-99f7-66dc93b8fb87 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:43.815226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-88c74220-ccea-4ed9-99f7-66dc93b8fb87 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.174450 Jul 14 10:13:43.815794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1395/2792] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:43 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:44.654035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3e2027bd-040f-4f64-af70-f7bf890508b5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:44.654695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3e2027bd-040f-4f64-af70-f7bf890508b5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:44.655829 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-68e46fe0-7a0b-44e4-b7c7-7c6bc323dea7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:44.656437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-68e46fe0-7a0b-44e4-b7c7-7c6bc323dea7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:44.661937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3e2027bd-040f-4f64-af70-f7bf890508b5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:44.662418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3e2027bd-040f-4f64-af70-f7bf890508b5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:44.663179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3e2027bd-040f-4f64-af70-f7bf890508b5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:44.663613 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68e46fe0-7a0b-44e4-b7c7-7c6bc323dea7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:44.663757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3e2027bd-040f-4f64-af70-f7bf890508b5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:44.664064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68e46fe0-7a0b-44e4-b7c7-7c6bc323dea7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:44.664821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68e46fe0-7a0b-44e4-b7c7-7c6bc323dea7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:44.665250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-68e46fe0-7a0b-44e4-b7c7-7c6bc323dea7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:44.858943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3e2027bd-040f-4f64-af70-f7bf890508b5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:44.863347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-68e46fe0-7a0b-44e4-b7c7-7c6bc323dea7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:44.867020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3e2027bd-040f-4f64-af70-f7bf890508b5 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.217027 Jul 14 10:13:44.867589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1398/2793] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:44 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:44.871803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-68e46fe0-7a0b-44e4-b7c7-7c6bc323dea7 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.219735 Jul 14 10:13:44.872156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-97d8916b-7a0e-473c-8187-733693bb19d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:44.877780 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-97d8916b-7a0e-473c-8187-733693bb19d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:44.877945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1396/2794] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:44 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:44.877945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d5313b66-6ac6-4ec1-8b32-3d2661f491d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:44.878560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d5313b66-6ac6-4ec1-8b32-3d2661f491d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:44.879413 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97d8916b-7a0e-473c-8187-733693bb19d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:44.879899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97d8916b-7a0e-473c-8187-733693bb19d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:44.880664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97d8916b-7a0e-473c-8187-733693bb19d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:44.881102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-97d8916b-7a0e-473c-8187-733693bb19d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:44.884961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5313b66-6ac6-4ec1-8b32-3d2661f491d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:44.885476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5313b66-6ac6-4ec1-8b32-3d2661f491d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:44.886334 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5313b66-6ac6-4ec1-8b32-3d2661f491d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:44.886767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d5313b66-6ac6-4ec1-8b32-3d2661f491d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:44.967615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-97d8916b-7a0e-473c-8187-733693bb19d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:44.976107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-97d8916b-7a0e-473c-8187-733693bb19d3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1369 microversion: 2.1 time: 0.107495 Jul 14 10:13:44.976885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1399/2795] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:44 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:45.045007 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d5313b66-6ac6-4ec1-8b32-3d2661f491d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:45.056398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d5313b66-6ac6-4ec1-8b32-3d2661f491d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.182521 Jul 14 10:13:45.067580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1397/2796] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:44 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:45.885076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6a20681d-6508-41b7-9f04-560ed521ab6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:45.885694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6a20681d-6508-41b7-9f04-560ed521ab6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:45.888749 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f4b49deb-c7ca-4edf-9df3-7bf783666b7c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:45.889357 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f4b49deb-c7ca-4edf-9df3-7bf783666b7c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:45.892266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a20681d-6508-41b7-9f04-560ed521ab6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:45.892723 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a20681d-6508-41b7-9f04-560ed521ab6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:45.893573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a20681d-6508-41b7-9f04-560ed521ab6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:45.893995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6a20681d-6508-41b7-9f04-560ed521ab6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:45.897155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4b49deb-c7ca-4edf-9df3-7bf783666b7c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:45.897595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4b49deb-c7ca-4edf-9df3-7bf783666b7c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:45.898392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4b49deb-c7ca-4edf-9df3-7bf783666b7c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:45.898820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f4b49deb-c7ca-4edf-9df3-7bf783666b7c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:46.084388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6a20681d-6508-41b7-9f04-560ed521ab6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:46.092354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6a20681d-6508-41b7-9f04-560ed521ab6a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1601 microversion: 2.1 time: 0.211077 Jul 14 10:13:46.092923 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1400/2797] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:45 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1601 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:46.102006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f4b49deb-c7ca-4edf-9df3-7bf783666b7c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:46.102226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:46.102226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:46.103770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f4b49deb-c7ca-4edf-9df3-7bf783666b7c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.218874 Jul 14 10:13:46.104415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1398/2798] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:45 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:46.104530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:46.105656 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:46.106641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:46.107255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:46.109247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e2781ad8-22e0-47bf-9551-fd42d1bfb9d6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:46.109935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e2781ad8-22e0-47bf-9551-fd42d1bfb9d6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:46.116422 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e2781ad8-22e0-47bf-9551-fd42d1bfb9d6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:46.116872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e2781ad8-22e0-47bf-9551-fd42d1bfb9d6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:46.117636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e2781ad8-22e0-47bf-9551-fd42d1bfb9d6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:46.118073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e2781ad8-22e0-47bf-9551-fd42d1bfb9d6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:46.140815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:46.141266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:46.141778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lazy-loading 'fault' on Instance uuid 99819874-5159-49fd-81c9-78998c928020 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:13:46.222140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:46.231546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9d0672da-73ab-4d3c-b800-77f95659a6ac tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 200 len: 1463 microversion: 2.1 time: 0.137448 Jul 14 10:13:46.232102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1401/2799] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:46 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:46.300000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e2781ad8-22e0-47bf-9551-fd42d1bfb9d6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:46.308354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e2781ad8-22e0-47bf-9551-fd42d1bfb9d6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.202832 Jul 14 10:13:46.308924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1399/2800] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:46 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:47.109507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-747dac0e-75e0-46e0-a1a1-d73f3e27b43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.110124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-747dac0e-75e0-46e0-a1a1-d73f3e27b43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:47.116814 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-747dac0e-75e0-46e0-a1a1-d73f3e27b43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.117266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-747dac0e-75e0-46e0-a1a1-d73f3e27b43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.118030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-747dac0e-75e0-46e0-a1a1-d73f3e27b43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.118504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-747dac0e-75e0-46e0-a1a1-d73f3e27b43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.120690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fdbb7dab-4b1d-4dc3-a421-ae178cf60aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.121299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fdbb7dab-4b1d-4dc3-a421-ae178cf60aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:47.128213 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fdbb7dab-4b1d-4dc3-a421-ae178cf60aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.128657 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fdbb7dab-4b1d-4dc3-a421-ae178cf60aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.129414 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fdbb7dab-4b1d-4dc3-a421-ae178cf60aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.129842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fdbb7dab-4b1d-4dc3-a421-ae178cf60aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.312154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-747dac0e-75e0-46e0-a1a1-d73f3e27b43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:47.315531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fdbb7dab-4b1d-4dc3-a421-ae178cf60aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:47.320429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-747dac0e-75e0-46e0-a1a1-d73f3e27b43f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1555 microversion: 2.1 time: 0.214755 Jul 14 10:13:47.321010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1402/2801] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:47 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:47.323886 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fdbb7dab-4b1d-4dc3-a421-ae178cf60aa9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.206998 Jul 14 10:13:47.324515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1400/2802] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:47 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:47.325440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.326258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:47.329056 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e8745861-4520-47fc-95a7-c9c4c3a49468 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.330460 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e8745861-4520-47fc-95a7-c9c4c3a49468 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:47.333137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.333588 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.334583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.335026 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.337243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8745861-4520-47fc-95a7-c9c4c3a49468 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.337689 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8745861-4520-47fc-95a7-c9c4c3a49468 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.338483 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8745861-4520-47fc-95a7-c9c4c3a49468 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.339005 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e8745861-4520-47fc-95a7-c9c4c3a49468 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.348728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] HTTP exception thrown: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Request method failure captured: Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 HTTP/1.1 Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P16GWuyqSuDY7ApG-mgPPjgP297ucssya2XQUHbHO5L48ShM0tgM_aa0glxfTBBjpaxdxtloMLxfF9ycWwy4hBXtqiaxqMivpiQuCnYWNA-8pppTmSpHjuzgPpbhbjjkbA1yYjMHMJMfNvrjc7x-vci7kZ-DMDlMd3nmq_wcriVwU Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:13:47.350378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 688f473972144fb6b7a398c1f775a5c1 Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:13:47.352210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '99819874-5159-49fd-81c9-78998c928020'} Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:47.353274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:13:47.355132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.356633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Returning 404 to user: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:47.356633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-72c31183-027b-492f-a0f5-c384cee3ef21 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 404 len: 111 microversion: 2.1 time: 0.030944 Jul 14 10:13:47.356633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1403/2803] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:47 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:13:47.362769 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-89381c9f-8d98-4d2a-8cb7-8a08464ecf93 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '.version_select at 0x7f7da63d33a0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.387312 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-89381c9f-8d98-4d2a-8cb7-8a08464ecf93 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244140682" status: 202 len: 0 microversion: 2.1 time: 0.028722 Jul 14 10:13:47.388728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1404/2804] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jul 14 10:13:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244140682 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 10:13:47.472380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e8745861-4520-47fc-95a7-c9c4c3a49468 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:47.480713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e8745861-4520-47fc-95a7-c9c4c3a49468 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1729 microversion: 2.1 time: 0.154929 Jul 14 10:13:47.481342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1401/2805] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:47 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:47.523672 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.524298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:47.530606 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.531153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.532264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.532952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.554733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] HTTP exception thrown: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Request method failure captured: Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f HTTP/1.1 Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5wZKDg4aGJEw2vYv6cXSHrRsNTEK6aBFxZpUthC5Hm2uGIW-p0tW-oTs2B6M1VV8UkhjIwCegMji1mncxw9X-fC2pNUwGaAeelP6Md_nJJrPHjbP0k6TdVQYTBiGiJWlIJaVcU_SkF4QhPc3EPFqpEe0cXazGpInOCCmbCqctQhs Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:13:47.556713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f50c3855aa764c2fb86c48c90eb9e15c Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.559965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': 'a00a0737-b755-4d07-a5a1-8b691911836f'} Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:47.561028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.564276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.570661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Returning 404 to user: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:47.570661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cff19dfd-96f5-4627-a7db-1b8edf173df8 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 404 len: 111 microversion: 2.20 time: 0.045588 Jul 14 10:13:47.570661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1405/2806] 10.222.0.40 () {60 vars in 1279 bytes} [Thu Jul 14 10:13:47 2022] DELETE /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:13:47.574921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.575527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] [instance: a00a0737-b755-4d07-a5a1-8b691911836f] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:47.582212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.582779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.583390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.583821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.593469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-036c1f6c-a0ea-4939-b8d4-be9967f87cb9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.593984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-036c1f6c-a0ea-4939-b8d4-be9967f87cb9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:47.600731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-036c1f6c-a0ea-4939-b8d4-be9967f87cb9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.601182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-036c1f6c-a0ea-4939-b8d4-be9967f87cb9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.601322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] HTTP exception thrown: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.601957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-036c1f6c-a0ea-4939-b8d4-be9967f87cb9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.602424 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-036c1f6c-a0ea-4939-b8d4-be9967f87cb9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Request method failure captured: Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f HTTP/1.1 Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5wZKDg4aGJEw2vYv6cXSHrRsNTEK6aBFxZpUthC5Hm2uGIW-p0tW-oTs2B6M1VV8UkhjIwCegMji1mncxw9X-fC2pNUwGaAeelP6Md_nJJrPHjbP0k6TdVQYTBiGiJWlIJaVcU_SkF4QhPc3EPFqpEe0cXazGpInOCCmbCqctQhs Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:13:47.603247 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_e4d87102c8234c7f9ba0c1a6299ba3d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: e4d87102c8234c7f9ba0c1a6299ba3d7 Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1044274265 Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f50c3855aa764c2fb86c48c90eb9e15c Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1044274265-project Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.605135 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'a00a0737-b755-4d07-a5a1-8b691911836f'} Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:47.606125 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. Jul 14 10:13:47.607980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:13:47.609569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] Returning 404 to user: Instance a00a0737-b755-4d07-a5a1-8b691911836f could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:47.609569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eaf8457a-f8d1-435e-9fee-a1a570c83ac6 tempest-AttachVolumeShelveTestJSON-1044274265 tempest-AttachVolumeShelveTestJSON-1044274265-project] 10.222.0.40 "GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f" status: 404 len: 111 microversion: 2.20 time: 0.037317 Jul 14 10:13:47.611351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1402/2807] 10.222.0.40 () {60 vars in 1276 bytes} [Thu Jul 14 10:13:47 2022] GET /compute/v2.1/servers/a00a0737-b755-4d07-a5a1-8b691911836f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:13:47.637990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-036c1f6c-a0ea-4939-b8d4-be9967f87cb9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:13:47.725641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-036c1f6c-a0ea-4939-b8d4-be9967f87cb9 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "DELETE /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 204 len: 0 microversion: 2.1 time: 0.139343 Jul 14 10:13:47.729601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1406/2808] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:13:47 2022] DELETE /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:13:47.734879 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f592880-7af4-4a3d-a786-827dc51075eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:47.736491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f592880-7af4-4a3d-a786-827dc51075eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:47.743736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f592880-7af4-4a3d-a786-827dc51075eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.744271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f592880-7af4-4a3d-a786-827dc51075eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:47.745227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f592880-7af4-4a3d-a786-827dc51075eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:47.745772 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f592880-7af4-4a3d-a786-827dc51075eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:48.015885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9f592880-7af4-4a3d-a786-827dc51075eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:48.024506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f592880-7af4-4a3d-a786-827dc51075eb tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1509 microversion: 2.1 time: 0.293663 Jul 14 10:13:48.025398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1403/2809] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:47 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:48.166182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6cc88fdc-5590-4893-8c61-9990f7bca052 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'create', calling method: .version_select at 0x7f7da6536430>, body: {"keypair": {"name": "tempest-keypair-1813994688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXUxFZAoZx96zdRaj8oCiW+zB6gkAtg3NwonMUE9NGzEn5DNrdgNJWoiDY3ics98putPmEax2CjfwBxksYEEhsRBpB99lmDD4R+iPZ4aZ+lkPO7+2aedTthIw/do8Vh/g=="}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:48.183513 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-6cc88fdc-5590-4893-8c61-9990f7bca052 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Getting quotas for project 140620648e604251bc9c5c1a0e9c483b. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:13:48.187341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-6cc88fdc-5590-4893-8c61-9990f7bca052 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Getting quotas for user 688f473972144fb6b7a398c1f775a5c1 and project 140620648e604251bc9c5c1a0e9c483b. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:13:48.211359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6cc88fdc-5590-4893-8c61-9990f7bca052 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049362 Jul 14 10:13:48.211967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1407/2810] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 10:13:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:13:48.339248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-15a0765c-4160-4c04-9d22-84962bb8db78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:48.340523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-15a0765c-4160-4c04-9d22-84962bb8db78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:48.345607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-62980d3a-7c6c-4550-8325-1d345645b940 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:48.347142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-62980d3a-7c6c-4550-8325-1d345645b940 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:48.350643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15a0765c-4160-4c04-9d22-84962bb8db78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:48.351320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15a0765c-4160-4c04-9d22-84962bb8db78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:48.352587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15a0765c-4160-4c04-9d22-84962bb8db78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:48.353341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-15a0765c-4160-4c04-9d22-84962bb8db78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:48.355396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:48.357030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62980d3a-7c6c-4550-8325-1d345645b940 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:48.357543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62980d3a-7c6c-4550-8325-1d345645b940 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:48.358451 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62980d3a-7c6c-4550-8325-1d345645b940 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:48.358952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62980d3a-7c6c-4550-8325-1d345645b940 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:48.724741 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-15a0765c-4160-4c04-9d22-84962bb8db78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:48.729701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-62980d3a-7c6c-4550-8325-1d345645b940 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:48.739834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-62980d3a-7c6c-4550-8325-1d345645b940 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1558 microversion: 2.1 time: 0.402804 Jul 14 10:13:48.744479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-15a0765c-4160-4c04-9d22-84962bb8db78 tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1555 microversion: 2.1 time: 0.410248 Jul 14 10:13:48.755566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1404/2811] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:48 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1555 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:48.755931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1408/2812] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:48 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1558 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:48.756046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c45e9869-111f-4134-8423-86c401f67ac8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:48.757026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c45e9869-111f-4134-8423-86c401f67ac8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:48.769804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c45e9869-111f-4134-8423-86c401f67ac8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:48.770467 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c45e9869-111f-4134-8423-86c401f67ac8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:48.771410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c45e9869-111f-4134-8423-86c401f67ac8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:48.771887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c45e9869-111f-4134-8423-86c401f67ac8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.042260 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b8a4aca5-b981-41be-9c4f-d8ca98e43b6b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:49.043006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b8a4aca5-b981-41be-9c4f-d8ca98e43b6b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:49.052273 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8a4aca5-b981-41be-9c4f-d8ca98e43b6b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:49.052731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8a4aca5-b981-41be-9c4f-d8ca98e43b6b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.054302 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8a4aca5-b981-41be-9c4f-d8ca98e43b6b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:49.054789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b8a4aca5-b981-41be-9c4f-d8ca98e43b6b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.073433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:49.319320 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c45e9869-111f-4134-8423-86c401f67ac8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:49.324580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b8a4aca5-b981-41be-9c4f-d8ca98e43b6b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:49.347842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b8a4aca5-b981-41be-9c4f-d8ca98e43b6b tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1509 microversion: 2.1 time: 0.309423 Jul 14 10:13:49.358208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1409/2813] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:49 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:49.358448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c45e9869-111f-4134-8423-86c401f67ac8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1683 microversion: 2.1 time: 0.605881 Jul 14 10:13:49.358448 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1405/2814] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:48 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1683 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:49.362048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-bb421d2d-7138-4651-9c90-84119a2af52b req-3727788b-7239-412d-a8ba-0383a7218d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e62e62e-be29-409c-a568-7269db0dba2d", "name": "network-vif-deleted", "tag": "f3b4a515-5f24-4041-9e95-ef29a5325536"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:49.381874 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-bb421d2d-7138-4651-9c90-84119a2af52b req-3727788b-7239-412d-a8ba-0383a7218d56 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:49.382357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-bb421d2d-7138-4651-9c90-84119a2af52b req-3727788b-7239-412d-a8ba-0383a7218d56 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.419090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-bb421d2d-7138-4651-9c90-84119a2af52b req-3727788b-7239-412d-a8ba-0383a7218d56 service nova] Creating event network-vif-deleted:f3b4a515-5f24-4041-9e95-ef29a5325536 for instance 9e62e62e-be29-409c-a568-7269db0dba2d on hv-cinder-82549 Jul 14 10:13:49.429256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-bb421d2d-7138-4651-9c90-84119a2af52b req-3727788b-7239-412d-a8ba-0383a7218d56 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078788 Jul 14 10:13:49.429795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1410/2815] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:13:49.763945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:49.764871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:49.772885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8a619270-a38f-4896-8e4f-0c99778c858a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:49.773579 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8a619270-a38f-4896-8e4f-0c99778c858a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:49.775321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:49.776040 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.777045 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:49.777878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.811841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a619270-a38f-4896-8e4f-0c99778c858a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:49.814332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a619270-a38f-4896-8e4f-0c99778c858a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.820475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:49.821509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a619270-a38f-4896-8e4f-0c99778c858a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:49.824763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8a619270-a38f-4896-8e4f-0c99778c858a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.826577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:49.827412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lazy-loading 'fault' on Instance uuid 9e62e62e-be29-409c-a568-7269db0dba2d {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:13:49.957575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93132e89a8ed42e58754ff9009d95a2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d48c64f286a4510a83d07bd9eb9449e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:49.966329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-546fe446-126f-4582-a7a6-e863194a4c9b tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 200 len: 1349 microversion: 2.1 time: 0.206723 Jul 14 10:13:49.968307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1406/2816] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:49 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 1349 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:50.167599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-8a619270-a38f-4896-8e4f-0c99778c858a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:50.179523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8a619270-a38f-4896-8e4f-0c99778c858a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1512 microversion: 2.1 time: 0.415953 Jul 14 10:13:50.180325 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1411/2817] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:49 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:50.371436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6d53aa99-3fa2-47f3-b0fb-45da1af28d93 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:50.372967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6d53aa99-3fa2-47f3-b0fb-45da1af28d93 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:50.375268 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5eb3dbc6-1fa4-47e3-bb3a-445ec2394830 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:50.379517 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5eb3dbc6-1fa4-47e3-bb3a-445ec2394830 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:50.391554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d53aa99-3fa2-47f3-b0fb-45da1af28d93 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:50.395124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d53aa99-3fa2-47f3-b0fb-45da1af28d93 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:50.396692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5eb3dbc6-1fa4-47e3-bb3a-445ec2394830 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:50.396956 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d53aa99-3fa2-47f3-b0fb-45da1af28d93 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:50.397568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d53aa99-3fa2-47f3-b0fb-45da1af28d93 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:50.398676 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5eb3dbc6-1fa4-47e3-bb3a-445ec2394830 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:50.402754 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5eb3dbc6-1fa4-47e3-bb3a-445ec2394830 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:50.403438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5eb3dbc6-1fa4-47e3-bb3a-445ec2394830 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:50.615577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5eb3dbc6-1fa4-47e3-bb3a-445ec2394830 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:50.634012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5eb3dbc6-1fa4-47e3-bb3a-445ec2394830 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 200 len: 1467 microversion: 2.1 time: 0.266968 Jul 14 10:13:50.645981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1407/2818] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:50 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 1467 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:50.697199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1970315478", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d18e0618-14d4-4101-85c8-7617d5de1451"}], "security_groups": [{"name": "tempest-securitygroup--497415542"}], "key_name": "tempest-keypair-1813994688", "user_data": "}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:50.910165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] validate_networks() for [('d18e0618-14d4-4101-85c8-7617d5de1451', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:13:50.956646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6d53aa99-3fa2-47f3-b0fb-45da1af28d93 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:50.965695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6d53aa99-3fa2-47f3-b0fb-45da1af28d93 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1683 microversion: 2.1 time: 0.598580 Jul 14 10:13:50.967388 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1412/2819] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:50 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1683 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:51.077694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-8d1110d7-7083-48a0-957a-4fba41a78d9b req-1cdb9636-197f-4e1f-99eb-307776962cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61bb2fe3-a0ee-48ce-996f-64ef966f6bcd", "name": "network-vif-deleted", "tag": "48f22e3e-0aba-4714-8fb9-6f1f18ac1f69"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:51.101021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-8d1110d7-7083-48a0-957a-4fba41a78d9b req-1cdb9636-197f-4e1f-99eb-307776962cd1 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:51.101882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-8d1110d7-7083-48a0-957a-4fba41a78d9b req-1cdb9636-197f-4e1f-99eb-307776962cd1 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:51.135794 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-8d1110d7-7083-48a0-957a-4fba41a78d9b req-1cdb9636-197f-4e1f-99eb-307776962cd1 service nova] Creating event network-vif-deleted:48f22e3e-0aba-4714-8fb9-6f1f18ac1f69 for instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd on hv-cinder-82549 Jul 14 10:13:51.144896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-8d1110d7-7083-48a0-957a-4fba41a78d9b req-1cdb9636-197f-4e1f-99eb-307776962cd1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175455 Jul 14 10:13:51.147123 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1413/2820] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:13:51.156868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:51.158627 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] [instance: 9e62e62e-be29-409c-a568-7269db0dba2d] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:51.168398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:51.169869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:51.171927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:51.172709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:51.196555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] HTTP exception thrown: Instance 9e62e62e-be29-409c-a568-7269db0dba2d could not be found. Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Request method failure captured: Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d HTTP/1.1 Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-RQxbi20qlgPnQ0yuVGBzUBonLKaLZSdzrgl0FAQ8wkPqiHBl8apyC-esXKUk7KyvTaxm2wGbJZ6MpcZz05siJUi91BxzhJx-0mcSeFU5X_-Qf9w58fmof4zIqusWvwiyWIYLFK_TVspBB0XJUwkfvLVxrmHO11vX5r346fHnrn9z4 Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:13:51.198563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6d48c64f286a4510a83d07bd9eb9449e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6d48c64f286a4510a83d07bd9eb9449e Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1227260815 Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 93132e89a8ed42e58754ff9009d95a2b Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestMinimumBasicScenario-1227260815-project Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 9e62e62e-be29-409c-a568-7269db0dba2d could not be found. Jul 14 10:13:51.200142 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '9e62e62e-be29-409c-a568-7269db0dba2d'} Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e62e62e-be29-409c-a568-7269db0dba2d could not be found. Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:51.201045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e62e62e-be29-409c-a568-7269db0dba2d could not be found. Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e62e62e-be29-409c-a568-7269db0dba2d could not be found. Jul 14 10:13:51.203139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:51.208702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Returning 404 to user: Instance 9e62e62e-be29-409c-a568-7269db0dba2d could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:51.210029 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6ba034c2-9d74-41bd-b659-fe14388c853f tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d" status: 404 len: 111 microversion: 2.1 time: 0.060488 Jul 14 10:13:51.211158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1414/2821] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:51 2022] GET /compute/v2.1/servers/9e62e62e-be29-409c-a568-7269db0dba2d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:13:51.216952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a565ca70-3442-4173-92f8-025f25903d59 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:51.218301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a565ca70-3442-4173-92f8-025f25903d59 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 21359018-1e48-4ba4-9529-a19b35577d59] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:51.226375 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a565ca70-3442-4173-92f8-025f25903d59 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:51.227603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a565ca70-3442-4173-92f8-025f25903d59 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:51.231293 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a565ca70-3442-4173-92f8-025f25903d59 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:51.232000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a565ca70-3442-4173-92f8-025f25903d59 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:51.922243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-a565ca70-3442-4173-92f8-025f25903d59 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:51.936341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a565ca70-3442-4173-92f8-025f25903d59 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59" status: 200 len: 1512 microversion: 2.1 time: 0.723886 Jul 14 10:13:51.936925 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1415/2822] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:51 2022] GET /compute/v2.1/servers/21359018-1e48-4ba4-9529-a19b35577d59 => generated 1512 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:51.942559 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1c94ba54-8d3a-416d-bdcb-188dd68c178a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] Calling method '.version_select at 0x7f7da644c4c0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:52.030327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1c94ba54-8d3a-416d-bdcb-188dd68c178a tempest-TestMinimumBasicScenario-1227260815 tempest-TestMinimumBasicScenario-1227260815-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1030520148" status: 202 len: 0 microversion: 2.1 time: 0.092042 Jul 14 10:13:52.036530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1416/2823] 10.222.0.40 () {58 vars in 1271 bytes} [Thu Jul 14 10:13:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1030520148 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:13:52.046206 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:52.047449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:52.075929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.100469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.101802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.104084 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.138152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd could not be found. Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd HTTP/1.1 Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:13:52.143342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd could not be found. Jul 14 10:13:52.145183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '61bb2fe3-a0ee-48ce-996f-64ef966f6bcd'} Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd could not be found. Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:52.146322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd could not be found. Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd could not be found. Jul 14 10:13:52.148114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:52.149699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 61bb2fe3-a0ee-48ce-996f-64ef966f6bcd could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:52.149699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b86d494-7dc2-46ad-993c-539c8c837a22 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd" status: 404 len: 111 microversion: 2.1 time: 0.105686 Jul 14 10:13:52.149699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1417/2824] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:52 2022] GET /compute/v2.1/servers/61bb2fe3-a0ee-48ce-996f-64ef966f6bcd => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:13:52.156078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-d7dbec13-432a-49cb-9a20-51f1d3ed7502 req-7390e711-00e3-4d9f-b49c-ce98dd6d151e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f265cbd-76a7-486d-873c-085ab051c168", "name": "network-vif-deleted", "tag": "dd8d169f-9a71-4f5d-a383-3bbcf7e20150"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:52.169280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-d7dbec13-432a-49cb-9a20-51f1d3ed7502 req-7390e711-00e3-4d9f-b49c-ce98dd6d151e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.169631 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-d7dbec13-432a-49cb-9a20-51f1d3ed7502 req-7390e711-00e3-4d9f-b49c-ce98dd6d151e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.208600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-d7dbec13-432a-49cb-9a20-51f1d3ed7502 req-7390e711-00e3-4d9f-b49c-ce98dd6d151e service nova] Creating event network-vif-deleted:dd8d169f-9a71-4f5d-a383-3bbcf7e20150 for instance 7f265cbd-76a7-486d-873c-085ab051c168 on hv-cinder-82549 Jul 14 10:13:52.224967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-d7dbec13-432a-49cb-9a20-51f1d3ed7502 req-7390e711-00e3-4d9f-b49c-ce98dd6d151e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073364 Jul 14 10:13:52.227538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1418/2825] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:13:52.249073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:52.251838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:52.274710 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.275776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.276930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.277667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.284302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:13:52.284906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:13:52.285243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:13:52.285840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:13:52.286662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:13:52.312642 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.313096 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.313933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.314401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.364733 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.365334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.366426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'fault' on Instance uuid 7f265cbd-76a7-486d-873c-085ab051c168 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:13:52.378438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Getting quotas for project 140620648e604251bc9c5c1a0e9c483b. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:13:52.393395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Getting quotas for user 688f473972144fb6b7a398c1f775a5c1 and project 140620648e604251bc9c5c1a0e9c483b. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:13:52.427087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:13:52.429371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:13:52.495984 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:52.516611 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5c260193-73fe-4d75-a26b-6adb57d1c3bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 200 len: 1332 microversion: 2.1 time: 0.285165 Jul 14 10:13:52.517937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1419/2826] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:52 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 1332 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:52.526485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c73fe7b6-eada-4561-946f-5cdd0e89936c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:52.529737 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c73fe7b6-eada-4561-946f-5cdd0e89936c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:52.552308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2c23fb52-34f5-4ffa-9b17-668ec9ac4668 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.859623 Jul 14 10:13:52.554529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1408/2827] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 10:13:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:13:52.574996 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c2e1080a-8f00-4f02-962d-fc124a728d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:52.575713 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c2e1080a-8f00-4f02-962d-fc124a728d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:52.587195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c73fe7b6-eada-4561-946f-5cdd0e89936c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.587658 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c73fe7b6-eada-4561-946f-5cdd0e89936c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.588471 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c73fe7b6-eada-4561-946f-5cdd0e89936c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.588875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c73fe7b6-eada-4561-946f-5cdd0e89936c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.654837 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c73fe7b6-eada-4561-946f-5cdd0e89936c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:13:52.732160 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c2e1080a-8f00-4f02-962d-fc124a728d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:52.751924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c2e1080a-8f00-4f02-962d-fc124a728d99 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1238 microversion: 2.1 time: 0.186334 Jul 14 10:13:52.757455 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1409/2828] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:52 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1238 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:52.837127 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c73fe7b6-eada-4561-946f-5cdd0e89936c tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 204 len: 0 microversion: 2.1 time: 0.316900 Jul 14 10:13:52.838077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1420/2829] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:13:52 2022] DELETE /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:13:52.847587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2938740b-10ba-4642-b656-bd43357fbaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:52.848418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2938740b-10ba-4642-b656-bd43357fbaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:52.893037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2938740b-10ba-4642-b656-bd43357fbaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.893551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2938740b-10ba-4642-b656-bd43357fbaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:52.894241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2938740b-10ba-4642-b656-bd43357fbaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:52.899507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2938740b-10ba-4642-b656-bd43357fbaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:53.109333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2938740b-10ba-4642-b656-bd43357fbaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:53.119531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2938740b-10ba-4642-b656-bd43357fbaf1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.277147 Jul 14 10:13:53.130746 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1410/2830] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:52 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:53.536903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:53.537715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:53.545291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:53.545826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:53.546960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:53.547936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:53.567799 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 HTTP/1.1 Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:13:53.569811 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:13:53.571587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '7f265cbd-76a7-486d-873c-085ab051c168'} Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:53.572499 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:13:53.573856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:13:53.577080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:53.577530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9cb3e1de-e601-4d99-bc78-89cf4a957687 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 404 len: 111 microversion: 2.1 time: 0.046154 Jul 14 10:13:53.578110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1421/2831] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:53 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:13:53.592866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1234936d-7454-4f43-82f9-2f7fd954b9a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '.version_select at 0x7f7da1e1d700>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:53.629140 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1234936d-7454-4f43-82f9-2f7fd954b9a2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877304209" status: 202 len: 0 microversion: 2.1 time: 0.044802 Jul 14 10:13:53.630065 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1411/2832] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jul 14 10:13:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1877304209 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:13:53.772587 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-521a8f46-11be-40be-afe9-924d5d7a9d78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:53.774067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-521a8f46-11be-40be-afe9-924d5d7a9d78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:53.785719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-521a8f46-11be-40be-afe9-924d5d7a9d78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:53.786241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-521a8f46-11be-40be-afe9-924d5d7a9d78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:53.787342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-521a8f46-11be-40be-afe9-924d5d7a9d78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:53.788199 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-521a8f46-11be-40be-afe9-924d5d7a9d78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:54.130494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-521a8f46-11be-40be-afe9-924d5d7a9d78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:54.138394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a85602f2-ad74-437c-b107-bf27f56925c1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:54.142519 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a85602f2-ad74-437c-b107-bf27f56925c1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:54.152054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-521a8f46-11be-40be-afe9-924d5d7a9d78 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1242 microversion: 2.1 time: 0.384343 Jul 14 10:13:54.155898 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a85602f2-ad74-437c-b107-bf27f56925c1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:54.156709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1422/2833] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:53 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1242 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:54.157378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a85602f2-ad74-437c-b107-bf27f56925c1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:54.159016 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a85602f2-ad74-437c-b107-bf27f56925c1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:54.159615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a85602f2-ad74-437c-b107-bf27f56925c1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:54.242140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-eb308cd2-e7ae-498f-a2c2-41cd589d631c req-1fee99f0-d850-4235-809c-0c8ab0f612f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21359018-1e48-4ba4-9529-a19b35577d59", "name": "network-vif-deleted", "tag": "e5ba949a-2ace-47d1-a8b3-aa70ff78fa5e"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:54.250444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-eb308cd2-e7ae-498f-a2c2-41cd589d631c req-1fee99f0-d850-4235-809c-0c8ab0f612f7 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:54.251136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-eb308cd2-e7ae-498f-a2c2-41cd589d631c req-1fee99f0-d850-4235-809c-0c8ab0f612f7 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:54.264401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-eb308cd2-e7ae-498f-a2c2-41cd589d631c req-1fee99f0-d850-4235-809c-0c8ab0f612f7 service nova] Creating event network-vif-deleted:e5ba949a-2ace-47d1-a8b3-aa70ff78fa5e for instance 21359018-1e48-4ba4-9529-a19b35577d59 on hv-cinder-82549 Jul 14 10:13:54.272318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-eb308cd2-e7ae-498f-a2c2-41cd589d631c req-1fee99f0-d850-4235-809c-0c8ab0f612f7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034658 Jul 14 10:13:54.273542 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1423/2834] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:13:54.486365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-23d0b085-2ab8-4976-a9ee-e692e6337271 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: .version_select at 0x7f7da63d3d30>, body: {"keypair": {"name": "tempest-keypair-271176762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFBX8j8I5wSUVD2gFpyjkUq4bj50gLZYZn5W7beklwOP5ACo3IpcK5wRGkLKRLTX1i6dbrbAFPdARQ1PzuInb86UCE6YIXq/IyCn+YYFTPxIBmwspPo9PiyRwC0rt1LWA=="}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:54.506311 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-23d0b085-2ab8-4976-a9ee-e692e6337271 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:13:54.510318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-23d0b085-2ab8-4976-a9ee-e692e6337271 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for user 1d7ae3d2f56a491baf26a83a34d86ccf and project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'key_pairs'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:13:54.521580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a85602f2-ad74-437c-b107-bf27f56925c1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:54.535338 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a85602f2-ad74-437c-b107-bf27f56925c1 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.401142 Jul 14 10:13:54.536089 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1412/2835] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:54 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:54.540770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-23d0b085-2ab8-4976-a9ee-e692e6337271 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059201 Jul 14 10:13:54.541362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1424/2836] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 10:13:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:13:55.174012 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-84089377-3929-4c97-88d9-e7bb8856e446 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:55.174653 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-84089377-3929-4c97-88d9-e7bb8856e446 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:55.183238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-84089377-3929-4c97-88d9-e7bb8856e446 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:55.183685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-84089377-3929-4c97-88d9-e7bb8856e446 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:55.184733 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-84089377-3929-4c97-88d9-e7bb8856e446 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:55.185170 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-84089377-3929-4c97-88d9-e7bb8856e446 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:55.209965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:55.308299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-84089377-3929-4c97-88d9-e7bb8856e446 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:55.321725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-84089377-3929-4c97-88d9-e7bb8856e446 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1242 microversion: 2.1 time: 0.151516 Jul 14 10:13:55.322742 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1413/2837] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:55 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:55.569575 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ea2e2a74-28d9-4cce-a87c-530af1c67f18 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:55.570759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ea2e2a74-28d9-4cce-a87c-530af1c67f18 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:55.580364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea2e2a74-28d9-4cce-a87c-530af1c67f18 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:55.581186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea2e2a74-28d9-4cce-a87c-530af1c67f18 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:55.582286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea2e2a74-28d9-4cce-a87c-530af1c67f18 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:55.583108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ea2e2a74-28d9-4cce-a87c-530af1c67f18 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:55.917750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-ea2e2a74-28d9-4cce-a87c-530af1c67f18 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:55.928604 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ea2e2a74-28d9-4cce-a87c-530af1c67f18 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.371406 Jul 14 10:13:55.938306 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1425/2838] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:55 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:56.339815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-43bdebfe-5849-4293-8ff2-300721ec4eb1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:56.341015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-43bdebfe-5849-4293-8ff2-300721ec4eb1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:56.348341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43bdebfe-5849-4293-8ff2-300721ec4eb1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:56.348794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43bdebfe-5849-4293-8ff2-300721ec4eb1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:56.349559 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43bdebfe-5849-4293-8ff2-300721ec4eb1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:56.349983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-43bdebfe-5849-4293-8ff2-300721ec4eb1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:56.453155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-43bdebfe-5849-4293-8ff2-300721ec4eb1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:56.457847 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-43bdebfe-5849-4293-8ff2-300721ec4eb1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1242 microversion: 2.1 time: 0.122610 Jul 14 10:13:56.467052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1414/2839] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:56 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:56.819868 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2074824963", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9dc9a66-299f-4d37-a369-9dec401232c3"}], "security_groups": [{"name": "tempest-securitygroup--7967197"}], "key_name": "tempest-keypair-271176762", "user_data": "}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:56.936286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] validate_networks() for [('b9dc9a66-299f-4d37-a369-9dec401232c3', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:13:56.945652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-541ce6b5-ad41-4ced-8367-47a578484656 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:56.946182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-541ce6b5-ad41-4ced-8367-47a578484656 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:56.955161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-541ce6b5-ad41-4ced-8367-47a578484656 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:56.955615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-541ce6b5-ad41-4ced-8367-47a578484656 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:56.956490 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-541ce6b5-ad41-4ced-8367-47a578484656 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:56.957211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-541ce6b5-ad41-4ced-8367-47a578484656 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:57.225318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-541ce6b5-ad41-4ced-8367-47a578484656 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:57.237509 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-541ce6b5-ad41-4ced-8367-47a578484656 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.295813 Jul 14 10:13:57.238779 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1415/2840] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:56 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:13:57.477277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7f27dc4f-ebd3-47bf-84cc-4513467dd421 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:57.478932 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7f27dc4f-ebd3-47bf-84cc-4513467dd421 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:57.489281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f27dc4f-ebd3-47bf-84cc-4513467dd421 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:57.491349 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f27dc4f-ebd3-47bf-84cc-4513467dd421 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:57.492734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f27dc4f-ebd3-47bf-84cc-4513467dd421 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:57.493865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7f27dc4f-ebd3-47bf-84cc-4513467dd421 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:57.497806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:13:57.498423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:13:57.499198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:13:57.499725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:13:57.500253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:13:57.515945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:57.516545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:57.517238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:57.517683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:57.544045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:13:57.549367 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for user 1d7ae3d2f56a491baf26a83a34d86ccf and project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:13:57.564411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:13:57.566760 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:13:57.596305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7f27dc4f-ebd3-47bf-84cc-4513467dd421 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:57.603949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7f27dc4f-ebd3-47bf-84cc-4513467dd421 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1290 microversion: 2.1 time: 0.132161 Jul 14 10:13:57.619051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1416/2841] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:57 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1290 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:57.645761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-047ce304-a1e7-4ae5-83a6-a14999a0b483 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.830221 Jul 14 10:13:57.649131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1426/2842] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 10:13:56 2022] POST /compute/v2.1/servers => generated 399 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:13:57.661050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3a2e0416-9e98-43ae-8836-eb417382a54d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:57.662072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3a2e0416-9e98-43ae-8836-eb417382a54d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:57.728985 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3a2e0416-9e98-43ae-8836-eb417382a54d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:57.739208 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3a2e0416-9e98-43ae-8836-eb417382a54d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1241 microversion: 2.1 time: 0.083060 Jul 14 10:13:57.739944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1417/2843] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:57 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:58.256920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-831d27e5-b9d7-42cb-9a25-b50b9904b73f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:58.257546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-831d27e5-b9d7-42cb-9a25-b50b9904b73f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:58.281686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-831d27e5-b9d7-42cb-9a25-b50b9904b73f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:58.283134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-831d27e5-b9d7-42cb-9a25-b50b9904b73f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:58.284157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-831d27e5-b9d7-42cb-9a25-b50b9904b73f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:58.285721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-831d27e5-b9d7-42cb-9a25-b50b9904b73f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:58.600264 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-831d27e5-b9d7-42cb-9a25-b50b9904b73f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:58.609770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-831d27e5-b9d7-42cb-9a25-b50b9904b73f tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.358711 Jul 14 10:13:58.611872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1427/2844] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:58 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:58.635143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-01d79d6a-8397-47a7-ba8f-478dbc73de97 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:58.636453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-01d79d6a-8397-47a7-ba8f-478dbc73de97 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:58.643323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01d79d6a-8397-47a7-ba8f-478dbc73de97 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:58.643768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01d79d6a-8397-47a7-ba8f-478dbc73de97 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:58.649122 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01d79d6a-8397-47a7-ba8f-478dbc73de97 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:58.649639 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01d79d6a-8397-47a7-ba8f-478dbc73de97 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:58.662716 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b62b350-01cc-42c5-83ba-007ca99f7f1c tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da63d3670>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:58.770149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b62b350-01cc-42c5-83ba-007ca99f7f1c tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/e504e6be-abcc-4a3d-acec-749e7e0e3ec5" status: 200 len: 349 microversion: 2.1 time: 0.144656 Jul 14 10:13:58.770894 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1428/2845] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 10:13:58 2022] GET /compute/v2.1/os-volumes/e504e6be-abcc-4a3d-acec-749e7e0e3ec5 => generated 349 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:13:58.780789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-98b67cf6-fabd-4ef3-8c15-679394b05568 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:58.784008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-98b67cf6-fabd-4ef3-8c15-679394b05568 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:58.805696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98b67cf6-fabd-4ef3-8c15-679394b05568 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:58.806358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98b67cf6-fabd-4ef3-8c15-679394b05568 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:58.807670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98b67cf6-fabd-4ef3-8c15-679394b05568 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:58.810776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-98b67cf6-fabd-4ef3-8c15-679394b05568 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:59.137430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-01d79d6a-8397-47a7-ba8f-478dbc73de97 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:59.156072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-01d79d6a-8397-47a7-ba8f-478dbc73de97 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1296 microversion: 2.1 time: 0.537265 Jul 14 10:13:59.156072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1418/2846] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:58 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1296 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:59.170931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-98b67cf6-fabd-4ef3-8c15-679394b05568 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:13:59.192483 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-98b67cf6-fabd-4ef3-8c15-679394b05568 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1293 microversion: 2.1 time: 0.420083 Jul 14 10:13:59.194437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1429/2847] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:58 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1293 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:13:59.628381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2887d021-61e9-40a3-9792-8676dc7c0445 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:59.629789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2887d021-61e9-40a3-9792-8676dc7c0445 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:13:59.636775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2887d021-61e9-40a3-9792-8676dc7c0445 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:59.637439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2887d021-61e9-40a3-9792-8676dc7c0445 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:59.638118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2887d021-61e9-40a3-9792-8676dc7c0445 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:59.638700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2887d021-61e9-40a3-9792-8676dc7c0445 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:59.897678 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-54725b37-246b-4f5f-b28d-8f34a805758b req-79bb62a7-fef5-45bf-8b67-c25821f2544b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1", "name": "network-vif-deleted", "tag": "2a9b746f-3a6c-4ff1-b675-838773cc6ee9"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:59.929134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-54725b37-246b-4f5f-b28d-8f34a805758b req-79bb62a7-fef5-45bf-8b67-c25821f2544b service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:59.929924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-54725b37-246b-4f5f-b28d-8f34a805758b req-79bb62a7-fef5-45bf-8b67-c25821f2544b service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:59.951854 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-54725b37-246b-4f5f-b28d-8f34a805758b req-79bb62a7-fef5-45bf-8b67-c25821f2544b service nova] Creating event network-vif-deleted:2a9b746f-3a6c-4ff1-b675-838773cc6ee9 for instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 on hv-cinder-82549 Jul 14 10:13:59.958642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-54725b37-246b-4f5f-b28d-8f34a805758b req-79bb62a7-fef5-45bf-8b67-c25821f2544b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064500 Jul 14 10:13:59.960194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1430/2848] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:13:59.975175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2887d021-61e9-40a3-9792-8676dc7c0445 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d0b9390f474de79828a675d4e0646a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35a70c5090a4570ad8ba3701dad3f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:00.002526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2887d021-61e9-40a3-9792-8676dc7c0445 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 200 len: 1522 microversion: 2.1 time: 0.377972 Jul 14 10:14:00.016263 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1419/2849] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:59 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:00.176231 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0f07c7f5-3845-438f-85e6-43a4f6b280f1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:00.177243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0f07c7f5-3845-438f-85e6-43a4f6b280f1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:00.198564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f07c7f5-3845-438f-85e6-43a4f6b280f1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:00.200132 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f07c7f5-3845-438f-85e6-43a4f6b280f1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:00.201154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f07c7f5-3845-438f-85e6-43a4f6b280f1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:00.202763 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0f07c7f5-3845-438f-85e6-43a4f6b280f1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:00.215522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a1d116d9-53f7-49bf-8b45-899791be9cf3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:00.216542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a1d116d9-53f7-49bf-8b45-899791be9cf3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:00.228385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a1d116d9-53f7-49bf-8b45-899791be9cf3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:00.230104 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a1d116d9-53f7-49bf-8b45-899791be9cf3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:00.232995 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a1d116d9-53f7-49bf-8b45-899791be9cf3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:00.238301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a1d116d9-53f7-49bf-8b45-899791be9cf3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:00.524468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a1d116d9-53f7-49bf-8b45-899791be9cf3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:00.534897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a1d116d9-53f7-49bf-8b45-899791be9cf3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1299 microversion: 2.1 time: 0.324416 Jul 14 10:14:00.536278 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1420/2850] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:00 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:00.541722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-872bbb7f-1a82-4f37-a6cb-eba31f5a932f tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da1d51670>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:00.601403 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-872bbb7f-1a82-4f37-a6cb-eba31f5a932f tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/c4eb55c7-bbf4-43f8-977e-ed45584cdae9" status: 200 len: 351 microversion: 2.1 time: 0.063444 Jul 14 10:14:00.603869 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1421/2851] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 10:14:00 2022] GET /compute/v2.1/os-volumes/c4eb55c7-bbf4-43f8-977e-ed45584cdae9 => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:00.886936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0f07c7f5-3845-438f-85e6-43a4f6b280f1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:00.898915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0f07c7f5-3845-438f-85e6-43a4f6b280f1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.729338 Jul 14 10:14:00.899954 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1431/2852] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:00 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:01.023887 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:01.024500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] [instance: 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:01.037961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:01.038848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:01.039846 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:01.040454 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:01.065225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] HTTP exception thrown: Instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 could not be found. Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Request method failure captured: Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 HTTP/1.1 Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P5rX3oYmVJJh2EGS3tYmiuK5LIR0UopCRAXcKv2EzzgdDQ0lOzPHGgvTaZqmvOgYHg6NaC4OuKEW2JMrli2alW8JX6r3YhcyajIwE0gW9TOHoRcr0Uqcnv3AqQGrPsZiSonEJIZDdRUBJ5OL14XhqFN_x3PMkhxm9vkbVYf1n-Mpo Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:14:01.072070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f35a70c5090a4570ad8ba3701dad3f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: f35a70c5090a4570ad8ba3701dad3f80 Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1080517056 Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: f1d0b9390f474de79828a675d4e0646a Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1080517056-project Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 could not be found. Jul 14 10:14:01.073877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1'} Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 could not be found. Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:14:01.075037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 could not be found. Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 could not be found. Jul 14 10:14:01.076652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:14:01.083723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] Returning 404 to user: Instance 7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:14:01.085331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d44eb105-38df-45d7-bdf7-ee823aedd723 tempest-ServerRescueNegativeTestJSON-1080517056 tempest-ServerRescueNegativeTestJSON-1080517056-project] 10.222.0.40 "GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1" status: 404 len: 111 microversion: 2.1 time: 0.065424 Jul 14 10:14:01.097817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1422/2853] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:01 2022] GET /compute/v2.1/servers/7c0d0dba-e78e-4f8b-80f1-1a7dd13385c1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:14:01.553021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3d0b92e1-0ed5-404d-a4f4-9f4f115226a3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:01.559223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3d0b92e1-0ed5-404d-a4f4-9f4f115226a3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:01.567002 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3d0b92e1-0ed5-404d-a4f4-9f4f115226a3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:01.567515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3d0b92e1-0ed5-404d-a4f4-9f4f115226a3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:01.568455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3d0b92e1-0ed5-404d-a4f4-9f4f115226a3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:01.569114 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3d0b92e1-0ed5-404d-a4f4-9f4f115226a3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:01.789100 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3d0b92e1-0ed5-404d-a4f4-9f4f115226a3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:01.797792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3d0b92e1-0ed5-404d-a4f4-9f4f115226a3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.248559 Jul 14 10:14:01.808036 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1432/2854] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:01 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:01.916949 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1ade0612-2581-4b48-af6c-d5675c2273ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:01.917679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1ade0612-2581-4b48-af6c-d5675c2273ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:01.925287 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ade0612-2581-4b48-af6c-d5675c2273ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:01.925815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ade0612-2581-4b48-af6c-d5675c2273ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:01.926957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ade0612-2581-4b48-af6c-d5675c2273ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:01.927391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1ade0612-2581-4b48-af6c-d5675c2273ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:01.996339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-e6713686-18b1-485c-928f-5b7b1a04e11a req-f889c607-65bf-402c-885c-8279507db4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cd8bd5-5679-49fd-b8f0-6af3ef428875", "tag": "49829aea-09a7-4c91-805e-d385763e6d9b"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:02.009228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-e6713686-18b1-485c-928f-5b7b1a04e11a req-f889c607-65bf-402c-885c-8279507db4e8 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:02.009989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-e6713686-18b1-485c-928f-5b7b1a04e11a req-f889c607-65bf-402c-885c-8279507db4e8 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:02.014279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:02.027198 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-e6713686-18b1-485c-928f-5b7b1a04e11a req-f889c607-65bf-402c-885c-8279507db4e8 service nova] Creating event network-changed:49829aea-09a7-4c91-805e-d385763e6d9b for instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 on hv-cinder-82549 Jul 14 10:14:02.038784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-e6713686-18b1-485c-928f-5b7b1a04e11a req-f889c607-65bf-402c-885c-8279507db4e8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046766 Jul 14 10:14:02.038784 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1433/2855] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:02.144520 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1ade0612-2581-4b48-af6c-d5675c2273ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:02.154839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1ade0612-2581-4b48-af6c-d5675c2273ba tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.241496 Jul 14 10:14:02.165479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1423/2856] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:01 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:02.817700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2e6bfd49-4581-4ceb-8b32-6826c435d621 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:02.818700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2e6bfd49-4581-4ceb-8b32-6826c435d621 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:02.826821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e6bfd49-4581-4ceb-8b32-6826c435d621 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:02.827530 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e6bfd49-4581-4ceb-8b32-6826c435d621 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:02.828321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e6bfd49-4581-4ceb-8b32-6826c435d621 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:02.828757 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2e6bfd49-4581-4ceb-8b32-6826c435d621 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:03.172547 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-11a089f7-783e-49d3-93c1-82c29fe08a1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:03.173858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-11a089f7-783e-49d3-93c1-82c29fe08a1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:03.176149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:03.191674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11a089f7-783e-49d3-93c1-82c29fe08a1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:03.192365 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11a089f7-783e-49d3-93c1-82c29fe08a1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:03.193161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11a089f7-783e-49d3-93c1-82c29fe08a1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:03.193591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-11a089f7-783e-49d3-93c1-82c29fe08a1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:03.487595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2e6bfd49-4581-4ceb-8b32-6826c435d621 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:03.496759 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2e6bfd49-4581-4ceb-8b32-6826c435d621 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.684640 Jul 14 10:14:03.497684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1434/2857] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:02 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:03.603580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-11a089f7-783e-49d3-93c1-82c29fe08a1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:03.613307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-11a089f7-783e-49d3-93c1-82c29fe08a1c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.444689 Jul 14 10:14:03.622362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1424/2858] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:03 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:04.518448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7d913c4c-3a4f-49a6-88e3-c54460d615b8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:04.520187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7d913c4c-3a4f-49a6-88e3-c54460d615b8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:04.530223 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d913c4c-3a4f-49a6-88e3-c54460d615b8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:04.531705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d913c4c-3a4f-49a6-88e3-c54460d615b8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:04.532512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d913c4c-3a4f-49a6-88e3-c54460d615b8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:04.533053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7d913c4c-3a4f-49a6-88e3-c54460d615b8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:04.630666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4b33c5ed-a48f-4552-b69b-d26f0c4ce981 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:04.631852 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4b33c5ed-a48f-4552-b69b-d26f0c4ce981 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:04.646486 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b33c5ed-a48f-4552-b69b-d26f0c4ce981 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:04.646937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b33c5ed-a48f-4552-b69b-d26f0c4ce981 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:04.647716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b33c5ed-a48f-4552-b69b-d26f0c4ce981 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:04.648142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4b33c5ed-a48f-4552-b69b-d26f0c4ce981 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:04.916189 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7d913c4c-3a4f-49a6-88e3-c54460d615b8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:04.926146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7d913c4c-3a4f-49a6-88e3-c54460d615b8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.414918 Jul 14 10:14:04.927349 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1435/2859] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:04 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:05.023585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4b33c5ed-a48f-4552-b69b-d26f0c4ce981 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:05.036182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4b33c5ed-a48f-4552-b69b-d26f0c4ce981 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.409826 Jul 14 10:14:05.037388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1425/2860] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:04 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:05.944505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-13a610d7-af72-4941-881f-d69513532629 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:05.945315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-13a610d7-af72-4941-881f-d69513532629 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:05.960227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13a610d7-af72-4941-881f-d69513532629 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:05.960741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13a610d7-af72-4941-881f-d69513532629 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:05.964746 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13a610d7-af72-4941-881f-d69513532629 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:05.968743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-13a610d7-af72-4941-881f-d69513532629 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:06.060722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-12702a11-2f62-4a09-82b2-63056cb9412c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:06.063161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-12702a11-2f62-4a09-82b2-63056cb9412c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:06.086031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12702a11-2f62-4a09-82b2-63056cb9412c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:06.086031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12702a11-2f62-4a09-82b2-63056cb9412c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:06.086031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12702a11-2f62-4a09-82b2-63056cb9412c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:06.086031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-12702a11-2f62-4a09-82b2-63056cb9412c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:06.185226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-13a610d7-af72-4941-881f-d69513532629 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:06.197750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-13a610d7-af72-4941-881f-d69513532629 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.257574 Jul 14 10:14:06.199561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1436/2861] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:05 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:06.465794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-12702a11-2f62-4a09-82b2-63056cb9412c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:06.500580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-12702a11-2f62-4a09-82b2-63056cb9412c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.451111 Jul 14 10:14:06.508805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1426/2862] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:06 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:06.898295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-268657144", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "networks": [{"uuid": "33e7d33f-d1db-4bcf-8519-11d88fe2947e"}]}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:06.969050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] validate_networks() for [('33e7d33f-d1db-4bcf-8519-11d88fe2947e', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:14:07.029290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-daa36f4c-1641-4260-ab25-a43c7b7e572f req-1e9b8e07-3d5b-4d3a-85cb-ea90a36ed004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9", "tag": "f4baff3e-3caa-4f28-860b-fca366386896"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:07.043326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-daa36f4c-1641-4260-ab25-a43c7b7e572f req-1e9b8e07-3d5b-4d3a-85cb-ea90a36ed004 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.044633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-daa36f4c-1641-4260-ab25-a43c7b7e572f req-1e9b8e07-3d5b-4d3a-85cb-ea90a36ed004 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.079033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-daa36f4c-1641-4260-ab25-a43c7b7e572f req-1e9b8e07-3d5b-4d3a-85cb-ea90a36ed004 service nova] Creating event network-changed:f4baff3e-3caa-4f28-860b-fca366386896 for instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 on hv-cinder-82549 Jul 14 10:14:07.087758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-daa36f4c-1641-4260-ab25-a43c7b7e572f req-1e9b8e07-3d5b-4d3a-85cb-ea90a36ed004 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062017 Jul 14 10:14:07.089157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1427/2863] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:07.215720 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d1d9f979-dc4c-43a5-9c76-ea906a782954 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:07.216634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d1d9f979-dc4c-43a5-9c76-ea906a782954 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:07.224191 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1d9f979-dc4c-43a5-9c76-ea906a782954 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.224659 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1d9f979-dc4c-43a5-9c76-ea906a782954 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.225406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1d9f979-dc4c-43a5-9c76-ea906a782954 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.225872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d1d9f979-dc4c-43a5-9c76-ea906a782954 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.479297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d1d9f979-dc4c-43a5-9c76-ea906a782954 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:07.488662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d1d9f979-dc4c-43a5-9c76-ea906a782954 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.277648 Jul 14 10:14:07.489230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1428/2864] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:07 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:07.505380 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:14:07.505810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:14:07.510250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:14:07.510250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:14:07.510250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:14:07.519561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.520020 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.520815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.521258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.538382 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-019b564f-1a1d-44ee-9332-0e0aecfcb7ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:07.539299 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-019b564f-1a1d-44ee-9332-0e0aecfcb7ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:07.539936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Getting quotas for project 6bf7eec88bc64cd2be062020a72563de. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:14:07.545164 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-019b564f-1a1d-44ee-9332-0e0aecfcb7ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.545489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Getting quotas for user 08962a3ebb194189b2ab68e62fee6e60 and project 6bf7eec88bc64cd2be062020a72563de. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:14:07.545635 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-019b564f-1a1d-44ee-9332-0e0aecfcb7ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.546359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-019b564f-1a1d-44ee-9332-0e0aecfcb7ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.546781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-019b564f-1a1d-44ee-9332-0e0aecfcb7ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.548028 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:07.560364 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:14:07.562640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:14:07.630541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0a0ceb19-cf72-4762-81b6-d18aee8f15bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732975 Jul 14 10:14:07.634797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1437/2865] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 10:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:14:07.651630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e7d98b5e-509a-42dc-9008-270f6e08388c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:07.652464 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e7d98b5e-509a-42dc-9008-270f6e08388c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:07.738748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=10 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:07.743211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-019b564f-1a1d-44ee-9332-0e0aecfcb7ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:07.743659 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e7d98b5e-509a-42dc-9008-270f6e08388c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:07.750693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e7d98b5e-509a-42dc-9008-270f6e08388c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1218 microversion: 2.1 time: 0.103119 Jul 14 10:14:07.751332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1438/2866] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:07 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:07.756495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8f7adcb2-03a5-4c17-9def-64fa9fbe9400 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da63aeb80>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:07.765231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-019b564f-1a1d-44ee-9332-0e0aecfcb7ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.230309 Jul 14 10:14:07.766380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1429/2867] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:07 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:07.811596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8f7adcb2-03a5-4c17-9def-64fa9fbe9400 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/634763bb-884e-4784-aa8a-1d1ca028a2db" status: 200 len: 351 microversion: 2.1 time: 0.058563 Jul 14 10:14:07.812167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1439/2868] 10.222.0.40 () {58 vars in 1244 bytes} [Thu Jul 14 10:14:07 2022] GET /compute/v2.1/os-volumes/634763bb-884e-4784-aa8a-1d1ca028a2db => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:07.824537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f109cf16-df39-46d0-8ce0-a9e5bdf44531 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da1be2f70>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:07.910944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f109cf16-df39-46d0-8ce0-a9e5bdf44531 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090860 Jul 14 10:14:07.911511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1430/2869] 10.222.0.40 () {58 vars in 1133 bytes} [Thu Jul 14 10:14:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:07.924725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4cbb610e-28aa-4149-9223-2f2953052dad tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da1d8c1f0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.014578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4cbb610e-28aa-4149-9223-2f2953052dad tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.094028 Jul 14 10:14:08.016206 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1440/2870] 10.222.0.40 () {58 vars in 1148 bytes} [Thu Jul 14 10:14:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:08.027976 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3565aa1a-c295-40c2-ac60-a7dac2314ec8 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da1e81550>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.118095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3565aa1a-c295-40c2-ac60-a7dac2314ec8 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094183 Jul 14 10:14:08.118757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1431/2871] 10.222.0.40 () {58 vars in 1133 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:08.130524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-97a60a7c-561c-4e2b-acc3-1d4de83d98b3 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da6545040>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.212427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-97a60a7c-561c-4e2b-acc3-1d4de83d98b3 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086519 Jul 14 10:14:08.213078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1441/2872] 10.222.0.40 () {58 vars in 1166 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:08.224434 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ee689b80-5546-4877-81bb-83138a6e3ecc tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da1e81040>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.305810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ee689b80-5546-4877-81bb-83138a6e3ecc tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085027 Jul 14 10:14:08.306771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1432/2873] 10.222.0.40 () {58 vars in 1169 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:08.320808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-eabba001-3cd6-4d17-a0f4-9be77d970675 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da63aed30>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.409625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-eabba001-3cd6-4d17-a0f4-9be77d970675 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093024 Jul 14 10:14:08.410708 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1442/2874] 10.222.0.40 () {58 vars in 1154 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:08.422941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a266e998-3bf7-45f3-8b80-d69aacc52268 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da206e790>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.509021 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e500b437-e4d9-4582-86be-ce02e97da047 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.509643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e500b437-e4d9-4582-86be-ce02e97da047 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:08.516935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e500b437-e4d9-4582-86be-ce02e97da047 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:08.517396 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e500b437-e4d9-4582-86be-ce02e97da047 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:08.518181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e500b437-e4d9-4582-86be-ce02e97da047 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:08.518646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e500b437-e4d9-4582-86be-ce02e97da047 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:08.653641 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a266e998-3bf7-45f3-8b80-d69aacc52268 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.234471 Jul 14 10:14:08.654351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1433/2875] 10.222.0.40 () {58 vars in 1187 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:14:08.660043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e500b437-e4d9-4582-86be-ce02e97da047 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:08.666302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1a99d41d-8118-4eec-8705-9970c6e1d961 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] Calling method '.version_select at 0x7f7da1e1d3a0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.668452 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e500b437-e4d9-4582-86be-ce02e97da047 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.163348 Jul 14 10:14:08.669012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1443/2876] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:08.747178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1a99d41d-8118-4eec-8705-9970c6e1d961 tempest-VolumesTestJSON-1781586015 tempest-VolumesTestJSON-1781586015-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084535 Jul 14 10:14:08.747748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1434/2877] 10.222.0.40 () {58 vars in 1154 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:08.767509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e5f39a54-712d-4de9-8536-05edeee41761 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.768117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e5f39a54-712d-4de9-8536-05edeee41761 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:08.774578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e5f39a54-712d-4de9-8536-05edeee41761 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:08.775079 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e5f39a54-712d-4de9-8536-05edeee41761 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:08.775849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e5f39a54-712d-4de9-8536-05edeee41761 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:08.776300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e5f39a54-712d-4de9-8536-05edeee41761 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:08.783843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-01d5a1af-9eb0-43d5-8073-989ab9e10726 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.784593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-01d5a1af-9eb0-43d5-8073-989ab9e10726 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:08.791180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01d5a1af-9eb0-43d5-8073-989ab9e10726 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:08.791593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01d5a1af-9eb0-43d5-8073-989ab9e10726 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:08.792736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01d5a1af-9eb0-43d5-8073-989ab9e10726 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:08.793240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-01d5a1af-9eb0-43d5-8073-989ab9e10726 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:08.847502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e5f39a54-712d-4de9-8536-05edeee41761 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:08.856642 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e5f39a54-712d-4de9-8536-05edeee41761 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1222 microversion: 2.1 time: 0.092949 Jul 14 10:14:08.867434 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1444/2878] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:08.949314 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-01d5a1af-9eb0-43d5-8073-989ab9e10726 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:08.956828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-01d5a1af-9eb0-43d5-8073-989ab9e10726 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.177775 Jul 14 10:14:08.957395 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1435/2879] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:09.686318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f1b51f90-de21-40fd-8828-be996c1a15fd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:09.686943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f1b51f90-de21-40fd-8828-be996c1a15fd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:09.697550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1b51f90-de21-40fd-8828-be996c1a15fd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:09.698274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1b51f90-de21-40fd-8828-be996c1a15fd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:09.699640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1b51f90-de21-40fd-8828-be996c1a15fd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:09.700277 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f1b51f90-de21-40fd-8828-be996c1a15fd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:09.875049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cbc06bbb-a35d-4492-b322-e2c030e36570 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:09.876840 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cbc06bbb-a35d-4492-b322-e2c030e36570 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:09.887011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbc06bbb-a35d-4492-b322-e2c030e36570 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:09.887572 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbc06bbb-a35d-4492-b322-e2c030e36570 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:09.888581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbc06bbb-a35d-4492-b322-e2c030e36570 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:09.889091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cbc06bbb-a35d-4492-b322-e2c030e36570 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:09.991905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f1b51f90-de21-40fd-8828-be996c1a15fd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:09.997342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cbc06bbb-a35d-4492-b322-e2c030e36570 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:10.004102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f1b51f90-de21-40fd-8828-be996c1a15fd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.321685 Jul 14 10:14:10.005059 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1445/2880] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:09 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:10.008636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cbc06bbb-a35d-4492-b322-e2c030e36570 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1288 microversion: 2.1 time: 0.137981 Jul 14 10:14:10.009494 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1436/2881] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:09 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1288 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:10.010887 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-39865510-bf68-45c9-8115-a6e62798ecae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:10.011661 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-39865510-bf68-45c9-8115-a6e62798ecae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:10.019358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39865510-bf68-45c9-8115-a6e62798ecae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:10.020128 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39865510-bf68-45c9-8115-a6e62798ecae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:10.022052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39865510-bf68-45c9-8115-a6e62798ecae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:10.022705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-39865510-bf68-45c9-8115-a6e62798ecae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:10.264070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-39865510-bf68-45c9-8115-a6e62798ecae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:10.271701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-39865510-bf68-45c9-8115-a6e62798ecae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.265024 Jul 14 10:14:10.272275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1446/2882] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:10 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:11.022023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9b47286d-ee00-4b96-b666-56f4ccec08fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:11.022851 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9b47286d-ee00-4b96-b666-56f4ccec08fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:11.025963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:11.031855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b285b6f6-12ec-4720-bb35-d72416214f29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:11.032404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b47286d-ee00-4b96-b666-56f4ccec08fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:11.032529 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b285b6f6-12ec-4720-bb35-d72416214f29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:11.032634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b47286d-ee00-4b96-b666-56f4ccec08fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.033243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b47286d-ee00-4b96-b666-56f4ccec08fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:11.033681 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9b47286d-ee00-4b96-b666-56f4ccec08fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.038688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b285b6f6-12ec-4720-bb35-d72416214f29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:11.039278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b285b6f6-12ec-4720-bb35-d72416214f29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.040101 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b285b6f6-12ec-4720-bb35-d72416214f29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:11.040643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b285b6f6-12ec-4720-bb35-d72416214f29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.244638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9b47286d-ee00-4b96-b666-56f4ccec08fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:11.252274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b285b6f6-12ec-4720-bb35-d72416214f29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:11.253987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9b47286d-ee00-4b96-b666-56f4ccec08fe tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.236036 Jul 14 10:14:11.263302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1437/2883] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:11 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:11.263521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b285b6f6-12ec-4720-bb35-d72416214f29 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.236743 Jul 14 10:14:11.263521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1447/2884] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:11 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:11.288855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c9460484-fe90-4a57-b9c9-2d9da4525bc4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:11.289381 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c9460484-fe90-4a57-b9c9-2d9da4525bc4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:11.295442 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9460484-fe90-4a57-b9c9-2d9da4525bc4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:11.295878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9460484-fe90-4a57-b9c9-2d9da4525bc4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.296621 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9460484-fe90-4a57-b9c9-2d9da4525bc4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:11.297048 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c9460484-fe90-4a57-b9c9-2d9da4525bc4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.312393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:11.428894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c9460484-fe90-4a57-b9c9-2d9da4525bc4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:11.436313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c9460484-fe90-4a57-b9c9-2d9da4525bc4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.151484 Jul 14 10:14:11.436877 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1438/2885] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:11 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:12.271048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4e735104-0586-43df-b439-4112c038c4f6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:12.271791 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4e735104-0586-43df-b439-4112c038c4f6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:12.276768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a494a6a9-3364-47ce-9ca9-38ca67445f30 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:12.277444 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a494a6a9-3364-47ce-9ca9-38ca67445f30 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:12.278688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e735104-0586-43df-b439-4112c038c4f6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.279148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e735104-0586-43df-b439-4112c038c4f6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.279921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e735104-0586-43df-b439-4112c038c4f6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.280365 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4e735104-0586-43df-b439-4112c038c4f6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.283698 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a494a6a9-3364-47ce-9ca9-38ca67445f30 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.284136 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a494a6a9-3364-47ce-9ca9-38ca67445f30 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.284885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a494a6a9-3364-47ce-9ca9-38ca67445f30 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.285316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a494a6a9-3364-47ce-9ca9-38ca67445f30 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.481144 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4e735104-0586-43df-b439-4112c038c4f6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:12.485508 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a494a6a9-3364-47ce-9ca9-38ca67445f30 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:12.489303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4e735104-0586-43df-b439-4112c038c4f6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.222105 Jul 14 10:14:12.489878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1448/2886] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:12 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:12.494300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2030c9f7-8014-442b-8ae4-fda6b7670e01 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:12.494903 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2030c9f7-8014-442b-8ae4-fda6b7670e01 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:12.496921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a494a6a9-3364-47ce-9ca9-38ca67445f30 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.223910 Jul 14 10:14:12.497760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1439/2887] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:12 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:12.500936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2030c9f7-8014-442b-8ae4-fda6b7670e01 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.501977 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2030c9f7-8014-442b-8ae4-fda6b7670e01 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.502770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2030c9f7-8014-442b-8ae4-fda6b7670e01 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.503236 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2030c9f7-8014-442b-8ae4-fda6b7670e01 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.629720 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2030c9f7-8014-442b-8ae4-fda6b7670e01 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:12.637139 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2030c9f7-8014-442b-8ae4-fda6b7670e01 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.146293 Jul 14 10:14:12.637705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1449/2888] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:12 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:13.506521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-dd05f90f-51f1-4f7c-9192-564642a79b57 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:13.507147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-dd05f90f-51f1-4f7c-9192-564642a79b57 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:13.513837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd05f90f-51f1-4f7c-9192-564642a79b57 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:13.514235 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d1868bf0-500e-45bc-8018-a535a19fd722 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:13.514693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd05f90f-51f1-4f7c-9192-564642a79b57 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:13.514862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d1868bf0-500e-45bc-8018-a535a19fd722 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:13.515121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd05f90f-51f1-4f7c-9192-564642a79b57 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:13.515550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-dd05f90f-51f1-4f7c-9192-564642a79b57 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:13.522166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d1868bf0-500e-45bc-8018-a535a19fd722 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:13.522647 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d1868bf0-500e-45bc-8018-a535a19fd722 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:13.523414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d1868bf0-500e-45bc-8018-a535a19fd722 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:13.523857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d1868bf0-500e-45bc-8018-a535a19fd722 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:13.710505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d1868bf0-500e-45bc-8018-a535a19fd722 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:13.718425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-dd05f90f-51f1-4f7c-9192-564642a79b57 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:13.718619 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d1868bf0-500e-45bc-8018-a535a19fd722 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.208159 Jul 14 10:14:13.719146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1450/2889] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:13 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:13.727944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-dd05f90f-51f1-4f7c-9192-564642a79b57 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.224243 Jul 14 10:14:13.727944 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1440/2890] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:13 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:13.731858 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5cf1ad78-7e41-404b-90c0-693a4a3abae1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:13.732459 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5cf1ad78-7e41-404b-90c0-693a4a3abae1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:13.739294 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5cf1ad78-7e41-404b-90c0-693a4a3abae1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:13.739799 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5cf1ad78-7e41-404b-90c0-693a4a3abae1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:13.740566 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5cf1ad78-7e41-404b-90c0-693a4a3abae1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:13.741000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5cf1ad78-7e41-404b-90c0-693a4a3abae1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:13.876273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5cf1ad78-7e41-404b-90c0-693a4a3abae1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:13.884730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5cf1ad78-7e41-404b-90c0-693a4a3abae1 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.156203 Jul 14 10:14:13.885312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1441/2891] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:13 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:14.736249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f71a37da-5381-410e-9e34-482dfc1cf94a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:14.736862 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f71a37da-5381-410e-9e34-482dfc1cf94a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:14.744213 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b9a71d2f-da83-4cc6-bb1f-85b03881c050 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:14.744830 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b9a71d2f-da83-4cc6-bb1f-85b03881c050 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:14.746465 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f71a37da-5381-410e-9e34-482dfc1cf94a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.746922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f71a37da-5381-410e-9e34-482dfc1cf94a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.747696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f71a37da-5381-410e-9e34-482dfc1cf94a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.748136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f71a37da-5381-410e-9e34-482dfc1cf94a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.752276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a71d2f-da83-4cc6-bb1f-85b03881c050 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.754031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a71d2f-da83-4cc6-bb1f-85b03881c050 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.754031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a71d2f-da83-4cc6-bb1f-85b03881c050 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.754031 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b9a71d2f-da83-4cc6-bb1f-85b03881c050 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.965768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b9a71d2f-da83-4cc6-bb1f-85b03881c050 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:14.969067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f71a37da-5381-410e-9e34-482dfc1cf94a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:14.975006 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b9a71d2f-da83-4cc6-bb1f-85b03881c050 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.234234 Jul 14 10:14:14.976026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1442/2892] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:14 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:14.977061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f71a37da-5381-410e-9e34-482dfc1cf94a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.246220 Jul 14 10:14:14.985038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1451/2893] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:14 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:14.985255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-24284388-e325-4ba3-b012-f207623f5593 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:14.985255 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-24284388-e325-4ba3-b012-f207623f5593 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:14.991131 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-24284388-e325-4ba3-b012-f207623f5593 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.991515 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-24284388-e325-4ba3-b012-f207623f5593 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.992293 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-24284388-e325-4ba3-b012-f207623f5593 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.992730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-24284388-e325-4ba3-b012-f207623f5593 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:15.127601 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-24284388-e325-4ba3-b012-f207623f5593 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:15.135543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-24284388-e325-4ba3-b012-f207623f5593 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.158067 Jul 14 10:14:15.136113 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1443/2894] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:14 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:15.992288 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-59466054-2264-49a6-92bd-db8f0e99088a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:15.992878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-59466054-2264-49a6-92bd-db8f0e99088a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:15.994399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ccbfab77-2ad7-45d0-8b46-4c38726888bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:15.995009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ccbfab77-2ad7-45d0-8b46-4c38726888bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:15.999506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59466054-2264-49a6-92bd-db8f0e99088a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:15.999959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59466054-2264-49a6-92bd-db8f0e99088a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:16.000721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59466054-2264-49a6-92bd-db8f0e99088a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:16.001151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59466054-2264-49a6-92bd-db8f0e99088a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:16.001405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ccbfab77-2ad7-45d0-8b46-4c38726888bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:16.001860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ccbfab77-2ad7-45d0-8b46-4c38726888bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:16.002651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ccbfab77-2ad7-45d0-8b46-4c38726888bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:16.003087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ccbfab77-2ad7-45d0-8b46-4c38726888bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:16.198284 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ccbfab77-2ad7-45d0-8b46-4c38726888bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:16.201090 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-59466054-2264-49a6-92bd-db8f0e99088a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:16.209241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-59466054-2264-49a6-92bd-db8f0e99088a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.220751 Jul 14 10:14:16.209823 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1452/2895] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:15 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:16.210271 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ccbfab77-2ad7-45d0-8b46-4c38726888bf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.219451 Jul 14 10:14:16.211000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1444/2896] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:15 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:16.217328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f579f256-2fa2-4ec8-bfa9-e8ca31a61d48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:16.218120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f579f256-2fa2-4ec8-bfa9-e8ca31a61d48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:16.225195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f579f256-2fa2-4ec8-bfa9-e8ca31a61d48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:16.225641 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f579f256-2fa2-4ec8-bfa9-e8ca31a61d48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:16.226558 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f579f256-2fa2-4ec8-bfa9-e8ca31a61d48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:16.226997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f579f256-2fa2-4ec8-bfa9-e8ca31a61d48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:16.354709 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f579f256-2fa2-4ec8-bfa9-e8ca31a61d48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:16.362899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f579f256-2fa2-4ec8-bfa9-e8ca31a61d48 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.152027 Jul 14 10:14:16.363387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1453/2897] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:16 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:17.227264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7bfebeeb-b6ac-4768-89ee-374085956bef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:17.227894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7bfebeeb-b6ac-4768-89ee-374085956bef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:17.228552 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-68094d9f-9673-4f6c-9c58-e87f8762288a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:17.229194 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-68094d9f-9673-4f6c-9c58-e87f8762288a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:17.235107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bfebeeb-b6ac-4768-89ee-374085956bef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:17.235281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bfebeeb-b6ac-4768-89ee-374085956bef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:17.235690 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68094d9f-9673-4f6c-9c58-e87f8762288a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:17.236724 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bfebeeb-b6ac-4768-89ee-374085956bef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:17.236850 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68094d9f-9673-4f6c-9c58-e87f8762288a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:17.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7bfebeeb-b6ac-4768-89ee-374085956bef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:17.237445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68094d9f-9673-4f6c-9c58-e87f8762288a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:17.237884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-68094d9f-9673-4f6c-9c58-e87f8762288a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:17.437589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7bfebeeb-b6ac-4768-89ee-374085956bef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:17.441634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-68094d9f-9673-4f6c-9c58-e87f8762288a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:17.447372 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7bfebeeb-b6ac-4768-89ee-374085956bef tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.223642 Jul 14 10:14:17.448587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1445/2898] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:17 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:17.455394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f7f8ef0-396c-44d2-beaa-158309dbe082 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:17.455994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f7f8ef0-396c-44d2-beaa-158309dbe082 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:17.460310 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-68094d9f-9673-4f6c-9c58-e87f8762288a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.235544 Jul 14 10:14:17.463781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7f8ef0-396c-44d2-beaa-158309dbe082 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:17.464354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7f8ef0-396c-44d2-beaa-158309dbe082 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:17.465163 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7f8ef0-396c-44d2-beaa-158309dbe082 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:17.465745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f7f8ef0-396c-44d2-beaa-158309dbe082 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:17.469432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1454/2899] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:17 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:17.617834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9f7f8ef0-396c-44d2-beaa-158309dbe082 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:17.626502 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f7f8ef0-396c-44d2-beaa-158309dbe082 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.175890 Jul 14 10:14:17.627090 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1446/2900] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:17 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:18.467355 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7393ce35-2c54-472b-851e-9ee3ad31a2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:18.468819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7393ce35-2c54-472b-851e-9ee3ad31a2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:18.479317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7ac14eac-d36a-4337-a0d1-8b2a5f55de7c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:18.479851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=4 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:18.480298 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=22 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:18.481076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7ac14eac-d36a-4337-a0d1-8b2a5f55de7c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:18.488726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7393ce35-2c54-472b-851e-9ee3ad31a2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.488726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7393ce35-2c54-472b-851e-9ee3ad31a2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:18.488726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7393ce35-2c54-472b-851e-9ee3ad31a2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.488726 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7393ce35-2c54-472b-851e-9ee3ad31a2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:18.503348 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ac14eac-d36a-4337-a0d1-8b2a5f55de7c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.504050 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ac14eac-d36a-4337-a0d1-8b2a5f55de7c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:18.507142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ac14eac-d36a-4337-a0d1-8b2a5f55de7c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.507802 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ac14eac-d36a-4337-a0d1-8b2a5f55de7c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:18.764022 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7393ce35-2c54-472b-851e-9ee3ad31a2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:18.780134 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7393ce35-2c54-472b-851e-9ee3ad31a2a9 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.318593 Jul 14 10:14:18.783508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1455/2901] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:18 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:18.789119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-5efe950f-0bd6-4efa-a680-c0887843888e req-5d3d22bc-b8c1-44c8-99c2-28af64556ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "752982c3-14af-4fd6-9f4d-71529abc0e40", "tag": "90195373-05dd-4e99-83f4-fbd74e13d3bd"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:18.820374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-5efe950f-0bd6-4efa-a680-c0887843888e req-5d3d22bc-b8c1-44c8-99c2-28af64556ac3 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.820898 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-5efe950f-0bd6-4efa-a680-c0887843888e req-5d3d22bc-b8c1-44c8-99c2-28af64556ac3 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:18.856046 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=100 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:18.862354 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-5efe950f-0bd6-4efa-a680-c0887843888e req-5d3d22bc-b8c1-44c8-99c2-28af64556ac3 service nova] Creating event network-changed:90195373-05dd-4e99-83f4-fbd74e13d3bd for instance 752982c3-14af-4fd6-9f4d-71529abc0e40 on hv-cinder-82549 Jul 14 10:14:18.874157 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-5efe950f-0bd6-4efa-a680-c0887843888e req-5d3d22bc-b8c1-44c8-99c2-28af64556ac3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085598 Jul 14 10:14:18.876182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1456/2902] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:18.887891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-90a99dad-835e-429a-be93-2f452a611010 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:18.888610 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-90a99dad-835e-429a-be93-2f452a611010 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:18.897725 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-90a99dad-835e-429a-be93-2f452a611010 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.898169 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-90a99dad-835e-429a-be93-2f452a611010 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:18.899188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-90a99dad-835e-429a-be93-2f452a611010 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.899798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-90a99dad-835e-429a-be93-2f452a611010 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.245462 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7ac14eac-d36a-4337-a0d1-8b2a5f55de7c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:19.260205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7ac14eac-d36a-4337-a0d1-8b2a5f55de7c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.785661 Jul 14 10:14:19.261265 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1447/2903] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:18 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:19.268575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-f4b5e9af-d171-4b77-889e-56c9f995c509 req-cf0274c5-28bb-4c29-902f-2f1d26b97336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd8bd5-5679-49fd-b8f0-6af3ef428875", "name": "network-vif-plugged", "status": "completed", "tag": "49829aea-09a7-4c91-805e-d385763e6d9b"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:19.277769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f4b5e9af-d171-4b77-889e-56c9f995c509 req-cf0274c5-28bb-4c29-902f-2f1d26b97336 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:19.278479 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f4b5e9af-d171-4b77-889e-56c9f995c509 req-cf0274c5-28bb-4c29-902f-2f1d26b97336 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.290272 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-f4b5e9af-d171-4b77-889e-56c9f995c509 req-cf0274c5-28bb-4c29-902f-2f1d26b97336 service nova] Creating event network-vif-plugged:49829aea-09a7-4c91-805e-d385763e6d9b for instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 on hv-cinder-82549 Jul 14 10:14:19.295597 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-f4b5e9af-d171-4b77-889e-56c9f995c509 req-cf0274c5-28bb-4c29-902f-2f1d26b97336 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032638 Jul 14 10:14:19.296786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1448/2904] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:19.309327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-90a99dad-835e-429a-be93-2f452a611010 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:19.318214 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-90a99dad-835e-429a-be93-2f452a611010 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.439139 Jul 14 10:14:19.318812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1457/2905] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:18 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:19.801585 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-95e561fb-44fb-4f6a-8512-514f064b7f4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:19.803599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-95e561fb-44fb-4f6a-8512-514f064b7f4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:19.810860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-95e561fb-44fb-4f6a-8512-514f064b7f4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:19.811668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-95e561fb-44fb-4f6a-8512-514f064b7f4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.812788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-95e561fb-44fb-4f6a-8512-514f064b7f4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:19.813279 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-95e561fb-44fb-4f6a-8512-514f064b7f4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.968076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-95e561fb-44fb-4f6a-8512-514f064b7f4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:19.975668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-95e561fb-44fb-4f6a-8512-514f064b7f4c tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.179533 Jul 14 10:14:19.976227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1449/2906] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:19 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:20.278179 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f4d5b546-36ab-4b5b-b14c-d45dd263b0b1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:20.279031 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f4d5b546-36ab-4b5b-b14c-d45dd263b0b1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:20.286568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4d5b546-36ab-4b5b-b14c-d45dd263b0b1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.287023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4d5b546-36ab-4b5b-b14c-d45dd263b0b1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.287856 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4d5b546-36ab-4b5b-b14c-d45dd263b0b1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.288442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f4d5b546-36ab-4b5b-b14c-d45dd263b0b1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.335570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fdaee710-8fd1-4e49-8cd9-ea92555f35b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:20.336687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fdaee710-8fd1-4e49-8cd9-ea92555f35b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:20.343318 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fdaee710-8fd1-4e49-8cd9-ea92555f35b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.344020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fdaee710-8fd1-4e49-8cd9-ea92555f35b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.345032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fdaee710-8fd1-4e49-8cd9-ea92555f35b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.345815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fdaee710-8fd1-4e49-8cd9-ea92555f35b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.527395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f4d5b546-36ab-4b5b-b14c-d45dd263b0b1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:20.539409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f4d5b546-36ab-4b5b-b14c-d45dd263b0b1 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.266162 Jul 14 10:14:20.544256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1458/2907] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:20 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:20.572154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fdaee710-8fd1-4e49-8cd9-ea92555f35b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:20.581974 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fdaee710-8fd1-4e49-8cd9-ea92555f35b3 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.250571 Jul 14 10:14:20.582672 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1450/2908] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:20 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:20.992821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-72a52986-9c63-47be-bec3-1a47e6e31025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:20.993433 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-72a52986-9c63-47be-bec3-1a47e6e31025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:20.999501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72a52986-9c63-47be-bec3-1a47e6e31025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.999957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72a52986-9c63-47be-bec3-1a47e6e31025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.000719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72a52986-9c63-47be-bec3-1a47e6e31025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.001162 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-72a52986-9c63-47be-bec3-1a47e6e31025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.141368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-72a52986-9c63-47be-bec3-1a47e6e31025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:21.149489 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-72a52986-9c63-47be-bec3-1a47e6e31025 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.160509 Jul 14 10:14:21.150060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1459/2909] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:20 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:21.316773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-40ebef35-06e5-4838-9a2e-f7c39d879575 req-26cd2720-9b6f-4a48-87e5-47bee7673be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9", "name": "network-vif-plugged", "status": "completed", "tag": "f4baff3e-3caa-4f28-860b-fca366386896"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:21.326668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-40ebef35-06e5-4838-9a2e-f7c39d879575 req-26cd2720-9b6f-4a48-87e5-47bee7673be8 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.327179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-40ebef35-06e5-4838-9a2e-f7c39d879575 req-26cd2720-9b6f-4a48-87e5-47bee7673be8 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.342567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-40ebef35-06e5-4838-9a2e-f7c39d879575 req-26cd2720-9b6f-4a48-87e5-47bee7673be8 service nova] Creating event network-vif-plugged:f4baff3e-3caa-4f28-860b-fca366386896 for instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 on hv-cinder-82549 Jul 14 10:14:21.348066 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-40ebef35-06e5-4838-9a2e-f7c39d879575 req-26cd2720-9b6f-4a48-87e5-47bee7673be8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037713 Jul 14 10:14:21.352864 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1451/2910] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:21.559173 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-e6bddc5c-cf08-4587-8a2b-a6ee53708302 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:21.560055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-e6bddc5c-cf08-4587-8a2b-a6ee53708302 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:21.567479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e6bddc5c-cf08-4587-8a2b-a6ee53708302 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.568891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e6bddc5c-cf08-4587-8a2b-a6ee53708302 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.569792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e6bddc5c-cf08-4587-8a2b-a6ee53708302 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.570305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-e6bddc5c-cf08-4587-8a2b-a6ee53708302 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.600579 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fa20b42c-fe14-4543-acd1-1c748f4744a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:21.601239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fa20b42c-fe14-4543-acd1-1c748f4744a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:21.607810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa20b42c-fe14-4543-acd1-1c748f4744a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.608253 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa20b42c-fe14-4543-acd1-1c748f4744a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.609020 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa20b42c-fe14-4543-acd1-1c748f4744a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.609450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fa20b42c-fe14-4543-acd1-1c748f4744a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.774950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-e6bddc5c-cf08-4587-8a2b-a6ee53708302 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:21.787301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-e6bddc5c-cf08-4587-8a2b-a6ee53708302 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.231677 Jul 14 10:14:21.788187 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1460/2911] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:21 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:21.805426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fa20b42c-fe14-4543-acd1-1c748f4744a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:21.812980 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fa20b42c-fe14-4543-acd1-1c748f4744a9 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.216961 Jul 14 10:14:21.813640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1452/2912] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:21 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:22.167305 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-616968ca-c9c9-45ae-92b8-4f067d0e263f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:22.168138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-616968ca-c9c9-45ae-92b8-4f067d0e263f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:22.175118 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-616968ca-c9c9-45ae-92b8-4f067d0e263f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.175331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-616968ca-c9c9-45ae-92b8-4f067d0e263f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.176067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-616968ca-c9c9-45ae-92b8-4f067d0e263f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.176508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-616968ca-c9c9-45ae-92b8-4f067d0e263f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.319576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-616968ca-c9c9-45ae-92b8-4f067d0e263f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:22.330978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-616968ca-c9c9-45ae-92b8-4f067d0e263f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.166579 Jul 14 10:14:22.331909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1461/2913] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:22 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:22.806531 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9844db12-8d67-4ff8-b759-1d0e12f10c37 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:22.807230 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9844db12-8d67-4ff8-b759-1d0e12f10c37 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:22.814638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9844db12-8d67-4ff8-b759-1d0e12f10c37 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.815162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9844db12-8d67-4ff8-b759-1d0e12f10c37 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.816018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9844db12-8d67-4ff8-b759-1d0e12f10c37 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.816967 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9844db12-8d67-4ff8-b759-1d0e12f10c37 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.835352 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b32af6fd-e7c8-4f11-9ca4-52c547aa59e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:22.835965 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b32af6fd-e7c8-4f11-9ca4-52c547aa59e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:22.844261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b32af6fd-e7c8-4f11-9ca4-52c547aa59e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.844922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b32af6fd-e7c8-4f11-9ca4-52c547aa59e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.845834 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b32af6fd-e7c8-4f11-9ca4-52c547aa59e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.847635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b32af6fd-e7c8-4f11-9ca4-52c547aa59e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:23.077581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9844db12-8d67-4ff8-b759-1d0e12f10c37 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:23.093763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9844db12-8d67-4ff8-b759-1d0e12f10c37 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.292113 Jul 14 10:14:23.094359 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b32af6fd-e7c8-4f11-9ca4-52c547aa59e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:23.109439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b32af6fd-e7c8-4f11-9ca4-52c547aa59e7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.279479 Jul 14 10:14:23.112976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1462/2914] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:22 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:23.113175 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1453/2915] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:22 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:23.359117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-970d474f-f5a3-49fd-bc3a-bcdbade23d4e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:23.359960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-970d474f-f5a3-49fd-bc3a-bcdbade23d4e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:23.384177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-970d474f-f5a3-49fd-bc3a-bcdbade23d4e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:23.384673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-970d474f-f5a3-49fd-bc3a-bcdbade23d4e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:23.385462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-970d474f-f5a3-49fd-bc3a-bcdbade23d4e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:23.385902 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-970d474f-f5a3-49fd-bc3a-bcdbade23d4e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:23.553301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-970d474f-f5a3-49fd-bc3a-bcdbade23d4e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:23.564159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-970d474f-f5a3-49fd-bc3a-bcdbade23d4e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.219627 Jul 14 10:14:23.564798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1463/2916] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:23 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:24.112482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c04f3e1a-00a9-454b-be44-2358ac5504ab tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:24.112986 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c04f3e1a-00a9-454b-be44-2358ac5504ab tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:24.122576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c04f3e1a-00a9-454b-be44-2358ac5504ab tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.123823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c04f3e1a-00a9-454b-be44-2358ac5504ab tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.125120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c04f3e1a-00a9-454b-be44-2358ac5504ab tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.125916 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c04f3e1a-00a9-454b-be44-2358ac5504ab tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.129423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d6046733-5a5f-4f7a-b4fd-330b508d45ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:24.130077 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d6046733-5a5f-4f7a-b4fd-330b508d45ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:24.142372 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6046733-5a5f-4f7a-b4fd-330b508d45ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.142915 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6046733-5a5f-4f7a-b4fd-330b508d45ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.145014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6046733-5a5f-4f7a-b4fd-330b508d45ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.145630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d6046733-5a5f-4f7a-b4fd-330b508d45ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.372834 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c04f3e1a-00a9-454b-be44-2358ac5504ab tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:24.384005 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-d6046733-5a5f-4f7a-b4fd-330b508d45ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:24.395158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d6046733-5a5f-4f7a-b4fd-330b508d45ca tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1363 microversion: 2.1 time: 0.272118 Jul 14 10:14:24.395905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1464/2917] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:24 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:24.403083 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c04f3e1a-00a9-454b-be44-2358ac5504ab tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.295744 Jul 14 10:14:24.404952 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1454/2918] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:24 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:24.583615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b744367b-349d-488d-abaf-935a18cc4d2f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:24.584395 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b744367b-349d-488d-abaf-935a18cc4d2f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:24.586895 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-185dda5a-2b83-4804-b8a7-7aa8b84c8441 req-7ece3416-b3d6-448d-a038-70495af93aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752982c3-14af-4fd6-9f4d-71529abc0e40", "name": "network-vif-plugged", "status": "completed", "tag": "90195373-05dd-4e99-83f4-fbd74e13d3bd"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:24.596246 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b744367b-349d-488d-abaf-935a18cc4d2f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.597154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b744367b-349d-488d-abaf-935a18cc4d2f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.597301 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-185dda5a-2b83-4804-b8a7-7aa8b84c8441 req-7ece3416-b3d6-448d-a038-70495af93aea service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.597662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-185dda5a-2b83-4804-b8a7-7aa8b84c8441 req-7ece3416-b3d6-448d-a038-70495af93aea service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.598743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b744367b-349d-488d-abaf-935a18cc4d2f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.599785 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b744367b-349d-488d-abaf-935a18cc4d2f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.615793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-185dda5a-2b83-4804-b8a7-7aa8b84c8441 req-7ece3416-b3d6-448d-a038-70495af93aea service nova] Creating event network-vif-plugged:90195373-05dd-4e99-83f4-fbd74e13d3bd for instance 752982c3-14af-4fd6-9f4d-71529abc0e40 on hv-cinder-82549 Jul 14 10:14:24.621780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-185dda5a-2b83-4804-b8a7-7aa8b84c8441 req-7ece3416-b3d6-448d-a038-70495af93aea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038544 Jul 14 10:14:24.622808 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1455/2919] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:14:24.754266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-b744367b-349d-488d-abaf-935a18cc4d2f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:24.762374 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b744367b-349d-488d-abaf-935a18cc4d2f tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.185111 Jul 14 10:14:24.762943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1465/2920] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:24 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:25.413554 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-a6130272-bf24-447c-83b9-b290afb45e22 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:25.414745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-a6130272-bf24-447c-83b9-b290afb45e22 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:25.423158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-32d15f1b-070f-459a-bc02-ab0b83c7957b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:25.423740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6130272-bf24-447c-83b9-b290afb45e22 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.423740 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6130272-bf24-447c-83b9-b290afb45e22 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.423976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-32d15f1b-070f-459a-bc02-ab0b83c7957b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:25.424529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6130272-bf24-447c-83b9-b290afb45e22 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.425156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-a6130272-bf24-447c-83b9-b290afb45e22 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.431015 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32d15f1b-070f-459a-bc02-ab0b83c7957b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.431702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32d15f1b-070f-459a-bc02-ab0b83c7957b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.432551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32d15f1b-070f-459a-bc02-ab0b83c7957b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.434502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-32d15f1b-070f-459a-bc02-ab0b83c7957b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.709789 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-a6130272-bf24-447c-83b9-b290afb45e22 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:25.715321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-32d15f1b-070f-459a-bc02-ab0b83c7957b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:25.724038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-32d15f1b-070f-459a-bc02-ab0b83c7957b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1364 microversion: 2.1 time: 0.306778 Jul 14 10:14:25.724207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-a6130272-bf24-447c-83b9-b290afb45e22 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1550 microversion: 2.1 time: 0.315222 Jul 14 10:14:25.724953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1466/2921] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:25 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:25.725470 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1456/2922] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:25 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1550 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:25.741650 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a3c59e93-f108-4208-ac50-5c0a04ffd8c8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:25.742488 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a3c59e93-f108-4208-ac50-5c0a04ffd8c8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:25.749062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a3c59e93-f108-4208-ac50-5c0a04ffd8c8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.750485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a3c59e93-f108-4208-ac50-5c0a04ffd8c8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.750809 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a3c59e93-f108-4208-ac50-5c0a04ffd8c8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.751453 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a3c59e93-f108-4208-ac50-5c0a04ffd8c8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.781333 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c06c33ac-a2c9-4ef3-93de-6aeebd070854 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:25.782400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c06c33ac-a2c9-4ef3-93de-6aeebd070854 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:25.789725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c06c33ac-a2c9-4ef3-93de-6aeebd070854 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.790112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c06c33ac-a2c9-4ef3-93de-6aeebd070854 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.791634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c06c33ac-a2c9-4ef3-93de-6aeebd070854 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.792129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c06c33ac-a2c9-4ef3-93de-6aeebd070854 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.799573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=100 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:25.916581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a3c59e93-f108-4208-ac50-5c0a04ffd8c8 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.178789 Jul 14 10:14:25.917383 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1467/2923] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 10:14:25 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:26.164280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c06c33ac-a2c9-4ef3-93de-6aeebd070854 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:26.173924 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c06c33ac-a2c9-4ef3-93de-6aeebd070854 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.397033 Jul 14 10:14:26.175115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1457/2924] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:25 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:26.741877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-724e2dab-08e9-460e-9197-81a655eae79d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:26.742523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-724e2dab-08e9-460e-9197-81a655eae79d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:26.749219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-724e2dab-08e9-460e-9197-81a655eae79d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:26.749670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-724e2dab-08e9-460e-9197-81a655eae79d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:26.750468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-724e2dab-08e9-460e-9197-81a655eae79d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:26.750899 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-724e2dab-08e9-460e-9197-81a655eae79d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.041342 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-724e2dab-08e9-460e-9197-81a655eae79d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:27.051050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-724e2dab-08e9-460e-9197-81a655eae79d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1555 microversion: 2.1 time: 0.313859 Jul 14 10:14:27.062660 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1468/2925] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:26 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1555 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:27.067378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-82dd155a-ace5-4d52-b4a9-6c6ac7e6b007 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:27.067928 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-82dd155a-ace5-4d52-b4a9-6c6ac7e6b007 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:27.082743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82dd155a-ace5-4d52-b4a9-6c6ac7e6b007 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.083209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82dd155a-ace5-4d52-b4a9-6c6ac7e6b007 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.084146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82dd155a-ace5-4d52-b4a9-6c6ac7e6b007 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.084583 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-82dd155a-ace5-4d52-b4a9-6c6ac7e6b007 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.194971 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-18514ddd-a58c-42df-bb26-0be3e7f84a74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:27.196158 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-18514ddd-a58c-42df-bb26-0be3e7f84a74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:27.202849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-18514ddd-a58c-42df-bb26-0be3e7f84a74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.203526 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-18514ddd-a58c-42df-bb26-0be3e7f84a74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.204510 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-18514ddd-a58c-42df-bb26-0be3e7f84a74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.205117 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-18514ddd-a58c-42df-bb26-0be3e7f84a74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.229342 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-82dd155a-ace5-4d52-b4a9-6c6ac7e6b007 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165570 Jul 14 10:14:27.230118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1458/2926] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 10:14:27 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:27.370034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-3f1a701c-ee40-477d-a952-ebf9608f20c1 req-84495d50-b9cd-44d5-87fa-19c57d96ec99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cd8bd5-5679-49fd-b8f0-6af3ef428875", "tag": "49829aea-09a7-4c91-805e-d385763e6d9b"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:27.394987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-3f1a701c-ee40-477d-a952-ebf9608f20c1 req-84495d50-b9cd-44d5-87fa-19c57d96ec99 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.395260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-3f1a701c-ee40-477d-a952-ebf9608f20c1 req-84495d50-b9cd-44d5-87fa-19c57d96ec99 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.416017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-18514ddd-a58c-42df-bb26-0be3e7f84a74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:27.416934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-3f1a701c-ee40-477d-a952-ebf9608f20c1 req-84495d50-b9cd-44d5-87fa-19c57d96ec99 service nova] Creating event network-changed:49829aea-09a7-4c91-805e-d385763e6d9b for instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 on hv-cinder-82549 Jul 14 10:14:27.425207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-18514ddd-a58c-42df-bb26-0be3e7f84a74 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.237663 Jul 14 10:14:27.428437 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-3f1a701c-ee40-477d-a952-ebf9608f20c1 req-84495d50-b9cd-44d5-87fa-19c57d96ec99 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062798 Jul 14 10:14:27.429266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1469/2927] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:27 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:27.430107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1459/2928] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:14:28.448515 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dfee8709-79a1-4114-8d2e-804c95136042 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:28.450000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dfee8709-79a1-4114-8d2e-804c95136042 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:28.469294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dfee8709-79a1-4114-8d2e-804c95136042 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:28.470833 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dfee8709-79a1-4114-8d2e-804c95136042 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:28.473555 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dfee8709-79a1-4114-8d2e-804c95136042 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:28.474546 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dfee8709-79a1-4114-8d2e-804c95136042 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:28.722563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dfee8709-79a1-4114-8d2e-804c95136042 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:28.739415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dfee8709-79a1-4114-8d2e-804c95136042 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1318 microversion: 2.1 time: 0.297207 Jul 14 10:14:28.742025 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1470/2929] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:28 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:29.195168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-c306dbcd-c9cc-48c7-bbf2-3f90ac793f0c req-f523b801-eefb-400a-a438-f7b1749ecf14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9", "tag": "f4baff3e-3caa-4f28-860b-fca366386896"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:29.216189 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-c306dbcd-c9cc-48c7-bbf2-3f90ac793f0c req-f523b801-eefb-400a-a438-f7b1749ecf14 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.217714 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-c306dbcd-c9cc-48c7-bbf2-3f90ac793f0c req-f523b801-eefb-400a-a438-f7b1749ecf14 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.241759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-c306dbcd-c9cc-48c7-bbf2-3f90ac793f0c req-f523b801-eefb-400a-a438-f7b1749ecf14 service nova] Creating event network-changed:f4baff3e-3caa-4f28-860b-fca366386896 for instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 on hv-cinder-82549 Jul 14 10:14:29.248465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-c306dbcd-c9cc-48c7-bbf2-3f90ac793f0c req-f523b801-eefb-400a-a438-f7b1749ecf14 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058930 Jul 14 10:14:29.249197 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1460/2930] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:29.756907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dcd6ec83-ae2c-4e71-aa5e-51d1b13ba7b2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:29.757534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dcd6ec83-ae2c-4e71-aa5e-51d1b13ba7b2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:29.768691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dcd6ec83-ae2c-4e71-aa5e-51d1b13ba7b2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.769550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dcd6ec83-ae2c-4e71-aa5e-51d1b13ba7b2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.770503 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dcd6ec83-ae2c-4e71-aa5e-51d1b13ba7b2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.771093 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dcd6ec83-ae2c-4e71-aa5e-51d1b13ba7b2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.960428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dcd6ec83-ae2c-4e71-aa5e-51d1b13ba7b2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:29.972256 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dcd6ec83-ae2c-4e71-aa5e-51d1b13ba7b2 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1506 microversion: 2.1 time: 0.219357 Jul 14 10:14:29.973322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1471/2931] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:29 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:29.989868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d6412aa4-6c9a-4607-a0b8-a586682cae4a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2caa9fe-0e51-45f8-af92-5d29e4095e00", "device": "/dev/sdb"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:29.991082 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d6412aa4-6c9a-4607-a0b8-a586682cae4a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:29.997384 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6412aa4-6c9a-4607-a0b8-a586682cae4a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.998047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6412aa4-6c9a-4607-a0b8-a586682cae4a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.999543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6412aa4-6c9a-4607-a0b8-a586682cae4a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:30.000157 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d6412aa4-6c9a-4607-a0b8-a586682cae4a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:30.307474 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d6412aa4-6c9a-4607-a0b8-a586682cae4a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "POST /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322090 Jul 14 10:14:30.308870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1461/2932] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 10:14:29 2022] POST /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:55.954518 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3eb8e85e-66d4-4018-99bc-73f2a34d2482 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:55.955573 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3eb8e85e-66d4-4018-99bc-73f2a34d2482 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:55.958078 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:55.958754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=89 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:55.965229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eb8e85e-66d4-4018-99bc-73f2a34d2482 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:55.965683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eb8e85e-66d4-4018-99bc-73f2a34d2482 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:55.966477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eb8e85e-66d4-4018-99bc-73f2a34d2482 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:55.966949 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3eb8e85e-66d4-4018-99bc-73f2a34d2482 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:56.047255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-3eb8e85e-66d4-4018-99bc-73f2a34d2482 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'services' on Instance uuid 752982c3-14af-4fd6-9f4d-71529abc0e40 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:14:56.118821 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3eb8e85e-66d4-4018-99bc-73f2a34d2482 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40/os-volume_attachments/e2caa9fe-0e51-45f8-af92-5d29e4095e00" status: 202 len: 0 microversion: 2.1 time: 0.168042 Jul 14 10:14:56.119817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1472/2933] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:14:55 2022] DELETE /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40/os-volume_attachments/e2caa9fe-0e51-45f8-af92-5d29e4095e00 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:14:58.283347 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=49 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:58.284418 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:58.289053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ada4ac6e-14ea-4d3a-89e5-b08c2c6a2d43 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:58.289630 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ada4ac6e-14ea-4d3a-89e5-b08c2c6a2d43 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:58.297033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada4ac6e-14ea-4d3a-89e5-b08c2c6a2d43 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:58.297480 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada4ac6e-14ea-4d3a-89e5-b08c2c6a2d43 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:58.298296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada4ac6e-14ea-4d3a-89e5-b08c2c6a2d43 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:58.299305 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ada4ac6e-14ea-4d3a-89e5-b08c2c6a2d43 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:58.325489 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ada4ac6e-14ea-4d3a-89e5-b08c2c6a2d43 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:14:58.401216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ada4ac6e-14ea-4d3a-89e5-b08c2c6a2d43 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "DELETE /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 204 len: 0 microversion: 2.1 time: 0.120308 Jul 14 10:14:58.401725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1462/2934] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:14:58 2022] DELETE /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:14:58.412479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-15107197-e67a-4430-aa00-100aff60bdc0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:58.413178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-15107197-e67a-4430-aa00-100aff60bdc0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:58.420175 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15107197-e67a-4430-aa00-100aff60bdc0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:58.420635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15107197-e67a-4430-aa00-100aff60bdc0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:58.421398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15107197-e67a-4430-aa00-100aff60bdc0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:58.421827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-15107197-e67a-4430-aa00-100aff60bdc0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:58.555722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-15107197-e67a-4430-aa00-100aff60bdc0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:58.563348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-15107197-e67a-4430-aa00-100aff60bdc0 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1512 microversion: 2.1 time: 0.155703 Jul 14 10:14:58.563920 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1473/2935] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:58 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:59.581281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7ac219a4-208d-48e9-94eb-7594989d53c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:59.581975 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7ac219a4-208d-48e9-94eb-7594989d53c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:59.588595 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ac219a4-208d-48e9-94eb-7594989d53c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:59.589037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ac219a4-208d-48e9-94eb-7594989d53c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:59.589787 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ac219a4-208d-48e9-94eb-7594989d53c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:59.590240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7ac219a4-208d-48e9-94eb-7594989d53c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:59.898863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-7ac219a4-208d-48e9-94eb-7594989d53c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:59.906249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7ac219a4-208d-48e9-94eb-7594989d53c6 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1512 microversion: 2.1 time: 0.329253 Jul 14 10:14:59.906812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1463/2936] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:59 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:00.924207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0a59dff4-ccf2-413d-a1ec-11931e7d1fe5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:00.924753 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0a59dff4-ccf2-413d-a1ec-11931e7d1fe5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:00.931475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a59dff4-ccf2-413d-a1ec-11931e7d1fe5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:00.931924 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a59dff4-ccf2-413d-a1ec-11931e7d1fe5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:00.932688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a59dff4-ccf2-413d-a1ec-11931e7d1fe5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:00.933125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a59dff4-ccf2-413d-a1ec-11931e7d1fe5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:01.062381 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0a59dff4-ccf2-413d-a1ec-11931e7d1fe5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:01.069849 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0a59dff4-ccf2-413d-a1ec-11931e7d1fe5 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1512 microversion: 2.1 time: 0.149584 Jul 14 10:15:01.070448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1474/2937] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:00 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:02.087033 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-efa32587-57a4-4609-b462-8e344681d3a1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:02.087618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-efa32587-57a4-4609-b462-8e344681d3a1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:02.093763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efa32587-57a4-4609-b462-8e344681d3a1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:02.094281 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efa32587-57a4-4609-b462-8e344681d3a1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:02.094993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efa32587-57a4-4609-b462-8e344681d3a1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:02.095989 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-efa32587-57a4-4609-b462-8e344681d3a1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:02.224866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-efa32587-57a4-4609-b462-8e344681d3a1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:02.232373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-efa32587-57a4-4609-b462-8e344681d3a1 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1512 microversion: 2.1 time: 0.149388 Jul 14 10:15:02.232933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1464/2938] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:02 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:03.249943 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9b7b11f4-64ef-4a4d-a877-4ff0aadf7849 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:03.250591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9b7b11f4-64ef-4a4d-a877-4ff0aadf7849 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:03.257644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b7b11f4-64ef-4a4d-a877-4ff0aadf7849 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:03.258095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b7b11f4-64ef-4a4d-a877-4ff0aadf7849 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:03.258896 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b7b11f4-64ef-4a4d-a877-4ff0aadf7849 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:03.259336 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9b7b11f4-64ef-4a4d-a877-4ff0aadf7849 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:03.390053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9b7b11f4-64ef-4a4d-a877-4ff0aadf7849 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:03.397742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9b7b11f4-64ef-4a4d-a877-4ff0aadf7849 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1512 microversion: 2.1 time: 0.151582 Jul 14 10:15:03.398331 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1475/2939] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:03 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:04.414473 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2e5a5425-6b3e-4f8a-8349-cfcfacad0a2a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:04.415146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2e5a5425-6b3e-4f8a-8349-cfcfacad0a2a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:04.421604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e5a5425-6b3e-4f8a-8349-cfcfacad0a2a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:04.422013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e5a5425-6b3e-4f8a-8349-cfcfacad0a2a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:04.422831 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e5a5425-6b3e-4f8a-8349-cfcfacad0a2a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:04.423266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2e5a5425-6b3e-4f8a-8349-cfcfacad0a2a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:04.561362 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2e5a5425-6b3e-4f8a-8349-cfcfacad0a2a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:04.570290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2e5a5425-6b3e-4f8a-8349-cfcfacad0a2a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1512 microversion: 2.1 time: 0.159509 Jul 14 10:15:04.570871 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1465/2940] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:04 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:05.319802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-a363acf4-ca78-4aa3-ada2-a61069846658 req-50d6dec8-a7db-4bf9-ae63-b2cbc7f86faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752982c3-14af-4fd6-9f4d-71529abc0e40", "name": "network-vif-deleted", "tag": "90195373-05dd-4e99-83f4-fbd74e13d3bd"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:05.328523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-a363acf4-ca78-4aa3-ada2-a61069846658 req-50d6dec8-a7db-4bf9-ae63-b2cbc7f86faf service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:05.328980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-a363acf4-ca78-4aa3-ada2-a61069846658 req-50d6dec8-a7db-4bf9-ae63-b2cbc7f86faf service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:05.343907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-a363acf4-ca78-4aa3-ada2-a61069846658 req-50d6dec8-a7db-4bf9-ae63-b2cbc7f86faf service nova] Creating event network-vif-deleted:90195373-05dd-4e99-83f4-fbd74e13d3bd for instance 752982c3-14af-4fd6-9f4d-71529abc0e40 on hv-cinder-82549 Jul 14 10:15:05.349535 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-a363acf4-ca78-4aa3-ada2-a61069846658 req-50d6dec8-a7db-4bf9-ae63-b2cbc7f86faf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033321 Jul 14 10:15:05.350432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1476/2941] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:05.587225 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:05.587835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:05.594688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:05.595133 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:05.596522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:05.596957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:05.627143 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:05.627587 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:05.628032 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'fault' on Instance uuid 752982c3-14af-4fd6-9f4d-71529abc0e40 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:05.669617 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:05.677121 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9f36c420-05ff-45df-93f5-3282ab32b065 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1308 microversion: 2.1 time: 0.093758 Jul 14 10:15:05.677674 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1466/2942] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:05 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:06.695653 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:06.696308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:06.702669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:06.703120 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:06.703891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:06.704322 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:06.735285 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:06.735722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:06.736751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'fault' on Instance uuid 752982c3-14af-4fd6-9f4d-71529abc0e40 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:06.776782 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:06.785183 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3cc290a1-d8f8-4ddb-be67-fe819f6ca748 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1308 microversion: 2.1 time: 0.094405 Jul 14 10:15:06.785741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1477/2943] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:06 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:07.802415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:07.803041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:07.809832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:07.810368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:07.811074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:07.811498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:07.845401 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:07.845832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:07.846319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'fault' on Instance uuid 752982c3-14af-4fd6-9f4d-71529abc0e40 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:07.890607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:07.898123 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-60c05b53-f37e-4d6e-9ce1-93be0531296a tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1308 microversion: 2.1 time: 0.100347 Jul 14 10:15:07.898704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1467/2944] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:07 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:08.915411 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:08.915952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:08.923797 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:08.924239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:08.925195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:08.925630 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:08.957705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:08.958145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:08.958614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'fault' on Instance uuid 752982c3-14af-4fd6-9f4d-71529abc0e40 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:08.998707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:09.007153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-12fca57a-d7a0-4be9-a67c-8848dd097c98 tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1308 microversion: 2.1 time: 0.095702 Jul 14 10:15:09.007717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1478/2945] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:08 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:10.025030 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:10.025660 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:10.031764 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:10.032239 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:10.032993 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:10.033429 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:10.064543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:10.065522 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:10.065965 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.objects.instance [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lazy-loading 'fault' on Instance uuid 752982c3-14af-4fd6-9f4d-71529abc0e40 {{(pid=129537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:10.105855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08962a3ebb194189b2ab68e62fee6e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf7eec88bc64cd2be062020a72563de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:10.114824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-02ef85c4-74a8-41ba-866f-f48fcd9d59cf tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 200 len: 1308 microversion: 2.1 time: 0.094417 Jul 14 10:15:10.115405 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1468/2946] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:10 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:11.132467 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:11.133075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] [instance: 752982c3-14af-4fd6-9f4d-71529abc0e40] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:11.138979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:11.139426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:11.140174 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:11.140607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:11.153960 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] HTTP exception thrown: Instance 752982c3-14af-4fd6-9f4d-71529abc0e40 could not be found. Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Request method failure captured: Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 HTTP/1.1 Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-TbCkOu4FxlwZ-c_OxLOIStpf4iGonbwNemx7QxSPddVqm-jWWKtxt2ZhQARG-ULAHyOl7sNk7p_oF-UgusOi1B6qInpialrzX5cI6xhApXBOgZThU-9vFkVH3RhsvASRdUEE8zH48P3m69js30qess-8g53kfA12Zv0pJ1lOlxkSE Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:15:11.155625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_6bf7eec88bc64cd2be062020a72563de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 6bf7eec88bc64cd2be062020a72563de Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-967264303 Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 08962a3ebb194189b2ab68e62fee6e60 Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-VolumesSnapshotTestJSON-967264303-project Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 752982c3-14af-4fd6-9f4d-71529abc0e40 could not be found. Jul 14 10:15:11.157521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '752982c3-14af-4fd6-9f4d-71529abc0e40'} Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 752982c3-14af-4fd6-9f4d-71529abc0e40 could not be found. Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:15:11.159109 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 752982c3-14af-4fd6-9f4d-71529abc0e40 could not be found. Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 752982c3-14af-4fd6-9f4d-71529abc0e40 could not be found. Jul 14 10:15:11.160878 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.162564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] Returning 404 to user: Instance 752982c3-14af-4fd6-9f4d-71529abc0e40 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:15:11.162564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-d535b91f-4558-42a2-958d-4468aa05f55e tempest-VolumesSnapshotTestJSON-967264303 tempest-VolumesSnapshotTestJSON-967264303-project] 10.222.0.40 "GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40" status: 404 len: 111 microversion: 2.1 time: 0.028641 Jul 14 10:15:11.162564 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1479/2947] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:11 2022] GET /compute/v2.1/servers/752982c3-14af-4fd6-9f4d-71529abc0e40 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:16:18.349963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:16:18.350848 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:16:28.276719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:16:28.277308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:16:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:16:28.567291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:16:28.567798 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:16:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:17:19.529619 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e21697ee-567a-42d2-b54d-7facf68bf57e] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 10:17:19.530390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:19.531000 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:19.535538 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b1e275ff-6ec0-4d0d-b0a4-9286164ca255 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:19.536219 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b1e275ff-6ec0-4d0d-b0a4-9286164ca255 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:19.546274 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1e275ff-6ec0-4d0d-b0a4-9286164ca255 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:19.546723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1e275ff-6ec0-4d0d-b0a4-9286164ca255 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:19.547484 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1e275ff-6ec0-4d0d-b0a4-9286164ca255 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:19.547915 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b1e275ff-6ec0-4d0d-b0a4-9286164ca255 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:19.572722 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b1e275ff-6ec0-4d0d-b0a4-9286164ca255 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/ips" status: 200 len: 147 microversion: 2.1 time: 0.045161 Jul 14 10:17:19.573277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1469/2948] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 10:17:19 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/ips => generated 147 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:20.878240 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de5f935d-60fa-4e21-924a-01eba6b6d466] AMQP server on 10.222.0.40:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 10:17:20.878810 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=20 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:20.879567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:20.883633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2759374b-ef38-4667-a90e-a32bf523043c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ca0c99b-c175-421b-8a4b-eb3b1d93e2c4"}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:20.884711 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2759374b-ef38-4667-a90e-a32bf523043c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:20.892845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2759374b-ef38-4667-a90e-a32bf523043c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:20.893295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2759374b-ef38-4667-a90e-a32bf523043c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:20.894054 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2759374b-ef38-4667-a90e-a32bf523043c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:20.894519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2759374b-ef38-4667-a90e-a32bf523043c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:21.082325 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2ecb783c-8956-4598-b562-b7d459e6cdeb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:21.082917 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2ecb783c-8956-4598-b562-b7d459e6cdeb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:21.091445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ecb783c-8956-4598-b562-b7d459e6cdeb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:21.092185 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ecb783c-8956-4598-b562-b7d459e6cdeb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:21.093578 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ecb783c-8956-4598-b562-b7d459e6cdeb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:21.094246 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ecb783c-8956-4598-b562-b7d459e6cdeb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:21.099425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] [e21697ee-567a-42d2-b54d-7facf68bf57e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 60318. Jul 14 10:17:21.120084 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2ecb783c-8956-4598-b562-b7d459e6cdeb tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/ips" status: 200 len: 151 microversion: 2.1 time: 0.041677 Jul 14 10:17:21.120650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1470/2949] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 10:17:21 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:17:21.885504 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] [de5f935d-60fa-4e21-924a-01eba6b6d466] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 60328. Jul 14 10:17:21.999133 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2759374b-ef38-4667-a90e-a32bf523043c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.122458 Jul 14 10:17:21.999731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1480/2950] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 10:17:20 2022] POST /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments => generated 194 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:22.444103 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-17f2e080-466b-48ad-8c09-139fce0dd46a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67f2d50a-4f70-46ba-b279-cf756c099818"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:22.445220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-17f2e080-466b-48ad-8c09-139fce0dd46a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:22.451768 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17f2e080-466b-48ad-8c09-139fce0dd46a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:22.452215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17f2e080-466b-48ad-8c09-139fce0dd46a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:22.452966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17f2e080-466b-48ad-8c09-139fce0dd46a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:22.453400 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17f2e080-466b-48ad-8c09-139fce0dd46a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:22.767994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-17f2e080-466b-48ad-8c09-139fce0dd46a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327716 Jul 14 10:17:22.778475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1471/2951] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 10:17:22 2022] POST /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:29.481657 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-8ce7ffe2-2007-4bda-9bbe-4d4a04a1a5d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:29.482762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-8ce7ffe2-2007-4bda-9bbe-4d4a04a1a5d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:29.489436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ce7ffe2-2007-4bda-9bbe-4d4a04a1a5d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:29.489889 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ce7ffe2-2007-4bda-9bbe-4d4a04a1a5d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:29.490684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ce7ffe2-2007-4bda-9bbe-4d4a04a1a5d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:29.491237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-8ce7ffe2-2007-4bda-9bbe-4d4a04a1a5d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:29.520689 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-8ce7ffe2-2007-4bda-9bbe-4d4a04a1a5d7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Jul 14 10:17:29.521244 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1481/2952] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:29 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:29.532704 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-af00a757-ca10-41ef-8e5e-12eece63209a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:29.533410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-af00a757-ca10-41ef-8e5e-12eece63209a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:29.540330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af00a757-ca10-41ef-8e5e-12eece63209a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:29.540781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af00a757-ca10-41ef-8e5e-12eece63209a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:29.541542 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af00a757-ca10-41ef-8e5e-12eece63209a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:29.541983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-af00a757-ca10-41ef-8e5e-12eece63209a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:29.570028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-af00a757-ca10-41ef-8e5e-12eece63209a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/3ca0c99b-c175-421b-8a4b-eb3b1d93e2c4" status: 200 len: 194 microversion: 2.1 time: 0.042798 Jul 14 10:17:29.570634 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1472/2953] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jul 14 10:17:29 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/3ca0c99b-c175-421b-8a4b-eb3b1d93e2c4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:30.879805 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c2d0adff-d4d5-4430-bc83-aeb89c5e6271 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9c0e6b5-68a6-48fe-866e-83bc4668bd13"}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:30.880859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c2d0adff-d4d5-4430-bc83-aeb89c5e6271 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:30.887484 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2d0adff-d4d5-4430-bc83-aeb89c5e6271 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:30.887929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2d0adff-d4d5-4430-bc83-aeb89c5e6271 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:30.888681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2d0adff-d4d5-4430-bc83-aeb89c5e6271 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:30.889115 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c2d0adff-d4d5-4430-bc83-aeb89c5e6271 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:31.136121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c2d0adff-d4d5-4430-bc83-aeb89c5e6271 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "POST /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260084 Jul 14 10:17:31.136717 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1482/2954] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 10:17:30 2022] POST /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:36.562761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67f2d50a-4f70-46ba-b279-cf756c099818"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:36.563801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:36.570282 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:36.570730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:36.571471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:36.571894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:36.649900 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Invalid volume: volume 67f2d50a-4f70-46ba-b279-cf756c099818 is already attached to instances: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: POST /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments HTTP/1.1 Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 74 Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:17:36.651671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {"volumeAttachment": {"volumeId": "67f2d50a-4f70-46ba-b279-cf756c099818"}} Jul 14 10:17:36.653521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Invalid volume: volume 67f2d50a-4f70-46ba-b279-cf756c099818 is already attached to instances: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'server_id': 'ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9', 'body': {'volumeAttachment': {'volumeId': '67f2d50a-4f70-46ba-b279-cf756c099818'}}} Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 67f2d50a-4f70-46ba-b279-cf756c099818 is already attached to instances: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:36.654810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 67f2d50a-4f70-46ba-b279-cf756c099818 is already attached to instances: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:36.656759 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:36.658523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:36.658523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:17:36.658523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:17:36.658523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 67f2d50a-4f70-46ba-b279-cf756c099818 is already attached to instances: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 Jul 14 10:17:36.658523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:36.658523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 400 to user: Invalid volume: volume 67f2d50a-4f70-46ba-b279-cf756c099818 is already attached to instances: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:17:36.658523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ef9784c6-5548-462f-b890-9e39bc86685b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094621 Jul 14 10:17:36.658523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1473/2955] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 10:17:36 2022] POST /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:17:36.713062 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3f4b8a1a-84b0-49ac-b938-e9fafaf76fe5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:36.713640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3f4b8a1a-84b0-49ac-b938-e9fafaf76fe5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:36.719871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f4b8a1a-84b0-49ac-b938-e9fafaf76fe5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:36.720321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f4b8a1a-84b0-49ac-b938-e9fafaf76fe5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:36.721080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f4b8a1a-84b0-49ac-b938-e9fafaf76fe5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:36.721519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3f4b8a1a-84b0-49ac-b938-e9fafaf76fe5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:36.799238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-3f4b8a1a-84b0-49ac-b938-e9fafaf76fe5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:17:36.869072 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3f4b8a1a-84b0-49ac-b938-e9fafaf76fe5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments/67f2d50a-4f70-46ba-b279-cf756c099818" status: 202 len: 0 microversion: 2.1 time: 0.160710 Jul 14 10:17:36.869649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1483/2956] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:17:36 2022] DELETE /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments/67f2d50a-4f70-46ba-b279-cf756c099818 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:17:36.878485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b4711475-71ea-459b-94aa-91cb679c5eb5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:36.879409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b4711475-71ea-459b-94aa-91cb679c5eb5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:36.885935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4711475-71ea-459b-94aa-91cb679c5eb5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:36.886510 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4711475-71ea-459b-94aa-91cb679c5eb5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:36.887420 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4711475-71ea-459b-94aa-91cb679c5eb5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:36.887892 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b4711475-71ea-459b-94aa-91cb679c5eb5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:36.918351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b4711475-71ea-459b-94aa-91cb679c5eb5 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Jul 14 10:17:36.918914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1474/2957] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:36 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:37.931033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-44877b47-861a-4a3c-946d-a3b4d4684c8d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:37.932105 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-44877b47-861a-4a3c-946d-a3b4d4684c8d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:37.938637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-44877b47-861a-4a3c-946d-a3b4d4684c8d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:37.939087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-44877b47-861a-4a3c-946d-a3b4d4684c8d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:37.939841 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-44877b47-861a-4a3c-946d-a3b4d4684c8d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:37.940307 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-44877b47-861a-4a3c-946d-a3b4d4684c8d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:37.969368 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-44877b47-861a-4a3c-946d-a3b4d4684c8d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043210 Jul 14 10:17:37.969909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1484/2958] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:37 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:38.980743 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-75b99aef-84e9-44e6-93e6-a7ed48ecc31c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:38.981668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-75b99aef-84e9-44e6-93e6-a7ed48ecc31c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:38.988868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75b99aef-84e9-44e6-93e6-a7ed48ecc31c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:38.989312 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75b99aef-84e9-44e6-93e6-a7ed48ecc31c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:38.990067 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75b99aef-84e9-44e6-93e6-a7ed48ecc31c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:38.990521 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-75b99aef-84e9-44e6-93e6-a7ed48ecc31c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:39.018041 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-75b99aef-84e9-44e6-93e6-a7ed48ecc31c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041302 Jul 14 10:17:39.018687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1475/2959] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:38 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:40.029776 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-faed25ba-df3e-45a5-8222-1f27b157c0bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:40.030740 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-faed25ba-df3e-45a5-8222-1f27b157c0bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:40.037410 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-faed25ba-df3e-45a5-8222-1f27b157c0bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:40.037891 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-faed25ba-df3e-45a5-8222-1f27b157c0bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:40.038812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-faed25ba-df3e-45a5-8222-1f27b157c0bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:40.039251 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-faed25ba-df3e-45a5-8222-1f27b157c0bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:40.068905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-faed25ba-df3e-45a5-8222-1f27b157c0bf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043066 Jul 14 10:17:40.069447 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1485/2960] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:40 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:17:41.080999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2aae7de1-df1f-4cc0-b811-f3d01c22d2a4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:41.081943 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2aae7de1-df1f-4cc0-b811-f3d01c22d2a4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:41.088471 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2aae7de1-df1f-4cc0-b811-f3d01c22d2a4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:41.088921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2aae7de1-df1f-4cc0-b811-f3d01c22d2a4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:41.089668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2aae7de1-df1f-4cc0-b811-f3d01c22d2a4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:41.090098 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2aae7de1-df1f-4cc0-b811-f3d01c22d2a4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:41.118782 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2aae7de1-df1f-4cc0-b811-f3d01c22d2a4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042199 Jul 14 10:17:41.119317 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1476/2961] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:41 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:42.130993 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-81de0ab8-c1b6-47a4-9672-13726b5328cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:42.132023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-81de0ab8-c1b6-47a4-9672-13726b5328cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:42.138639 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81de0ab8-c1b6-47a4-9672-13726b5328cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:42.139087 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81de0ab8-c1b6-47a4-9672-13726b5328cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:42.139908 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81de0ab8-c1b6-47a4-9672-13726b5328cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:42.140872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81de0ab8-c1b6-47a4-9672-13726b5328cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:42.168936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-81de0ab8-c1b6-47a4-9672-13726b5328cf tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 Jul 14 10:17:42.169481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1486/2962] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:42 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:43.180677 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9699cafd-a3df-44f7-9302-03764effd5b0 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:43.181650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9699cafd-a3df-44f7-9302-03764effd5b0 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:43.188465 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9699cafd-a3df-44f7-9302-03764effd5b0 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:43.188912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9699cafd-a3df-44f7-9302-03764effd5b0 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:43.189690 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9699cafd-a3df-44f7-9302-03764effd5b0 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:43.190120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9699cafd-a3df-44f7-9302-03764effd5b0 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:43.220548 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9699cafd-a3df-44f7-9302-03764effd5b0 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Jul 14 10:17:43.221106 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1477/2963] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:43 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:43.875702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-56dd09cf-3dfe-40ec-b10f-1527800f30d4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:43.876618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-56dd09cf-3dfe-40ec-b10f-1527800f30d4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:43.883006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56dd09cf-3dfe-40ec-b10f-1527800f30d4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:43.883454 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56dd09cf-3dfe-40ec-b10f-1527800f30d4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:43.884206 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56dd09cf-3dfe-40ec-b10f-1527800f30d4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:43.884643 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-56dd09cf-3dfe-40ec-b10f-1527800f30d4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:43.912940 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-56dd09cf-3dfe-40ec-b10f-1527800f30d4 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041687 Jul 14 10:17:43.913479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1487/2964] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:43 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:44.057600 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1bfd51cc-37e4-4f24-b018-1b294bf831dd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:44.058008 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1bfd51cc-37e4-4f24-b018-1b294bf831dd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:44.064888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bfd51cc-37e4-4f24-b018-1b294bf831dd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.065322 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bfd51cc-37e4-4f24-b018-1b294bf831dd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.066062 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bfd51cc-37e4-4f24-b018-1b294bf831dd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.066523 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1bfd51cc-37e4-4f24-b018-1b294bf831dd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.094195 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1bfd51cc-37e4-4f24-b018-1b294bf831dd tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/3ca0c99b-c175-421b-8a4b-eb3b1d93e2c4" status: 200 len: 194 microversion: 2.1 time: 0.040722 Jul 14 10:17:44.094776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1478/2965] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jul 14 10:17:44 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/3ca0c99b-c175-421b-8a4b-eb3b1d93e2c4 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:44.104436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b40972b2-02ed-49ad-beba-6447609c01fa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:44.104955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b40972b2-02ed-49ad-beba-6447609c01fa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:44.111668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b40972b2-02ed-49ad-beba-6447609c01fa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.112129 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b40972b2-02ed-49ad-beba-6447609c01fa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.112886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b40972b2-02ed-49ad-beba-6447609c01fa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.113330 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b40972b2-02ed-49ad-beba-6447609c01fa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.193988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-b40972b2-02ed-49ad-beba-6447609c01fa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lazy-loading 'services' on Instance uuid d1cd8bd5-5679-49fd-b8f0-6af3ef428875 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:17:44.231815 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-63ae9e25-bb56-47ea-822e-f3d2c19099dd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:44.232773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-63ae9e25-bb56-47ea-822e-f3d2c19099dd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:44.239950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63ae9e25-bb56-47ea-822e-f3d2c19099dd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.240394 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63ae9e25-bb56-47ea-822e-f3d2c19099dd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.241182 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63ae9e25-bb56-47ea-822e-f3d2c19099dd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.241616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-63ae9e25-bb56-47ea-822e-f3d2c19099dd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.264428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b40972b2-02ed-49ad-beba-6447609c01fa tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/3ca0c99b-c175-421b-8a4b-eb3b1d93e2c4" status: 202 len: 0 microversion: 2.1 time: 0.163709 Jul 14 10:17:44.265107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1488/2966] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:17:44 2022] DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/3ca0c99b-c175-421b-8a4b-eb3b1d93e2c4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:17:44.271086 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-63ae9e25-bb56-47ea-822e-f3d2c19099dd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043173 Jul 14 10:17:44.271643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1479/2967] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:44 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 10:17:44.331860 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-110e1af5-d978-41ae-9b06-2aa53a927a5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:44.332448 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-110e1af5-d978-41ae-9b06-2aa53a927a5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:44.339010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-110e1af5-d978-41ae-9b06-2aa53a927a5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.339458 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-110e1af5-d978-41ae-9b06-2aa53a927a5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.340215 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-110e1af5-d978-41ae-9b06-2aa53a927a5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.340634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-110e1af5-d978-41ae-9b06-2aa53a927a5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.369112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-110e1af5-d978-41ae-9b06-2aa53a927a5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:17:44.446978 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-110e1af5-d978-41ae-9b06-2aa53a927a5d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 204 len: 0 microversion: 2.1 time: 0.119110 Jul 14 10:17:44.447713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1489/2968] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:17:44 2022] DELETE /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:17:44.456214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fcfa6feb-c0a4-463f-8c13-20818b856ef4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:44.456865 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fcfa6feb-c0a4-463f-8c13-20818b856ef4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:44.463646 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcfa6feb-c0a4-463f-8c13-20818b856ef4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.464077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcfa6feb-c0a4-463f-8c13-20818b856ef4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.464817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcfa6feb-c0a4-463f-8c13-20818b856ef4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.465241 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcfa6feb-c0a4-463f-8c13-20818b856ef4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.591957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-fcfa6feb-c0a4-463f-8c13-20818b856ef4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:44.599973 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fcfa6feb-c0a4-463f-8c13-20818b856ef4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1680 microversion: 2.1 time: 0.148104 Jul 14 10:17:44.600540 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1480/2969] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:44 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:45.617550 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9272d40d-7024-4729-85de-04018886fded tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:45.618201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9272d40d-7024-4729-85de-04018886fded tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:45.624663 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9272d40d-7024-4729-85de-04018886fded tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:45.625107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9272d40d-7024-4729-85de-04018886fded tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:45.625851 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9272d40d-7024-4729-85de-04018886fded tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:45.626304 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9272d40d-7024-4729-85de-04018886fded tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:45.752703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-9272d40d-7024-4729-85de-04018886fded tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:45.756262 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:45.761045 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9272d40d-7024-4729-85de-04018886fded tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1680 microversion: 2.1 time: 0.147777 Jul 14 10:17:45.761597 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1490/2970] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:45 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:46.777821 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-59359e12-14ee-4791-adbe-dedd88ee699f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:46.778842 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-59359e12-14ee-4791-adbe-dedd88ee699f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:46.785358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59359e12-14ee-4791-adbe-dedd88ee699f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:46.785888 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59359e12-14ee-4791-adbe-dedd88ee699f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:46.787426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59359e12-14ee-4791-adbe-dedd88ee699f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:46.787426 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59359e12-14ee-4791-adbe-dedd88ee699f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:47.184174 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-59359e12-14ee-4791-adbe-dedd88ee699f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:47.191875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-59359e12-14ee-4791-adbe-dedd88ee699f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 200 len: 1680 microversion: 2.1 time: 0.417899 Jul 14 10:17:47.192443 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1481/2971] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:46 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 1680 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:47.486872 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-bd1ae8e7-974b-4524-83a4-0a72720f2f2a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:47.487435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-bd1ae8e7-974b-4524-83a4-0a72720f2f2a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:47.494436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd1ae8e7-974b-4524-83a4-0a72720f2f2a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:47.494967 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd1ae8e7-974b-4524-83a4-0a72720f2f2a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:47.495800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd1ae8e7-974b-4524-83a4-0a72720f2f2a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:47.496308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-bd1ae8e7-974b-4524-83a4-0a72720f2f2a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:47.532756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-bd1ae8e7-974b-4524-83a4-0a72720f2f2a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/d9c0e6b5-68a6-48fe-866e-83bc4668bd13" status: 200 len: 194 microversion: 2.1 time: 0.049688 Jul 14 10:17:47.533353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1491/2972] 10.222.0.40 () {58 vars in 1412 bytes} [Thu Jul 14 10:17:47 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/d9c0e6b5-68a6-48fe-866e-83bc4668bd13 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:47.543649 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1550f0fc-200e-48fb-adb2-7047374ab6ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:47.544195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1550f0fc-200e-48fb-adb2-7047374ab6ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:47.554303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1550f0fc-200e-48fb-adb2-7047374ab6ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:47.554754 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1550f0fc-200e-48fb-adb2-7047374ab6ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:47.555729 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1550f0fc-200e-48fb-adb2-7047374ab6ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:47.556314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-1550f0fc-200e-48fb-adb2-7047374ab6ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:47.608909 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-ed3ac7f4-09b1-40b6-8b19-749b38f1022f req-4e581725-72a8-4c58-8f51-4109c7b2814e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9", "name": "network-vif-deleted", "tag": "f4baff3e-3caa-4f28-860b-fca366386896"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:47.621570 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-ed3ac7f4-09b1-40b6-8b19-749b38f1022f req-4e581725-72a8-4c58-8f51-4109c7b2814e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:47.622009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-ed3ac7f4-09b1-40b6-8b19-749b38f1022f req-4e581725-72a8-4c58-8f51-4109c7b2814e service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:47.641109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-ed3ac7f4-09b1-40b6-8b19-749b38f1022f req-4e581725-72a8-4c58-8f51-4109c7b2814e service nova] Creating event network-vif-deleted:f4baff3e-3caa-4f28-860b-fca366386896 for instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 on hv-cinder-82549 Jul 14 10:17:47.650003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-ed3ac7f4-09b1-40b6-8b19-749b38f1022f req-4e581725-72a8-4c58-8f51-4109c7b2814e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130206 Jul 14 10:17:47.651930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1482/2973] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:17:47.674677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-1550f0fc-200e-48fb-adb2-7047374ab6ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lazy-loading 'services' on Instance uuid d1cd8bd5-5679-49fd-b8f0-6af3ef428875 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:17:47.768418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1550f0fc-200e-48fb-adb2-7047374ab6ae tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/d9c0e6b5-68a6-48fe-866e-83bc4668bd13" status: 202 len: 0 microversion: 2.1 time: 0.228562 Jul 14 10:17:47.769520 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1492/2974] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:17:47 2022] DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments/d9c0e6b5-68a6-48fe-866e-83bc4668bd13 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 10:17:48.209805 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:48.210528 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:48.216906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:48.217344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:48.218205 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:48.218636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:48.232154 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 HTTP/1.1 Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:17:48.234374 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:17:48.236231 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9'} Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:17:48.237277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:17:48.239013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:48.241390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:17:48.242259 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-375694c1-bfca-4a93-b98f-86ace9f461a8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 404 len: 111 microversion: 2.1 time: 0.037112 Jul 14 10:17:48.242817 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1483/2975] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:48 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:17:48.252440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c288ea9f-bf70-4507-85b0-74595dcb689c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '.version_select at 0x7f7da1e40ee0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:48.273670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c288ea9f-bf70-4507-85b0-74595dcb689c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-271176762" status: 202 len: 0 microversion: 2.1 time: 0.025893 Jul 14 10:17:48.274317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1493/2976] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 10:17:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-271176762 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:17:48.917346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7e3f7fa3-915c-4396-bbee-0bca99f2a033 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: .version_select at 0x7f7da1e7be50>, body: {"keypair": {"name": "tempest-keypair-565318504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNBjAzUyStY55EPI+IueAKAYMoFTJabCsPPVDzXLtvT6oerOjzw/u/68MQ8M/o+wZWwf/XrMBtLhKZ02b6NqANFEjXIenLOfLN+MPHVbHX5SRis2X5mqiK4hFETSBeS/g=="}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:48.940844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-7e3f7fa3-915c-4396-bbee-0bca99f2a033 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:17:48.943506 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-5b8a17ad-2667-4642-8498-ed0fe71fec36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:48.944595 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-5b8a17ad-2667-4642-8498-ed0fe71fec36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:48.945399 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-7e3f7fa3-915c-4396-bbee-0bca99f2a033 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for user 1d7ae3d2f56a491baf26a83a34d86ccf and project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:17:48.953300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b8a17ad-2667-4642-8498-ed0fe71fec36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:48.953879 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b8a17ad-2667-4642-8498-ed0fe71fec36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:48.954778 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b8a17ad-2667-4642-8498-ed0fe71fec36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:48.955416 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-5b8a17ad-2667-4642-8498-ed0fe71fec36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:48.973930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7e3f7fa3-915c-4396-bbee-0bca99f2a033 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060276 Jul 14 10:17:48.974568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1484/2977] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 10:17:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:48.988412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-5b8a17ad-2667-4642-8498-ed0fe71fec36 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051227 Jul 14 10:17:48.988969 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1494/2978] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:48 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 10:17:49.096968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fd893846-bb45-4545-ad14-ce6485fc0f47 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:49.097991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fd893846-bb45-4545-ad14-ce6485fc0f47 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:49.105207 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fd893846-bb45-4545-ad14-ce6485fc0f47 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.106009 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fd893846-bb45-4545-ad14-ce6485fc0f47 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.106968 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fd893846-bb45-4545-ad14-ce6485fc0f47 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.107645 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fd893846-bb45-4545-ad14-ce6485fc0f47 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.139273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fd893846-bb45-4545-ad14-ce6485fc0f47 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046764 Jul 14 10:17:49.140785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1485/2979] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:17:49 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:17:49.199585 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b5cc6cd3-ceba-4dbe-8446-6624638cfd45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:49.200086 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b5cc6cd3-ceba-4dbe-8446-6624638cfd45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:49.207569 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5cc6cd3-ceba-4dbe-8446-6624638cfd45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.208071 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5cc6cd3-ceba-4dbe-8446-6624638cfd45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.208848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5cc6cd3-ceba-4dbe-8446-6624638cfd45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.209290 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-b5cc6cd3-ceba-4dbe-8446-6624638cfd45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.236219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-b5cc6cd3-ceba-4dbe-8446-6624638cfd45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:17:49.313917 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b5cc6cd3-ceba-4dbe-8446-6624638cfd45 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 204 len: 0 microversion: 2.1 time: 0.117667 Jul 14 10:17:49.314549 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1495/2980] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:17:49 2022] DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:17:49.323330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-be292bfa-8639-465c-8955-e61da366ad5a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:49.323937 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-be292bfa-8639-465c-8955-e61da366ad5a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:49.331129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be292bfa-8639-465c-8955-e61da366ad5a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.331575 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be292bfa-8639-465c-8955-e61da366ad5a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.332368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be292bfa-8639-465c-8955-e61da366ad5a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.332899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-be292bfa-8639-465c-8955-e61da366ad5a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.470560 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-be292bfa-8639-465c-8955-e61da366ad5a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:49.477956 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-be292bfa-8639-465c-8955-e61da366ad5a tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1675 microversion: 2.1 time: 0.158827 Jul 14 10:17:49.478543 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1486/2981] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:49 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:50.260807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-248112079", "imageRef": "a001d6b7-551f-493b-88c9-53b3a0c8056e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9dc9a66-299f-4d37-a369-9dec401232c3"}], "security_groups": [{"name": "tempest-securitygroup--1191051774"}], "key_name": "tempest-keypair-565318504", "user_data": "}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:50.363066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] validate_networks() for [('b9dc9a66-299f-4d37-a369-9dec401232c3', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:17:50.495061 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6a760bc4-bde2-4f9c-88c1-58d8faf30f71 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:50.495751 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6a760bc4-bde2-4f9c-88c1-58d8faf30f71 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:50.498242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:50.503795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a760bc4-bde2-4f9c-88c1-58d8faf30f71 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.504329 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a760bc4-bde2-4f9c-88c1-58d8faf30f71 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.505168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a760bc4-bde2-4f9c-88c1-58d8faf30f71 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.505697 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a760bc4-bde2-4f9c-88c1-58d8faf30f71 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.510835 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:50.853375 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6a760bc4-bde2-4f9c-88c1-58d8faf30f71 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:50.860894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6a760bc4-bde2-4f9c-88c1-58d8faf30f71 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1675 microversion: 2.1 time: 0.369781 Jul 14 10:17:50.861461 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1487/2982] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:50 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1675 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:17:50.871122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:17:50.871538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:17:50.872181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:17:50.872584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:17:50.872990 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:17:50.882274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.882719 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.883498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.883928 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.895724 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:50.902815 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:17:50.908024 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Getting quotas for user 1d7ae3d2f56a491baf26a83a34d86ccf and project 52acfca03c3e45cfb2e8d3d4f391b281. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:17:50.919677 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:17:50.922017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a001d6b7-551f-493b-88c9-53b3a0c8056e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:17:50.970632 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4b2d1992-22cb-431a-b466-72ee8f80c759 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.714455 Jul 14 10:17:50.971278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1496/2983] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 10:17:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:17:51.034358 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-304a3645-ca2e-4075-b1d9-3821f48ffe6a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:51.034977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-304a3645-ca2e-4075-b1d9-3821f48ffe6a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:51.089981 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-304a3645-ca2e-4075-b1d9-3821f48ffe6a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:51.096679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-304a3645-ca2e-4075-b1d9-3821f48ffe6a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1240 microversion: 2.1 time: 0.119392 Jul 14 10:17:51.097244 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1488/2984] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:50 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:51.878334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-34b388f1-276a-469d-8e9a-e97eeadad358 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:51.878945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-34b388f1-276a-469d-8e9a-e97eeadad358 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:51.887508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34b388f1-276a-469d-8e9a-e97eeadad358 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:51.887953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34b388f1-276a-469d-8e9a-e97eeadad358 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:51.888707 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34b388f1-276a-469d-8e9a-e97eeadad358 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:51.889136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-34b388f1-276a-469d-8e9a-e97eeadad358 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:52.047712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-34b388f1-276a-469d-8e9a-e97eeadad358 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688f473972144fb6b7a398c1f775a5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140620648e604251bc9c5c1a0e9c483b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:52.071279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-34b388f1-276a-469d-8e9a-e97eeadad358 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 200 len: 1675 microversion: 2.1 time: 0.197160 Jul 14 10:17:52.071884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1497/2985] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:51 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:52.112905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-60d0b300-4e9a-4918-a72c-8af2ef626056 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:52.115773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-60d0b300-4e9a-4918-a72c-8af2ef626056 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:52.125212 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60d0b300-4e9a-4918-a72c-8af2ef626056 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:52.125940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60d0b300-4e9a-4918-a72c-8af2ef626056 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:52.127854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60d0b300-4e9a-4918-a72c-8af2ef626056 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:52.129115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-60d0b300-4e9a-4918-a72c-8af2ef626056 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:52.214580 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-60d0b300-4e9a-4918-a72c-8af2ef626056 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:52.223264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-60d0b300-4e9a-4918-a72c-8af2ef626056 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1310 microversion: 2.1 time: 0.114261 Jul 14 10:17:52.223902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1489/2986] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:52 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1310 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:52.347578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-3401a7dd-9483-4da2-a0ec-ee7531bc3f88 req-79ceb569-0c98-457d-86fe-5e26c407c8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cd8bd5-5679-49fd-b8f0-6af3ef428875", "name": "network-vif-deleted", "tag": "49829aea-09a7-4c91-805e-d385763e6d9b"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:52.356601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-3401a7dd-9483-4da2-a0ec-ee7531bc3f88 req-79ceb569-0c98-457d-86fe-5e26c407c8e2 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:52.357404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-3401a7dd-9483-4da2-a0ec-ee7531bc3f88 req-79ceb569-0c98-457d-86fe-5e26c407c8e2 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:52.373699 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-3401a7dd-9483-4da2-a0ec-ee7531bc3f88 req-79ceb569-0c98-457d-86fe-5e26c407c8e2 service nova] Creating event network-vif-deleted:49829aea-09a7-4c91-805e-d385763e6d9b for instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 on hv-cinder-82549 Jul 14 10:17:52.381121 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-3401a7dd-9483-4da2-a0ec-ee7531bc3f88 req-79ceb569-0c98-457d-86fe-5e26c407c8e2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039239 Jul 14 10:17:52.386773 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1498/2987] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:53.089686 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:53.090385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:53.099172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.099953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:53.101141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.101797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:53.119906 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] HTTP exception thrown: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Request method failure captured: Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 HTTP/1.1 Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P16GWuyqSuDY7ApG-mgPPjgP297ucssya2XQUHbHO5L48ShM0tgM_aa0glxfTBBjpaxdxtloMLxfF9ycWwy4hBXtqiaxqMivpiQuCnYWNA-8pppTmSpHjuzgPpbhbjjkbA1yYjMHMJMfNvrjc7x-vci7kZ-DMDlMd3nmq_wcriVwU Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:17:53.122214 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 688f473972144fb6b7a398c1f775a5c1 Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:53.123957 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'd1cd8bd5-5679-49fd-b8f0-6af3ef428875'} Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:17:53.124950 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:53.126592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:53.129832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Returning 404 to user: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:17:53.130747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3e018fa0-3d09-4dcf-869b-7387ffc83fa7 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 404 len: 111 microversion: 2.1 time: 0.045773 Jul 14 10:17:53.131383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1490/2988] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:53 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:17:53.140313 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-b783bbd0-db63-42fe-a71e-46eebb50862e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '.version_select at 0x7f7da651fca0>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:53.159167 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-b783bbd0-db63-42fe-a71e-46eebb50862e tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813994688" status: 202 len: 0 microversion: 2.1 time: 0.023025 Jul 14 10:17:53.160242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1499/2989] 10.222.0.40 () {58 vars in 1220 bytes} [Thu Jul 14 10:17:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813994688 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:17:53.240760 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1128a242-88dc-4212-b31f-57521bfa1e35 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:53.241897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1128a242-88dc-4212-b31f-57521bfa1e35 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:53.252556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1128a242-88dc-4212-b31f-57521bfa1e35 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.253018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1128a242-88dc-4212-b31f-57521bfa1e35 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:53.253803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1128a242-88dc-4212-b31f-57521bfa1e35 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.254940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1128a242-88dc-4212-b31f-57521bfa1e35 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:53.478758 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1128a242-88dc-4212-b31f-57521bfa1e35 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:53.492546 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1128a242-88dc-4212-b31f-57521bfa1e35 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.255554 Jul 14 10:17:53.503614 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1491/2990] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:53 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:53.728883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-f9baa7df-4c36-4da0-aaf6-4efcbae65eaf req-2b5c1cbf-ab87-4372-8481-164e0a22442c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1b9074-afd6-4872-af6e-d6511494d355", "tag": "f5c5adad-f87c-4c6c-888f-e46762c10405"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:53.756869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-f9baa7df-4c36-4da0-aaf6-4efcbae65eaf req-2b5c1cbf-ab87-4372-8481-164e0a22442c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.757702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-f9baa7df-4c36-4da0-aaf6-4efcbae65eaf req-2b5c1cbf-ab87-4372-8481-164e0a22442c service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:53.772460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-f9baa7df-4c36-4da0-aaf6-4efcbae65eaf req-2b5c1cbf-ab87-4372-8481-164e0a22442c service nova] Creating event network-changed:f5c5adad-f87c-4c6c-888f-e46762c10405 for instance 0f1b9074-afd6-4872-af6e-d6511494d355 on hv-cinder-82549 Jul 14 10:17:53.778827 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-f9baa7df-4c36-4da0-aaf6-4efcbae65eaf req-2b5c1cbf-ab87-4372-8481-164e0a22442c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054650 Jul 14 10:17:53.780423 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1500/2991] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:54.510024 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-50cca4e1-555d-4055-8f2e-cd52c782f4f9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:54.510618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-50cca4e1-555d-4055-8f2e-cd52c782f4f9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:54.517064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50cca4e1-555d-4055-8f2e-cd52c782f4f9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:54.517500 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50cca4e1-555d-4055-8f2e-cd52c782f4f9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:54.518273 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50cca4e1-555d-4055-8f2e-cd52c782f4f9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:54.518700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-50cca4e1-555d-4055-8f2e-cd52c782f4f9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:54.652343 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-50cca4e1-555d-4055-8f2e-cd52c782f4f9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:54.660165 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-50cca4e1-555d-4055-8f2e-cd52c782f4f9 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.154124 Jul 14 10:17:54.660716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1492/2992] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:54 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:55.677402 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-cc0cc3b1-7758-4954-961f-d7780ecb9169 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:55.678095 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-cc0cc3b1-7758-4954-961f-d7780ecb9169 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:55.684909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc0cc3b1-7758-4954-961f-d7780ecb9169 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:55.685335 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc0cc3b1-7758-4954-961f-d7780ecb9169 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:55.686382 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc0cc3b1-7758-4954-961f-d7780ecb9169 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:55.686812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-cc0cc3b1-7758-4954-961f-d7780ecb9169 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:55.813027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-cc0cc3b1-7758-4954-961f-d7780ecb9169 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:55.820485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-cc0cc3b1-7758-4954-961f-d7780ecb9169 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.147369 Jul 14 10:17:55.821038 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1501/2993] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:55 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:56.178552 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:56.179100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:56.185463 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.186161 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.186961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.187391 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.200379 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] HTTP exception thrown: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Request method failure captured: Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 HTTP/1.1 Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P16GWuyqSuDY7ApG-mgPPjgP297ucssya2XQUHbHO5L48ShM0tgM_aa0glxfTBBjpaxdxtloMLxfF9ycWwy4hBXtqiaxqMivpiQuCnYWNA-8pppTmSpHjuzgPpbhbjjkbA1yYjMHMJMfNvrjc7x-vci7kZ-DMDlMd3nmq_wcriVwU Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:17:56.201878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 688f473972144fb6b7a398c1f775a5c1 Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.203688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'd1cd8bd5-5679-49fd-b8f0-6af3ef428875'} Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:17:56.204855 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.206797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.208607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Returning 404 to user: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:17:56.208607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4bae6231-8606-4a7d-aba3-a30858d5b4ea tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 404 len: 111 microversion: 2.1 time: 0.028608 Jul 14 10:17:56.208607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1493/2994] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:17:56 2022] DELETE /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:17:56.213755 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:56.214398 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: d1cd8bd5-5679-49fd-b8f0-6af3ef428875] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:56.220883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.221334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.222094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.222601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.236234 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] HTTP exception thrown: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Request method failure captured: Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 HTTP/1.1 Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P16GWuyqSuDY7ApG-mgPPjgP297ucssya2XQUHbHO5L48ShM0tgM_aa0glxfTBBjpaxdxtloMLxfF9ycWwy4hBXtqiaxqMivpiQuCnYWNA-8pppTmSpHjuzgPpbhbjjkbA1yYjMHMJMfNvrjc7x-vci7kZ-DMDlMd3nmq_wcriVwU Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:17:56.237842 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 688f473972144fb6b7a398c1f775a5c1 Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.239667 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': 'd1cd8bd5-5679-49fd-b8f0-6af3ef428875'} Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:17:56.240697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. Jul 14 10:17:56.242437 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:56.244003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Returning 404 to user: Instance d1cd8bd5-5679-49fd-b8f0-6af3ef428875 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:17:56.244003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ec9a3ba0-36cf-48cc-8666-d3c65bf5fc76 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875" status: 404 len: 111 microversion: 2.1 time: 0.029266 Jul 14 10:17:56.244003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1502/2995] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:56 2022] GET /compute/v2.1/servers/d1cd8bd5-5679-49fd-b8f0-6af3ef428875 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:17:56.839023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6a7ad7d8-124d-4afe-87bc-49941d705793 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:56.839633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6a7ad7d8-124d-4afe-87bc-49941d705793 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:56.846482 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a7ad7d8-124d-4afe-87bc-49941d705793 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.846933 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a7ad7d8-124d-4afe-87bc-49941d705793 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.847712 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a7ad7d8-124d-4afe-87bc-49941d705793 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.848146 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6a7ad7d8-124d-4afe-87bc-49941d705793 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.032567 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6a7ad7d8-124d-4afe-87bc-49941d705793 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:57.040018 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6a7ad7d8-124d-4afe-87bc-49941d705793 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.204998 Jul 14 10:17:57.040568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1494/2996] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:56 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:57.367936 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:57.368480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:57.375599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:57.376053 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.376807 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:57.377239 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.390278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] HTTP exception thrown: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Request method failure captured: Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 HTTP/1.1 Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-P16GWuyqSuDY7ApG-mgPPjgP297ucssya2XQUHbHO5L48ShM0tgM_aa0glxfTBBjpaxdxtloMLxfF9ycWwy4hBXtqiaxqMivpiQuCnYWNA-8pppTmSpHjuzgPpbhbjjkbA1yYjMHMJMfNvrjc7x-vci7kZ-DMDlMd3nmq_wcriVwU Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:17:57.391787 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 688f473972144fb6b7a398c1f775a5c1 Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.393616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '99819874-5159-49fd-81c9-78998c928020'} Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:17:57.394825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.396742 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.398554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Returning 404 to user: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:17:57.398554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-543fc9d4-87f4-4ba1-95e3-b8baf132b2f5 tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "DELETE /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 404 len: 111 microversion: 2.1 time: 0.029023 Jul 14 10:17:57.398554 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1503/2997] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:17:57 2022] DELETE /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:17:57.401345 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:57.401982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] [instance: 99819874-5159-49fd-81c9-78998c928020] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:57.408477 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:57.409029 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.409793 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:57.410240 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.425445 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] HTTP exception thrown: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Request method failure captured: Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 HTTP/1.1 Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-P16GWuyqSuDY7ApG-mgPPjgP297ucssya2XQUHbHO5L48ShM0tgM_aa0glxfTBBjpaxdxtloMLxfF9ycWwy4hBXtqiaxqMivpiQuCnYWNA-8pppTmSpHjuzgPpbhbjjkbA1yYjMHMJMfNvrjc7x-vci7kZ-DMDlMd3nmq_wcriVwU Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:17:57.426963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_140620648e604251bc9c5c1a0e9c483b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 140620648e604251bc9c5c1a0e9c483b Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeTestJSON-712004695 Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 688f473972144fb6b7a398c1f775a5c1 Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeTestJSON-712004695-project Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.428769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '99819874-5159-49fd-81c9-78998c928020'} Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:17:57.429994 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. Jul 14 10:17:57.431931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:17:57.433792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] Returning 404 to user: Instance 99819874-5159-49fd-81c9-78998c928020 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:17:57.433792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-fcb4c5de-ea30-428d-9ba5-c49dfa53220c tempest-AttachVolumeTestJSON-712004695 tempest-AttachVolumeTestJSON-712004695-project] 10.222.0.40 "GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020" status: 404 len: 111 microversion: 2.1 time: 0.030829 Jul 14 10:17:57.433792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1495/2998] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:57 2022] GET /compute/v2.1/servers/99819874-5159-49fd-81c9-78998c928020 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 10:17:58.056835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dc332947-a58c-4710-b9d8-8ec7ed4db515 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:58.057449 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dc332947-a58c-4710-b9d8-8ec7ed4db515 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:58.063866 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dc332947-a58c-4710-b9d8-8ec7ed4db515 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:58.064315 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dc332947-a58c-4710-b9d8-8ec7ed4db515 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:58.065074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dc332947-a58c-4710-b9d8-8ec7ed4db515 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:58.065512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dc332947-a58c-4710-b9d8-8ec7ed4db515 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:58.197825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dc332947-a58c-4710-b9d8-8ec7ed4db515 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:58.205832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dc332947-a58c-4710-b9d8-8ec7ed4db515 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.152828 Jul 14 10:17:58.206425 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1504/2999] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:58 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:59.223290 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-798acc66-bd41-437d-b1f3-4f28a102a207 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:59.224046 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-798acc66-bd41-437d-b1f3-4f28a102a207 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:59.231109 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-798acc66-bd41-437d-b1f3-4f28a102a207 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:59.231668 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-798acc66-bd41-437d-b1f3-4f28a102a207 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:59.232506 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-798acc66-bd41-437d-b1f3-4f28a102a207 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:59.233014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-798acc66-bd41-437d-b1f3-4f28a102a207 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:59.376179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-798acc66-bd41-437d-b1f3-4f28a102a207 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:59.383939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-798acc66-bd41-437d-b1f3-4f28a102a207 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.164432 Jul 14 10:17:59.384503 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1496/3000] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:59 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:00.400749 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0c7fd1c5-75e5-4523-8731-bf0258c3f538 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:00.401462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0c7fd1c5-75e5-4523-8731-bf0258c3f538 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:00.412035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c7fd1c5-75e5-4523-8731-bf0258c3f538 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:00.412492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c7fd1c5-75e5-4523-8731-bf0258c3f538 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:00.413266 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c7fd1c5-75e5-4523-8731-bf0258c3f538 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:00.413694 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0c7fd1c5-75e5-4523-8731-bf0258c3f538 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:00.586210 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0c7fd1c5-75e5-4523-8731-bf0258c3f538 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:00.595238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0c7fd1c5-75e5-4523-8731-bf0258c3f538 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.198275 Jul 14 10:18:00.595963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1505/3001] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:00 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:01.094812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=6 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:01.223901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-a47a084e-a9b7-4fdb-9ac6-1d4721c78fc2 req-efae4a34-105e-4f80-99c8-b1ee4152f458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1b9074-afd6-4872-af6e-d6511494d355", "name": "network-vif-plugged", "status": "completed", "tag": "f5c5adad-f87c-4c6c-888f-e46762c10405"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:01.232152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-a47a084e-a9b7-4fdb-9ac6-1d4721c78fc2 req-efae4a34-105e-4f80-99c8-b1ee4152f458 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:01.232592 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-a47a084e-a9b7-4fdb-9ac6-1d4721c78fc2 req-efae4a34-105e-4f80-99c8-b1ee4152f458 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:01.244052 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-a47a084e-a9b7-4fdb-9ac6-1d4721c78fc2 req-efae4a34-105e-4f80-99c8-b1ee4152f458 service nova] Creating event network-vif-plugged:f5c5adad-f87c-4c6c-888f-e46762c10405 for instance 0f1b9074-afd6-4872-af6e-d6511494d355 on hv-cinder-82549 Jul 14 10:18:01.249266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-a47a084e-a9b7-4fdb-9ac6-1d4721c78fc2 req-efae4a34-105e-4f80-99c8-b1ee4152f458 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224027 Jul 14 10:18:01.249889 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1497/3002] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:01.611857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b065fea-b69f-4aab-8648-9232a9dccf0e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:01.612469 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b065fea-b69f-4aab-8648-9232a9dccf0e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:01.614456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:01.615219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=6 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:01.622817 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b065fea-b69f-4aab-8648-9232a9dccf0e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:01.623265 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b065fea-b69f-4aab-8648-9232a9dccf0e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:01.624030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b065fea-b69f-4aab-8648-9232a9dccf0e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:01.624995 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b065fea-b69f-4aab-8648-9232a9dccf0e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:01.760487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b065fea-b69f-4aab-8648-9232a9dccf0e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:01.767964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b065fea-b69f-4aab-8648-9232a9dccf0e tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.159931 Jul 14 10:18:01.768633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1506/3003] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:01 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:02.785775 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-38b149d6-1bb4-4822-acd7-6bdc35a66974 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:02.786507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-38b149d6-1bb4-4822-acd7-6bdc35a66974 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:02.793206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38b149d6-1bb4-4822-acd7-6bdc35a66974 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:02.793671 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38b149d6-1bb4-4822-acd7-6bdc35a66974 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:02.794511 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38b149d6-1bb4-4822-acd7-6bdc35a66974 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:02.794969 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-38b149d6-1bb4-4822-acd7-6bdc35a66974 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:02.922626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-38b149d6-1bb4-4822-acd7-6bdc35a66974 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:02.929960 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-38b149d6-1bb4-4822-acd7-6bdc35a66974 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1366 microversion: 2.1 time: 0.148989 Jul 14 10:18:02.930535 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1498/3004] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:02 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:03.947303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c83b9653-1292-489b-a27e-a36ed7d4dc67 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:03.947913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c83b9653-1292-489b-a27e-a36ed7d4dc67 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:03.955042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c83b9653-1292-489b-a27e-a36ed7d4dc67 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:03.955487 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c83b9653-1292-489b-a27e-a36ed7d4dc67 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:03.956243 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c83b9653-1292-489b-a27e-a36ed7d4dc67 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:03.956670 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c83b9653-1292-489b-a27e-a36ed7d4dc67 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.083819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c83b9653-1292-489b-a27e-a36ed7d4dc67 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:04.091282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c83b9653-1292-489b-a27e-a36ed7d4dc67 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1557 microversion: 2.1 time: 0.147779 Jul 14 10:18:04.091875 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1507/3005] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:03 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:04.107801 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b5d5ea48-e719-4a7c-af83-391f2bd39798 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:04.108310 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b5d5ea48-e719-4a7c-af83-391f2bd39798 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:04.114693 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5d5ea48-e719-4a7c-af83-391f2bd39798 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:04.115145 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5d5ea48-e719-4a7c-af83-391f2bd39798 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.115899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5d5ea48-e719-4a7c-af83-391f2bd39798 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:04.116327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b5d5ea48-e719-4a7c-af83-391f2bd39798 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.193818 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b5d5ea48-e719-4a7c-af83-391f2bd39798 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089775 Jul 14 10:18:04.194453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1499/3006] 10.222.0.40 () {58 vars in 1274 bytes} [Thu Jul 14 10:18:04 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:05.096428 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-0380a085-a06f-48f8-a301-b4f800aaa603 req-f22498a4-3dd2-4d15-9616-c90bfffff272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1b9074-afd6-4872-af6e-d6511494d355", "tag": "f5c5adad-f87c-4c6c-888f-e46762c10405"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:05.109882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-0380a085-a06f-48f8-a301-b4f800aaa603 req-f22498a4-3dd2-4d15-9616-c90bfffff272 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:05.110435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-0380a085-a06f-48f8-a301-b4f800aaa603 req-f22498a4-3dd2-4d15-9616-c90bfffff272 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:05.121883 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-0380a085-a06f-48f8-a301-b4f800aaa603 req-f22498a4-3dd2-4d15-9616-c90bfffff272 service nova] Creating event network-changed:f5c5adad-f87c-4c6c-888f-e46762c10405 for instance 0f1b9074-afd6-4872-af6e-d6511494d355 on hv-cinder-82549 Jul 14 10:18:05.127998 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-0380a085-a06f-48f8-a301-b4f800aaa603 req-f22498a4-3dd2-4d15-9616-c90bfffff272 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037500 Jul 14 10:18:05.129636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1508/3007] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:48.293276 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:19:48.293837 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:19:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:20:02.212798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e21697ee-567a-42d2-b54d-7facf68bf57e] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 10:20:02.214072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=27 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:02.215485 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=53 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:02.413737 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-df045820-c7c8-4449-98c6-0870e8273a5c tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Action: 'create', calling method: .version_select at 0x7f7da1e1d4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1398841134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE5h+586FM8l6rbFJTE21kVO7PRQjEr43T5o+pMwrteHVNJybJ+iwv6B7LeCQW3DyZaqtxuXxZmnW+/LMP6sEDfzvkgeZG132XAquLxbw196SrGuMQUOwvOi7lQeDfFYQ=="}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:02.429412 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-df045820-c7c8-4449-98c6-0870e8273a5c tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Getting quotas for project c5f8922bb91240a2b1f63f306c6d09d1. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:20:02.439655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-df045820-c7c8-4449-98c6-0870e8273a5c tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Getting quotas for user 5897368539ef4287bcba0c274c458491 and project c5f8922bb91240a2b1f63f306c6d09d1. Resources: {'key_pairs'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:20:02.469371 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-df045820-c7c8-4449-98c6-0870e8273a5c tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.259705 Jul 14 10:20:02.469939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1500/3008] 10.222.0.40 () {60 vars in 1158 bytes} [Thu Jul 14 10:20:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:03.858591 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de5f935d-60fa-4e21-924a-01eba6b6d466] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 10:20:03.859208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:03.859946 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:03.864358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6f9eba48-b1ad-4338-9f98-c3266c124910 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:03.864931 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6f9eba48-b1ad-4338-9f98-c3266c124910 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:03.873014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f9eba48-b1ad-4338-9f98-c3266c124910 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:03.873455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f9eba48-b1ad-4338-9f98-c3266c124910 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:03.874220 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f9eba48-b1ad-4338-9f98-c3266c124910 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:03.874654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6f9eba48-b1ad-4338-9f98-c3266c124910 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:03.897958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6f9eba48-b1ad-4338-9f98-c3266c124910 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/ips" status: 200 len: 150 microversion: 2.1 time: 0.041407 Jul 14 10:20:03.898669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1509/3009] 10.222.0.40 () {58 vars in 1247 bytes} [Thu Jul 14 10:20:03 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:05.275608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b686c983-59d4-426a-a214-28eeea46c488 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44e1194a-1416-41c3-af5d-657c922f6b9b"}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:05.277303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b686c983-59d4-426a-a214-28eeea46c488 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:05.286563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] [e21697ee-567a-42d2-b54d-7facf68bf57e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33502. Jul 14 10:20:05.290930 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b686c983-59d4-426a-a214-28eeea46c488 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:05.291378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b686c983-59d4-426a-a214-28eeea46c488 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:05.292180 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b686c983-59d4-426a-a214-28eeea46c488 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:05.292612 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b686c983-59d4-426a-a214-28eeea46c488 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:05.685355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b686c983-59d4-426a-a214-28eeea46c488 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "POST /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417005 Jul 14 10:20:05.685982 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1501/3010] 10.222.0.40 () {60 vars in 1322 bytes} [Thu Jul 14 10:20:05 2022] POST /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:13.313950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-ddefb0ee-6137-4455-90e1-2bbc5826fb6d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:13.314514 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-ddefb0ee-6137-4455-90e1-2bbc5826fb6d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:13.322532 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddefb0ee-6137-4455-90e1-2bbc5826fb6d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:13.322983 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddefb0ee-6137-4455-90e1-2bbc5826fb6d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:13.323734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddefb0ee-6137-4455-90e1-2bbc5826fb6d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:13.324200 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-ddefb0ee-6137-4455-90e1-2bbc5826fb6d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:13.330081 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] [de5f935d-60fa-4e21-924a-01eba6b6d466] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 33552. Jul 14 10:20:13.408789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.objects.instance [None req-ddefb0ee-6137-4455-90e1-2bbc5826fb6d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lazy-loading 'services' on Instance uuid 0f1b9074-afd6-4872-af6e-d6511494d355 {{(pid=129536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:20:13.481502 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-ddefb0ee-6137-4455-90e1-2bbc5826fb6d tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments/44e1194a-1416-41c3-af5d-657c922f6b9b" status: 202 len: 0 microversion: 2.1 time: 0.171316 Jul 14 10:20:13.482104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1510/3011] 10.222.0.40 () {58 vars in 1415 bytes} [Thu Jul 14 10:20:13 2022] DELETE /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments/44e1194a-1416-41c3-af5d-657c922f6b9b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:20:13.489341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=4 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:13.502582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-76b4187f-f7b3-4ae1-bf50-035408e144ca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:13.504022 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-76b4187f-f7b3-4ae1-bf50-035408e144ca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:13.511966 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76b4187f-f7b3-4ae1-bf50-035408e144ca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:13.512551 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76b4187f-f7b3-4ae1-bf50-035408e144ca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:13.513321 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76b4187f-f7b3-4ae1-bf50-035408e144ca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:13.513761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-76b4187f-f7b3-4ae1-bf50-035408e144ca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:13.547047 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-76b4187f-f7b3-4ae1-bf50-035408e144ca tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060395 Jul 14 10:20:13.547626 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1502/3012] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:20:13 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:14.559792 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-41b90b80-3cc3-4472-881e-68bcc3690a13 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:14.560877 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-41b90b80-3cc3-4472-881e-68bcc3690a13 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:14.567528 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41b90b80-3cc3-4472-881e-68bcc3690a13 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:14.568065 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41b90b80-3cc3-4472-881e-68bcc3690a13 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:14.568835 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41b90b80-3cc3-4472-881e-68bcc3690a13 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:14.569397 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-41b90b80-3cc3-4472-881e-68bcc3690a13 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:14.601640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-41b90b80-3cc3-4472-881e-68bcc3690a13 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Jul 14 10:20:14.602594 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1511/3013] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:20:14 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:15.614060 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-9a091480-6c8b-4b89-a5bf-d4859317ebdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:15.614948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-9a091480-6c8b-4b89-a5bf-d4859317ebdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:15.621368 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a091480-6c8b-4b89-a5bf-d4859317ebdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:15.621814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a091480-6c8b-4b89-a5bf-d4859317ebdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:15.622591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a091480-6c8b-4b89-a5bf-d4859317ebdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:15.623023 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-9a091480-6c8b-4b89-a5bf-d4859317ebdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:15.651152 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-9a091480-6c8b-4b89-a5bf-d4859317ebdd tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041630 Jul 14 10:20:15.651685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1503/3014] 10.222.0.40 () {58 vars in 1301 bytes} [Thu Jul 14 10:20:15 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:20:15.706830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-28bdff38-9a63-4ecf-b2f9-f2e6f9eff6d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:15.707329 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-28bdff38-9a63-4ecf-b2f9-f2e6f9eff6d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:15.713859 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28bdff38-9a63-4ecf-b2f9-f2e6f9eff6d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:15.714344 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28bdff38-9a63-4ecf-b2f9-f2e6f9eff6d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:15.715098 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28bdff38-9a63-4ecf-b2f9-f2e6f9eff6d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:15.715533 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-28bdff38-9a63-4ecf-b2f9-f2e6f9eff6d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:15.742332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-28bdff38-9a63-4ecf-b2f9-f2e6f9eff6d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Going to try to terminate instance {{(pid=129536) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:20:15.820378 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-28bdff38-9a63-4ecf-b2f9-f2e6f9eff6d8 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 204 len: 0 microversion: 2.1 time: 0.117107 Jul 14 10:20:15.821208 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1512/3015] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:15 2022] DELETE /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:20:15.829882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ffedaa19-e2b8-40f4-8ecf-154bb8f27e6f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:15.830518 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ffedaa19-e2b8-40f4-8ecf-154bb8f27e6f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:15.836468 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ffedaa19-e2b8-40f4-8ecf-154bb8f27e6f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:15.836912 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ffedaa19-e2b8-40f4-8ecf-154bb8f27e6f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:15.837661 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ffedaa19-e2b8-40f4-8ecf-154bb8f27e6f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:15.838091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ffedaa19-e2b8-40f4-8ecf-154bb8f27e6f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:15.967814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ffedaa19-e2b8-40f4-8ecf-154bb8f27e6f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:15.975748 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ffedaa19-e2b8-40f4-8ecf-154bb8f27e6f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1681 microversion: 2.1 time: 0.149739 Jul 14 10:20:15.976307 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1504/3016] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:15 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:16.993486 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-27050d09-090b-47a3-b1c5-3a550d9582b6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:16.994201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-27050d09-090b-47a3-b1c5-3a550d9582b6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:17.000599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27050d09-090b-47a3-b1c5-3a550d9582b6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:17.001047 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27050d09-090b-47a3-b1c5-3a550d9582b6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:17.001804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27050d09-090b-47a3-b1c5-3a550d9582b6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:17.002324 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-27050d09-090b-47a3-b1c5-3a550d9582b6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:17.131926 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-27050d09-090b-47a3-b1c5-3a550d9582b6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:17.139419 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-27050d09-090b-47a3-b1c5-3a550d9582b6 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1681 microversion: 2.1 time: 0.150169 Jul 14 10:20:17.139979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1513/3017] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:16 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:18.157380 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2c06c1e8-fc01-4d89-b192-52544564140c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:18.157991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2c06c1e8-fc01-4d89-b192-52544564140c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:18.164569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c06c1e8-fc01-4d89-b192-52544564140c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:18.165014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c06c1e8-fc01-4d89-b192-52544564140c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:18.165776 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c06c1e8-fc01-4d89-b192-52544564140c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:18.166227 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2c06c1e8-fc01-4d89-b192-52544564140c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:18.295327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2c06c1e8-fc01-4d89-b192-52544564140c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:18.302803 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2c06c1e8-fc01-4d89-b192-52544564140c tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1681 microversion: 2.1 time: 0.149792 Jul 14 10:20:18.303359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1505/3018] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:18 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:19.321578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-40da50d7-b798-4f97-b95f-2ac74724d6bc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:19.322207 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-40da50d7-b798-4f97-b95f-2ac74724d6bc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:19.328527 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-40da50d7-b798-4f97-b95f-2ac74724d6bc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:19.328975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-40da50d7-b798-4f97-b95f-2ac74724d6bc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:19.329721 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-40da50d7-b798-4f97-b95f-2ac74724d6bc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:19.330152 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-40da50d7-b798-4f97-b95f-2ac74724d6bc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:19.417795 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-40da50d7-b798-4f97-b95f-2ac74724d6bc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7ae3d2f56a491baf26a83a34d86ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52acfca03c3e45cfb2e8d3d4f391b281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:19.428279 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-40da50d7-b798-4f97-b95f-2ac74724d6bc tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 200 len: 1613 microversion: 2.1 time: 0.110442 Jul 14 10:20:19.429599 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1514/3019] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:19 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:19.497633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-f07cb911-e003-46da-974e-82f6595f5158 req-521a83f0-e513-4f76-9049-7df87ed02ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1b9074-afd6-4872-af6e-d6511494d355", "name": "network-vif-deleted", "tag": "f5c5adad-f87c-4c6c-888f-e46762c10405"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:19.515761 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f07cb911-e003-46da-974e-82f6595f5158 req-521a83f0-e513-4f76-9049-7df87ed02ab2 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:19.516206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f07cb911-e003-46da-974e-82f6595f5158 req-521a83f0-e513-4f76-9049-7df87ed02ab2 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:19.551622 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-f07cb911-e003-46da-974e-82f6595f5158 req-521a83f0-e513-4f76-9049-7df87ed02ab2 service nova] Creating event network-vif-deleted:f5c5adad-f87c-4c6c-888f-e46762c10405 for instance 0f1b9074-afd6-4872-af6e-d6511494d355 on hv-cinder-82549 Jul 14 10:20:19.563710 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-f07cb911-e003-46da-974e-82f6595f5158 req-521a83f0-e513-4f76-9049-7df87ed02ab2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149417 Jul 14 10:20:19.564652 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1506/3020] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:20:20.445618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:20.446291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:20.452727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:20.453181 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:20.454614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:20.455060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:20.468000 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 HTTP/1.1 Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:20:20.469623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:20.470964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '0f1b9074-afd6-4872-af6e-d6511494d355'} Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:20.471919 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:20.473496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:20.474600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:20.474600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-a5a3c62f-6c7b-4bdf-9d45-1c6956015f68 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 404 len: 111 microversion: 2.1 time: 0.029788 Jul 14 10:20:20.474600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1515/3021] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:20 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:20.481153 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6eb987c8-a09e-4674-9738-08def616c6f4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '.version_select at 0x7f7da1d929d0>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:20.501252 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6eb987c8-a09e-4674-9738-08def616c6f4 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565318504" status: 202 len: 0 microversion: 2.1 time: 0.024129 Jul 14 10:20:20.501824 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1507/3022] 10.222.0.40 () {58 vars in 1217 bytes} [Thu Jul 14 10:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565318504 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:20:22.230493 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:22.230997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:22.237404 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:22.237853 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:22.238640 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:22.239074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:22.252116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 HTTP/1.1 Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:20:22.253625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.254997 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '0f1b9074-afd6-4872-af6e-d6511494d355'} Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:22.255728 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.256829 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.257964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:22.257964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3bcce784-bd01-4e18-aac9-63a30fc45e1f tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 404 len: 111 microversion: 2.1 time: 0.028353 Jul 14 10:20:22.257964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1516/3023] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:22 2022] DELETE /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:22.263565 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:22.264344 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 0f1b9074-afd6-4872-af6e-d6511494d355] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:22.271620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:22.272010 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:22.272757 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:22.273201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:22.286616 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 HTTP/1.1 Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:20:22.288190 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.289393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '0f1b9074-afd6-4872-af6e-d6511494d355'} Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:22.290071 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. Jul 14 10:20:22.291206 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:22.292266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 0f1b9074-afd6-4872-af6e-d6511494d355 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:22.292266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-306a79c3-ca38-4123-a390-7cbb449824d3 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355" status: 404 len: 111 microversion: 2.1 time: 0.030234 Jul 14 10:20:22.292266 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1508/3024] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:22 2022] GET /compute/v2.1/servers/0f1b9074-afd6-4872-af6e-d6511494d355 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 10:20:23.417568 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:23.418131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:23.425229 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.425691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.426516 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.426955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.440014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 HTTP/1.1 Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:20:23.441541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.442955 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': 'ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9'} Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:23.443523 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.444418 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.445462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:23.445462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-00e26923-37be-41be-a734-719f5cd11c73 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 404 len: 111 microversion: 2.1 time: 0.029484 Jul 14 10:20:23.445462 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1517/3025] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:23 2022] DELETE /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:23.451727 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:23.452327 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:23.458769 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.459203 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.459935 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.460355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.474425 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 HTTP/1.1 Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:20:23.475954 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.477115 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': 'ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9'} Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:23.477709 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. Jul 14 10:20:23.478832 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.479844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:23.479844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-91cbb9b2-076a-4951-93d0-9cc55ca0b214 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9" status: 404 len: 111 microversion: 2.1 time: 0.029577 Jul 14 10:20:23.479844 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1509/3026] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:23 2022] GET /compute/v2.1/servers/ea095eb0-75b5-40bc-94f8-c3dbc1ec09c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:23.486149 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:23.486703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:23.492669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.493113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.493867 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.494332 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.507360 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad HTTP/1.1 Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:20:23.508871 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.510066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '70e1234d-e61b-402a-8ad9-380bbe756dad'} Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:23.510907 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.512209 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.513427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:23.513427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-04dfb04a-b4d7-45bd-9595-4010123c7db2 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 404 len: 111 microversion: 2.1 time: 0.028481 Jul 14 10:20:23.513427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1518/3027] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:23 2022] DELETE /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:23.519015 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:23.519615 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 70e1234d-e61b-402a-8ad9-380bbe756dad] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:23.525649 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.526092 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.526868 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.527302 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.541087 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad HTTP/1.1 Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:20:23.542608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.543878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '70e1234d-e61b-402a-8ad9-380bbe756dad'} Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:23.544628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. Jul 14 10:20:23.545788 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:23.546873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 70e1234d-e61b-402a-8ad9-380bbe756dad could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:23.546873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5df4b4a9-74ee-4aa6-87dc-e86620f7636a tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad" status: 404 len: 111 microversion: 2.1 time: 0.029225 Jul 14 10:20:23.546873 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1510/3028] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:23 2022] GET /compute/v2.1/servers/70e1234d-e61b-402a-8ad9-380bbe756dad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:24.681055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:24.681534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:24.688131 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:24.688576 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:24.689327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:24.689761 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:24.703030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 HTTP/1.1 Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:20:24.704556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.705702 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '7f265cbd-76a7-486d-873c-085ab051c168'} Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:24.706356 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.707357 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.708323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:24.708323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6d63f2f1-8f48-49be-96f8-084ea67ac63b tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 404 len: 111 microversion: 2.1 time: 0.028734 Jul 14 10:20:24.708323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1519/3029] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:24 2022] DELETE /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:24.714264 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:24.714875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] [instance: 7f265cbd-76a7-486d-873c-085ab051c168] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:24.721726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:24.722174 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:24.722955 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:24.723389 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:24.737112 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] HTTP exception thrown: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Request method failure captured: Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 HTTP/1.1 Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-Ro_8vOuOtWEZ7o5faq0VcrcyF7_biAAA995DwYv8F5-6yyx_GESNEuehkT-hEXqiSyEZN1A9mXYCELy615vQO-a-hmHkRKK3RWLeOaHJ4SI2IZC9RvxJ_WzP6Ma1vKsay_uhgLPajKOnR4quAJjU7_thJ1cW1n2ykqotLPQ9nvjFY Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:20:24.738643 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_52acfca03c3e45cfb2e8d3d4f391b281"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: 52acfca03c3e45cfb2e8d3d4f391b281 Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754032914 Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 1d7ae3d2f56a491baf26a83a34d86ccf Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-AttachVolumeNegativeTest-754032914-project Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.739891 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '7f265cbd-76a7-486d-873c-085ab051c168'} Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:24.740591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. Jul 14 10:20:24.741804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:20:24.742853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] Returning 404 to user: Instance 7f265cbd-76a7-486d-873c-085ab051c168 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:24.742853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-73d64338-e4dc-40e4-803f-bbb97a838093 tempest-AttachVolumeNegativeTest-754032914 tempest-AttachVolumeNegativeTest-754032914-project] 10.222.0.40 "GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168" status: 404 len: 111 microversion: 2.1 time: 0.029595 Jul 14 10:20:24.742853 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1511/3030] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:24 2022] GET /compute/v2.1/servers/7f265cbd-76a7-486d-873c-085ab051c168 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:28.111314 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-87720783", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1398841134", "security_groups": [{"name": "tempest-secgroup-smoke-701861612"}], "block_device_mapping_v2": [{"uuid": "b4f1d3fc-3cb3-4a3c-91fd-fc55ed8c437c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3e560a30-a591-433e-800b-39add59e8d51"}]}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:28.259069 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] validate_networks() for [('3e560a30-a591-433e-800b-39add59e8d51', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:20:28.665254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:20:28.665683 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:20:28.666163 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:20:28.666608 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:20:28.667066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:20:28.677080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:28.677534 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:28.678403 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:28.678848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:28.697979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Getting quotas for project c5f8922bb91240a2b1f63f306c6d09d1. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:20:28.702468 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Getting quotas for user 5897368539ef4287bcba0c274c458491 and project c5f8922bb91240a2b1f63f306c6d09d1. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:20:28.761301 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:20:28.763407 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4f1d3fc-3cb3-4a3c-91fd-fc55ed8c437c',volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:20:28.893361 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-de29ef59-3e60-45d3-a4a9-4e7918d0826a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.786451 Jul 14 10:20:28.894705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1520/3031] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 10:20:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:20:28.904168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f2d0a9d1-6b03-42d0-9e2b-6f123f777bd4 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:28.904777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f2d0a9d1-6b03-42d0-9e2b-6f123f777bd4 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:28.979438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f2d0a9d1-6b03-42d0-9e2b-6f123f777bd4 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:28.990640 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f2d0a9d1-6b03-42d0-9e2b-6f123f777bd4 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1093 microversion: 2.1 time: 0.090209 Jul 14 10:20:28.991351 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1512/3032] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:28 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1093 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:30.007972 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-62d79a24-ad64-4bdb-8e08-754eb874341e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:30.008603 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-62d79a24-ad64-4bdb-8e08-754eb874341e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:30.020593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62d79a24-ad64-4bdb-8e08-754eb874341e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:30.021538 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62d79a24-ad64-4bdb-8e08-754eb874341e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:30.022713 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62d79a24-ad64-4bdb-8e08-754eb874341e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:30.024085 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-62d79a24-ad64-4bdb-8e08-754eb874341e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:30.122125 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-62d79a24-ad64-4bdb-8e08-754eb874341e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:30.137271 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-62d79a24-ad64-4bdb-8e08-754eb874341e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1209 microversion: 2.1 time: 0.133219 Jul 14 10:20:30.142334 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1521/3033] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:30 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:31.155715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-5311921d-8c47-4702-9935-ca0f2693ce84 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:31.156238 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-5311921d-8c47-4702-9935-ca0f2693ce84 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:31.164159 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5311921d-8c47-4702-9935-ca0f2693ce84 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:31.164604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5311921d-8c47-4702-9935-ca0f2693ce84 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:31.165373 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5311921d-8c47-4702-9935-ca0f2693ce84 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:31.165809 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-5311921d-8c47-4702-9935-ca0f2693ce84 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:31.355527 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-5311921d-8c47-4702-9935-ca0f2693ce84 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:31.363667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-5311921d-8c47-4702-9935-ca0f2693ce84 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.211967 Jul 14 10:20:31.366688 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1513/3034] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:31 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:31.677241 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-5f38796b-e212-4572-bb9a-a268717817f7 req-3c5ce207-6df8-4058-9a08-138bbc358324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2648f6c0-3376-4548-88b9-d127f3885a75", "tag": "c8073a39-c013-40de-89a1-aa7e7a08975d"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:31.696136 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-5f38796b-e212-4572-bb9a-a268717817f7 req-3c5ce207-6df8-4058-9a08-138bbc358324 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:31.696825 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-5f38796b-e212-4572-bb9a-a268717817f7 req-3c5ce207-6df8-4058-9a08-138bbc358324 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:31.718580 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-5f38796b-e212-4572-bb9a-a268717817f7 req-3c5ce207-6df8-4058-9a08-138bbc358324 service nova] Creating event network-changed:c8073a39-c013-40de-89a1-aa7e7a08975d for instance 2648f6c0-3376-4548-88b9-d127f3885a75 on hv-cinder-82549 Jul 14 10:20:31.723495 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-5f38796b-e212-4572-bb9a-a268717817f7 req-3c5ce207-6df8-4058-9a08-138bbc358324 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050484 Jul 14 10:20:31.724509 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1522/3035] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:32.380902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f0f70960-b043-41ec-b4fb-e86b5de55b21 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:32.381501 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f0f70960-b043-41ec-b4fb-e86b5de55b21 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:32.383880 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:32.389119 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f0f70960-b043-41ec-b4fb-e86b5de55b21 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:32.389568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f0f70960-b043-41ec-b4fb-e86b5de55b21 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:32.390341 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f0f70960-b043-41ec-b4fb-e86b5de55b21 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:32.390773 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f0f70960-b043-41ec-b4fb-e86b5de55b21 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:32.395450 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:32.522234 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f0f70960-b043-41ec-b4fb-e86b5de55b21 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:32.529732 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f0f70960-b043-41ec-b4fb-e86b5de55b21 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.152647 Jul 14 10:20:32.530303 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1514/3036] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:32 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:33.549427 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-7eef4ed6-2fca-4bdc-9ad0-1936e8977392 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:33.550180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-7eef4ed6-2fca-4bdc-9ad0-1936e8977392 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:33.556445 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7eef4ed6-2fca-4bdc-9ad0-1936e8977392 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.556888 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7eef4ed6-2fca-4bdc-9ad0-1936e8977392 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.557646 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7eef4ed6-2fca-4bdc-9ad0-1936e8977392 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.558074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-7eef4ed6-2fca-4bdc-9ad0-1936e8977392 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.769409 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-7eef4ed6-2fca-4bdc-9ad0-1936e8977392 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:33.778873 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-7eef4ed6-2fca-4bdc-9ad0-1936e8977392 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.235730 Jul 14 10:20:33.779439 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1523/3037] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:33 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:34.795783 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d07de6bd-eea6-4af0-81ef-777fa3242857 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:34.796396 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d07de6bd-eea6-4af0-81ef-777fa3242857 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:34.803651 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d07de6bd-eea6-4af0-81ef-777fa3242857 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.804100 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d07de6bd-eea6-4af0-81ef-777fa3242857 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.804863 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d07de6bd-eea6-4af0-81ef-777fa3242857 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.805295 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d07de6bd-eea6-4af0-81ef-777fa3242857 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.940162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d07de6bd-eea6-4af0-81ef-777fa3242857 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:34.947899 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d07de6bd-eea6-4af0-81ef-777fa3242857 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.155989 Jul 14 10:20:34.948533 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1515/3038] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:34 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:35.965278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3b7efff9-9b5c-43ec-aae6-5b7f15d26411 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:35.966030 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3b7efff9-9b5c-43ec-aae6-5b7f15d26411 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:35.968804 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:35.975391 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b7efff9-9b5c-43ec-aae6-5b7f15d26411 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:35.976067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b7efff9-9b5c-43ec-aae6-5b7f15d26411 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:35.977012 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b7efff9-9b5c-43ec-aae6-5b7f15d26411 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:35.977482 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3b7efff9-9b5c-43ec-aae6-5b7f15d26411 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:35.983633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:36.122429 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3b7efff9-9b5c-43ec-aae6-5b7f15d26411 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:36.130146 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3b7efff9-9b5c-43ec-aae6-5b7f15d26411 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.168852 Jul 14 10:20:36.130881 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1524/3039] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:35 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:37.146650 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-80e9c324-8f0c-4dd2-8e2e-fc2bff14a9cb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:37.147248 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-80e9c324-8f0c-4dd2-8e2e-fc2bff14a9cb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:37.153324 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80e9c324-8f0c-4dd2-8e2e-fc2bff14a9cb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:37.153765 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80e9c324-8f0c-4dd2-8e2e-fc2bff14a9cb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:37.154537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80e9c324-8f0c-4dd2-8e2e-fc2bff14a9cb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:37.154961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-80e9c324-8f0c-4dd2-8e2e-fc2bff14a9cb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:37.295406 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-80e9c324-8f0c-4dd2-8e2e-fc2bff14a9cb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:37.304262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-80e9c324-8f0c-4dd2-8e2e-fc2bff14a9cb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.161203 Jul 14 10:20:37.304903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1516/3040] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:37 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:20:38.322153 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0dde1ca4-89c7-45eb-b46d-5fbb5d77b707 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:38.322695 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0dde1ca4-89c7-45eb-b46d-5fbb5d77b707 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:38.329826 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dde1ca4-89c7-45eb-b46d-5fbb5d77b707 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:38.330317 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dde1ca4-89c7-45eb-b46d-5fbb5d77b707 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:38.331050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dde1ca4-89c7-45eb-b46d-5fbb5d77b707 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:38.331479 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0dde1ca4-89c7-45eb-b46d-5fbb5d77b707 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:38.460461 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0dde1ca4-89c7-45eb-b46d-5fbb5d77b707 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:38.467734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0dde1ca4-89c7-45eb-b46d-5fbb5d77b707 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.149755 Jul 14 10:20:38.468295 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1525/3041] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:38 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:39.484795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-73246b00-ab42-4b14-86b8-714a472da2c1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:39.485331 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-73246b00-ab42-4b14-86b8-714a472da2c1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:39.487632 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:39.493155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73246b00-ab42-4b14-86b8-714a472da2c1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:39.493599 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73246b00-ab42-4b14-86b8-714a472da2c1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:39.494385 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73246b00-ab42-4b14-86b8-714a472da2c1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:39.494820 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-73246b00-ab42-4b14-86b8-714a472da2c1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:39.624763 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-73246b00-ab42-4b14-86b8-714a472da2c1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:39.632719 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-73246b00-ab42-4b14-86b8-714a472da2c1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.151884 Jul 14 10:20:39.633277 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1517/3042] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:39 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:40.649275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-3ff03dbd-85e4-4bff-8fa6-3f939a3948ab tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:40.649882 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-3ff03dbd-85e4-4bff-8fa6-3f939a3948ab tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:40.651743 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:40.652401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=6 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:40.659238 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3ff03dbd-85e4-4bff-8fa6-3f939a3948ab tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:40.659684 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3ff03dbd-85e4-4bff-8fa6-3f939a3948ab tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:40.660440 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3ff03dbd-85e4-4bff-8fa6-3f939a3948ab tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:40.660884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-3ff03dbd-85e4-4bff-8fa6-3f939a3948ab tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:40.789076 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-3ff03dbd-85e4-4bff-8fa6-3f939a3948ab tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:40.796543 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-3ff03dbd-85e4-4bff-8fa6-3f939a3948ab tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.151253 Jul 14 10:20:40.797106 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1526/3043] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:40 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:41.813035 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2310bab3-a5a3-4f08-b797-613f3594725b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:41.813747 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2310bab3-a5a3-4f08-b797-613f3594725b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:41.821242 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2310bab3-a5a3-4f08-b797-613f3594725b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:41.821770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2310bab3-a5a3-4f08-b797-613f3594725b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:41.822563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2310bab3-a5a3-4f08-b797-613f3594725b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:41.822992 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2310bab3-a5a3-4f08-b797-613f3594725b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:41.953896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-2310bab3-a5a3-4f08-b797-613f3594725b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:41.961296 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2310bab3-a5a3-4f08-b797-613f3594725b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.152156 Jul 14 10:20:41.961854 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1518/3044] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:41 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:42.976929 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-240ab307-944f-4eb5-9a32-0253422b578b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:42.977463 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-240ab307-944f-4eb5-9a32-0253422b578b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:42.983951 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-240ab307-944f-4eb5-9a32-0253422b578b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:42.984399 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-240ab307-944f-4eb5-9a32-0253422b578b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:42.985147 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-240ab307-944f-4eb5-9a32-0253422b578b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:42.985583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-240ab307-944f-4eb5-9a32-0253422b578b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:43.116159 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-240ab307-944f-4eb5-9a32-0253422b578b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:43.123494 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-240ab307-944f-4eb5-9a32-0253422b578b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.150563 Jul 14 10:20:43.124050 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1527/3045] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:42 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:43.786798 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-f32c0ac0-64a8-4876-8779-0e47f5cd3204 req-a50fae8c-e976-4fe6-b7f0-5e2f416556e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2648f6c0-3376-4548-88b9-d127f3885a75", "name": "network-vif-plugged", "status": "completed", "tag": "c8073a39-c013-40de-89a1-aa7e7a08975d"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:43.799700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f32c0ac0-64a8-4876-8779-0e47f5cd3204 req-a50fae8c-e976-4fe6-b7f0-5e2f416556e9 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:43.800142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-f32c0ac0-64a8-4876-8779-0e47f5cd3204 req-a50fae8c-e976-4fe6-b7f0-5e2f416556e9 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:43.811977 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-f32c0ac0-64a8-4876-8779-0e47f5cd3204 req-a50fae8c-e976-4fe6-b7f0-5e2f416556e9 service nova] Creating event network-vif-plugged:c8073a39-c013-40de-89a1-aa7e7a08975d for instance 2648f6c0-3376-4548-88b9-d127f3885a75 on hv-cinder-82549 Jul 14 10:20:43.817723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-f32c0ac0-64a8-4876-8779-0e47f5cd3204 req-a50fae8c-e976-4fe6-b7f0-5e2f416556e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Jul 14 10:20:43.819209 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1519/3046] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:44.140808 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-48e1f4cf-8ba9-4f01-8d7d-565555dc0429 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:44.141415 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-48e1f4cf-8ba9-4f01-8d7d-565555dc0429 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:44.148180 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-48e1f4cf-8ba9-4f01-8d7d-565555dc0429 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:44.148623 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-48e1f4cf-8ba9-4f01-8d7d-565555dc0429 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:44.149371 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-48e1f4cf-8ba9-4f01-8d7d-565555dc0429 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:44.149803 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-48e1f4cf-8ba9-4f01-8d7d-565555dc0429 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:44.288921 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-48e1f4cf-8ba9-4f01-8d7d-565555dc0429 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:44.296450 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-48e1f4cf-8ba9-4f01-8d7d-565555dc0429 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.159513 Jul 14 10:20:44.297017 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1528/3047] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:44 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:45.313451 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-49012c8a-5b2a-42df-9ac7-b1d075227407 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:45.314095 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-49012c8a-5b2a-42df-9ac7-b1d075227407 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:45.321129 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-49012c8a-5b2a-42df-9ac7-b1d075227407 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.321586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-49012c8a-5b2a-42df-9ac7-b1d075227407 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.322383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-49012c8a-5b2a-42df-9ac7-b1d075227407 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.322812 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-49012c8a-5b2a-42df-9ac7-b1d075227407 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.452072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-49012c8a-5b2a-42df-9ac7-b1d075227407 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:45.460091 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-49012c8a-5b2a-42df-9ac7-b1d075227407 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1264 microversion: 2.1 time: 0.150904 Jul 14 10:20:45.460662 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1520/3048] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:45 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:46.479527 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-560e59c5-0dca-4656-bd43-bbd3fe709be1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:46.480216 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-560e59c5-0dca-4656-bd43-bbd3fe709be1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:46.489386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-560e59c5-0dca-4656-bd43-bbd3fe709be1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:46.489830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-560e59c5-0dca-4656-bd43-bbd3fe709be1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:46.490635 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-560e59c5-0dca-4656-bd43-bbd3fe709be1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:46.491067 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-560e59c5-0dca-4656-bd43-bbd3fe709be1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:46.626654 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-560e59c5-0dca-4656-bd43-bbd3fe709be1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:46.634040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-560e59c5-0dca-4656-bd43-bbd3fe709be1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1451 microversion: 2.1 time: 0.160700 Jul 14 10:20:46.634634 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1529/3049] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:46 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:46.649499 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e37a001f-b3f9-4cc9-8715-949d5bd9fef5 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:46.650102 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e37a001f-b3f9-4cc9-8715-949d5bd9fef5 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:46.656667 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e37a001f-b3f9-4cc9-8715-949d5bd9fef5 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:46.657120 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e37a001f-b3f9-4cc9-8715-949d5bd9fef5 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:46.657921 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e37a001f-b3f9-4cc9-8715-949d5bd9fef5 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:46.658387 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e37a001f-b3f9-4cc9-8715-949d5bd9fef5 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:46.794073 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e37a001f-b3f9-4cc9-8715-949d5bd9fef5 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:46.801475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e37a001f-b3f9-4cc9-8715-949d5bd9fef5 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1451 microversion: 2.1 time: 0.155736 Jul 14 10:20:46.802021 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1521/3050] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:46 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:48.502113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-84467475-1fc4-437d-aeec-1d057170c74e req-4f0daa5c-12b9-4f3a-8fb8-c4c8b6383617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2648f6c0-3376-4548-88b9-d127f3885a75", "tag": "c8073a39-c013-40de-89a1-aa7e7a08975d"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:48.511511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-84467475-1fc4-437d-aeec-1d057170c74e req-4f0daa5c-12b9-4f3a-8fb8-c4c8b6383617 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.512061 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-84467475-1fc4-437d-aeec-1d057170c74e req-4f0daa5c-12b9-4f3a-8fb8-c4c8b6383617 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.523942 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-84467475-1fc4-437d-aeec-1d057170c74e req-4f0daa5c-12b9-4f3a-8fb8-c4c8b6383617 service nova] Creating event network-changed:c8073a39-c013-40de-89a1-aa7e7a08975d for instance 2648f6c0-3376-4548-88b9-d127f3885a75 on hv-cinder-82549 Jul 14 10:20:48.531386 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-84467475-1fc4-437d-aeec-1d057170c74e req-4f0daa5c-12b9-4f3a-8fb8-c4c8b6383617 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032779 Jul 14 10:20:48.531996 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1530/3051] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:23:02.001261 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:23:02.002319 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:23:02.618940 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=15 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:02.619687 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=43 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:02.623905 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7abd6a9d-3d9d-418b-a7fd-48c977d83635 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:02.624390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7abd6a9d-3d9d-418b-a7fd-48c977d83635 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:02.631703 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7abd6a9d-3d9d-418b-a7fd-48c977d83635 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:02.632147 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7abd6a9d-3d9d-418b-a7fd-48c977d83635 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:02.632896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7abd6a9d-3d9d-418b-a7fd-48c977d83635 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:02.633328 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7abd6a9d-3d9d-418b-a7fd-48c977d83635 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:02.656729 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7abd6a9d-3d9d-418b-a7fd-48c977d83635 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:23:02.731055 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7abd6a9d-3d9d-418b-a7fd-48c977d83635 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 204 len: 0 microversion: 2.1 time: 0.113760 Jul 14 10:23:02.731654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1522/3052] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:23:02 2022] DELETE /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:23:02.738618 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de5f935d-60fa-4e21-924a-01eba6b6d466] AMQP server on 10.222.0.40:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 10:23:02.739227 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=13 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:02.739976 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=37 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:02.744275 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-4b637717-f470-4dda-9515-f27ffb6cb8b7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:02.744975 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-4b637717-f470-4dda-9515-f27ffb6cb8b7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:02.752140 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b637717-f470-4dda-9515-f27ffb6cb8b7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:02.752590 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b637717-f470-4dda-9515-f27ffb6cb8b7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:02.753986 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b637717-f470-4dda-9515-f27ffb6cb8b7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:02.754456 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-4b637717-f470-4dda-9515-f27ffb6cb8b7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:03.081511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-4b637717-f470-4dda-9515-f27ffb6cb8b7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:03.088953 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-4b637717-f470-4dda-9515-f27ffb6cb8b7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1576 microversion: 2.1 time: 0.352954 Jul 14 10:23:03.089512 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1531/3053] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:02 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1576 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:04.106991 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-27b81ffb-72e5-48cf-a1f8-da5247cdc962 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:04.107705 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-27b81ffb-72e5-48cf-a1f8-da5247cdc962 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:04.114251 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27b81ffb-72e5-48cf-a1f8-da5247cdc962 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:04.114692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27b81ffb-72e5-48cf-a1f8-da5247cdc962 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:04.115432 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27b81ffb-72e5-48cf-a1f8-da5247cdc962 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:04.115875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-27b81ffb-72e5-48cf-a1f8-da5247cdc962 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:04.248298 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-27b81ffb-72e5-48cf-a1f8-da5247cdc962 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:04.255780 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-27b81ffb-72e5-48cf-a1f8-da5247cdc962 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1576 microversion: 2.1 time: 0.153086 Jul 14 10:23:04.256335 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1523/3054] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:04 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:05.272567 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-fd4a9999-c74f-48cf-923f-0415af831795 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:05.273278 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-fd4a9999-c74f-48cf-923f-0415af831795 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:05.280668 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd4a9999-c74f-48cf-923f-0415af831795 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:05.281193 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd4a9999-c74f-48cf-923f-0415af831795 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:05.282027 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd4a9999-c74f-48cf-923f-0415af831795 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:05.282561 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-fd4a9999-c74f-48cf-923f-0415af831795 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:05.289321 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] [de5f935d-60fa-4e21-924a-01eba6b6d466] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34606. Jul 14 10:23:05.366741 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-fd4a9999-c74f-48cf-923f-0415af831795 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:05.374541 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-fd4a9999-c74f-48cf-923f-0415af831795 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 200 len: 1509 microversion: 2.1 time: 0.105764 Jul 14 10:23:05.375116 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1532/3055] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:05 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 1509 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:05.438939 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-a3c214d6-c184-4a34-b61e-1f6971718da5 req-7087cb8b-968d-4fac-9be7-5ca99f1392f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2648f6c0-3376-4548-88b9-d127f3885a75", "name": "network-vif-deleted", "tag": "c8073a39-c013-40de-89a1-aa7e7a08975d"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:05.448149 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-a3c214d6-c184-4a34-b61e-1f6971718da5 req-7087cb8b-968d-4fac-9be7-5ca99f1392f5 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:05.448591 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-a3c214d6-c184-4a34-b61e-1f6971718da5 req-7087cb8b-968d-4fac-9be7-5ca99f1392f5 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:05.460876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-a3c214d6-c184-4a34-b61e-1f6971718da5 req-7087cb8b-968d-4fac-9be7-5ca99f1392f5 service nova] Creating event network-vif-deleted:c8073a39-c013-40de-89a1-aa7e7a08975d for instance 2648f6c0-3376-4548-88b9-d127f3885a75 on hv-cinder-82549 Jul 14 10:23:05.466004 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-a3c214d6-c184-4a34-b61e-1f6971718da5 req-7087cb8b-968d-4fac-9be7-5ca99f1392f5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Jul 14 10:23:05.467202 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1524/3056] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:23:06.390669 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:06.391286 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:06.398126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:06.398735 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:06.399644 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:06.400182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:06.414094 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] HTTP exception thrown: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Request method failure captured: Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 HTTP/1.1 Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-3MKujh6UzQVvoOquE6Ivgz9BwmOxCpiCPXHFfB_wkxR02xBJ5wFGoAe2hGk2DsNR2_aEr4qkbb1vd1-_UzRqQQWxbRXYCud1daHCRyDrPOpE8veKK-UcDugueLMMvlvj65K9_jYwdurgKM8GnDJefvVRG6jSgPDaNW2bkI0d1Veog Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:23:06.415858 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 5897368539ef4287bcba0c274c458491 Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:23:06.417291 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '2648f6c0-3376-4548-88b9-d127f3885a75'} Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:23:06.418102 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:23:06.419274 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:23:06.420219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Returning 404 to user: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:23:06.420219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-175fdc00-8950-4a7f-8842-d412cf8afd3f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 404 len: 111 microversion: 2.1 time: 0.030553 Jul 14 10:23:06.420219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1533/3057] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:06 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:23:06.514608 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1683862884", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1398841134", "security_groups": [{"name": "tempest-secgroup-smoke-701861612"}], "block_device_mapping_v2": [{"uuid": "b4f1d3fc-3cb3-4a3c-91fd-fc55ed8c437c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3e560a30-a591-433e-800b-39add59e8d51"}]}} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:06.624326 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.network.neutron [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] validate_networks() for [('3e560a30-a591-433e-800b-39add59e8d51', None, None, None, None, None)] {{(pid=129537) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:23:07.021589 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Flavor limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:23:07.022014 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Image limits 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:23:07.022938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Flavor pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:23:07.023673 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Image pref 0:0:0 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:23:07.024475 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.virt.hardware [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:23:07.036495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:07.037309 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:07.038726 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:07.039178 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:07.055655 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Getting quotas for project c5f8922bb91240a2b1f63f306c6d09d1. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:23:07.059569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.quota [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Getting quotas for user 5897368539ef4287bcba0c274c458491 and project c5f8922bb91240a2b1f63f306c6d09d1. Resources: {'instances', 'cores', 'ram'} {{(pid=129537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:23:07.116725 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Going to run 1 instances... {{(pid=129537) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:23:07.118901 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b4f1d3fc-3cb3-4a3c-91fd-fc55ed8c437c',volume_size=None,volume_type=None)] {{(pid=129537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:23:07.239990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [360e6445-70b6-4c27-81d2-3e70aa5088a8] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 10:23:08.248897 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [360e6445-70b6-4c27-81d2-3e70aa5088a8] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34636. Jul 14 10:23:08.253053 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-2ef68646-3a5b-4fe9-83d4-b4e46aa00bd6 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.743134 Jul 14 10:23:08.254476 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1525/3058] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 10:23:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:23:08.265088 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-1bd5eba2-73a4-46dd-9fde-0454fa803a7e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:08.265701 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-1bd5eba2-73a4-46dd-9fde-0454fa803a7e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:08.321886 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-1bd5eba2-73a4-46dd-9fde-0454fa803a7e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:08.328592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-1bd5eba2-73a4-46dd-9fde-0454fa803a7e tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1095 microversion: 2.1 time: 0.068215 Jul 14 10:23:08.329155 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1534/3059] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:08 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:08.579296 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:23:08.579474 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:23:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:23:09.346315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1b00d2d6-1bec-44ac-8535-9d891bdc6fc1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:09.346876 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1b00d2d6-1bec-44ac-8535-9d891bdc6fc1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:09.358953 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b00d2d6-1bec-44ac-8535-9d891bdc6fc1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:09.359593 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b00d2d6-1bec-44ac-8535-9d891bdc6fc1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:09.360718 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b00d2d6-1bec-44ac-8535-9d891bdc6fc1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:09.361156 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1b00d2d6-1bec-44ac-8535-9d891bdc6fc1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:09.433315 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1b00d2d6-1bec-44ac-8535-9d891bdc6fc1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:09.440723 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1b00d2d6-1bec-44ac-8535-9d891bdc6fc1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1211 microversion: 2.1 time: 0.098817 Jul 14 10:23:09.441316 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1526/3060] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:09 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:10.458060 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f260624c-2619-4d8c-a703-777e2e3a0f54 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:10.458686 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f260624c-2619-4d8c-a703-777e2e3a0f54 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:10.466703 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f260624c-2619-4d8c-a703-777e2e3a0f54 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:10.467160 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f260624c-2619-4d8c-a703-777e2e3a0f54 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:10.467945 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f260624c-2619-4d8c-a703-777e2e3a0f54 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:10.468387 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f260624c-2619-4d8c-a703-777e2e3a0f54 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:10.720637 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f260624c-2619-4d8c-a703-777e2e3a0f54 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:10.728629 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f260624c-2619-4d8c-a703-777e2e3a0f54 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.274499 Jul 14 10:23:10.729188 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1535/3061] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:10 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:11.016262 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-d20452b8-68e7-4c95-b897-01b9ab4a1b6a req-85703e36-5a19-4bb4-bbe2-4ac2c6ab9267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb94aedd-4204-42e8-bb0f-2fdd324331b3", "tag": "bc269076-b07f-4f39-8923-ce383f25f265"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:11.027168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-d20452b8-68e7-4c95-b897-01b9ab4a1b6a req-85703e36-5a19-4bb4-bbe2-4ac2c6ab9267 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:11.028027 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-d20452b8-68e7-4c95-b897-01b9ab4a1b6a req-85703e36-5a19-4bb4-bbe2-4ac2c6ab9267 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:11.044577 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-d20452b8-68e7-4c95-b897-01b9ab4a1b6a req-85703e36-5a19-4bb4-bbe2-4ac2c6ab9267 service nova] Creating event network-changed:bc269076-b07f-4f39-8923-ce383f25f265 for instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 on hv-cinder-82549 Jul 14 10:23:11.050107 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-d20452b8-68e7-4c95-b897-01b9ab4a1b6a req-85703e36-5a19-4bb4-bbe2-4ac2c6ab9267 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039386 Jul 14 10:23:11.050804 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1527/3062] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:23:11.744498 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0acff268-665b-4fd1-9031-a8ba9259c908 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:11.745110 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0acff268-665b-4fd1-9031-a8ba9259c908 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:11.751589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0acff268-665b-4fd1-9031-a8ba9259c908 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:11.752037 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0acff268-665b-4fd1-9031-a8ba9259c908 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:11.752789 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0acff268-665b-4fd1-9031-a8ba9259c908 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:11.753276 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0acff268-665b-4fd1-9031-a8ba9259c908 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:11.884715 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-0acff268-665b-4fd1-9031-a8ba9259c908 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:11.892064 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0acff268-665b-4fd1-9031-a8ba9259c908 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.151430 Jul 14 10:23:11.892616 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1536/3063] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:11 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:12.909983 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-17e0d525-a4c6-4922-bafd-d082e394f344 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:12.910706 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-17e0d525-a4c6-4922-bafd-d082e394f344 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:12.916875 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17e0d525-a4c6-4922-bafd-d082e394f344 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:12.917323 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17e0d525-a4c6-4922-bafd-d082e394f344 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:12.918081 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17e0d525-a4c6-4922-bafd-d082e394f344 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:12.918550 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-17e0d525-a4c6-4922-bafd-d082e394f344 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:13.062654 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-17e0d525-a4c6-4922-bafd-d082e394f344 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:13.070275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-17e0d525-a4c6-4922-bafd-d082e394f344 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.165545 Jul 14 10:23:13.070828 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1528/3064] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:12 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:14.087806 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-f3298d80-51a0-406c-9b0b-11135ea0dbdd tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:14.088412 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-f3298d80-51a0-406c-9b0b-11135ea0dbdd tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:14.094884 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3298d80-51a0-406c-9b0b-11135ea0dbdd tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:14.095328 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3298d80-51a0-406c-9b0b-11135ea0dbdd tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:14.096073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3298d80-51a0-406c-9b0b-11135ea0dbdd tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:14.096501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-f3298d80-51a0-406c-9b0b-11135ea0dbdd tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:14.223259 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-f3298d80-51a0-406c-9b0b-11135ea0dbdd tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:14.230676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-f3298d80-51a0-406c-9b0b-11135ea0dbdd tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.146701 Jul 14 10:23:14.231233 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1537/3065] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:14 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:15.246168 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-36139699-8ae1-47c1-81a0-0334ce0bfc94 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:15.246791 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-36139699-8ae1-47c1-81a0-0334ce0bfc94 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:15.253199 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36139699-8ae1-47c1-81a0-0334ce0bfc94 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:15.253633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36139699-8ae1-47c1-81a0-0334ce0bfc94 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:15.254410 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36139699-8ae1-47c1-81a0-0334ce0bfc94 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:15.254839 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-36139699-8ae1-47c1-81a0-0334ce0bfc94 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:15.386647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-36139699-8ae1-47c1-81a0-0334ce0bfc94 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:15.394436 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-36139699-8ae1-47c1-81a0-0334ce0bfc94 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.151533 Jul 14 10:23:15.394990 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1529/3066] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:15 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:16.411006 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-80c49867-9817-40b7-904a-56f3870b6f2f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:16.412122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-80c49867-9817-40b7-904a-56f3870b6f2f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:16.418693 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-80c49867-9817-40b7-904a-56f3870b6f2f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:16.419148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-80c49867-9817-40b7-904a-56f3870b6f2f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:16.419912 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-80c49867-9817-40b7-904a-56f3870b6f2f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:16.420353 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-80c49867-9817-40b7-904a-56f3870b6f2f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:16.547578 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-80c49867-9817-40b7-904a-56f3870b6f2f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:16.555066 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-80c49867-9817-40b7-904a-56f3870b6f2f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.148018 Jul 14 10:23:16.555636 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1538/3067] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:16 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:17.571472 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-6fde3c98-d518-4ed0-a27f-069c377b1e6f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:17.572077 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-6fde3c98-d518-4ed0-a27f-069c377b1e6f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:17.574569 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:17.575226 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=6 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:17.580843 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6fde3c98-d518-4ed0-a27f-069c377b1e6f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:17.581785 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6fde3c98-d518-4ed0-a27f-069c377b1e6f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:17.582573 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6fde3c98-d518-4ed0-a27f-069c377b1e6f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:17.583003 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-6fde3c98-d518-4ed0-a27f-069c377b1e6f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:17.722833 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-6fde3c98-d518-4ed0-a27f-069c377b1e6f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:17.730288 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-6fde3c98-d518-4ed0-a27f-069c377b1e6f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.163216 Jul 14 10:23:17.730845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1530/3068] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:17 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:18.746979 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-664f9bfb-5466-472b-9ab3-e11aaf537602 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:18.747582 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-664f9bfb-5466-472b-9ab3-e11aaf537602 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:18.749830 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:18.755706 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-664f9bfb-5466-472b-9ab3-e11aaf537602 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:18.756151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-664f9bfb-5466-472b-9ab3-e11aaf537602 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:18.756895 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-664f9bfb-5466-472b-9ab3-e11aaf537602 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:18.757327 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-664f9bfb-5466-472b-9ab3-e11aaf537602 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:18.886436 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-664f9bfb-5466-472b-9ab3-e11aaf537602 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:18.894460 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-664f9bfb-5466-472b-9ab3-e11aaf537602 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.151016 Jul 14 10:23:18.895010 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1539/3069] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:18 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:19.911664 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-56e2d804-53e5-45ad-b012-cf7762a56b29 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:19.912297 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-56e2d804-53e5-45ad-b012-cf7762a56b29 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:19.918781 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56e2d804-53e5-45ad-b012-cf7762a56b29 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:19.919221 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56e2d804-53e5-45ad-b012-cf7762a56b29 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:19.920204 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56e2d804-53e5-45ad-b012-cf7762a56b29 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:19.920428 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-56e2d804-53e5-45ad-b012-cf7762a56b29 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:20.054229 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-56e2d804-53e5-45ad-b012-cf7762a56b29 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:20.061647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-56e2d804-53e5-45ad-b012-cf7762a56b29 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.154516 Jul 14 10:23:20.062216 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1531/3070] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:19 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:21.078885 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-db2eebd0-70d9-4084-a7d1-4092d5562455 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:21.079496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-db2eebd0-70d9-4084-a7d1-4092d5562455 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:21.086601 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db2eebd0-70d9-4084-a7d1-4092d5562455 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:21.087055 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db2eebd0-70d9-4084-a7d1-4092d5562455 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:21.087819 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db2eebd0-70d9-4084-a7d1-4092d5562455 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:21.088551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-db2eebd0-70d9-4084-a7d1-4092d5562455 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:21.224138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-db2eebd0-70d9-4084-a7d1-4092d5562455 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:21.231581 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-db2eebd0-70d9-4084-a7d1-4092d5562455 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.156549 Jul 14 10:23:21.232258 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1540/3071] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:21 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:22.248676 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b0f03c6f-3538-4487-8ba3-8f37c66efeff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:22.249275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b0f03c6f-3538-4487-8ba3-8f37c66efeff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:22.256051 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0f03c6f-3538-4487-8ba3-8f37c66efeff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:22.256491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0f03c6f-3538-4487-8ba3-8f37c66efeff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:22.257236 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0f03c6f-3538-4487-8ba3-8f37c66efeff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:22.257777 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b0f03c6f-3538-4487-8ba3-8f37c66efeff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:22.389512 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b0f03c6f-3538-4487-8ba3-8f37c66efeff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:22.397963 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b0f03c6f-3538-4487-8ba3-8f37c66efeff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.153105 Jul 14 10:23:22.398563 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1532/3072] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:22 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:22.547108 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-d709e769-8b7e-4c91-bff4-6cec3e6fe43d req-d1269fce-1428-442e-b7c0-0f557a192e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb94aedd-4204-42e8-bb0f-2fdd324331b3", "name": "network-vif-plugged", "status": "completed", "tag": "bc269076-b07f-4f39-8923-ce383f25f265"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:22.556389 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-d709e769-8b7e-4c91-bff4-6cec3e6fe43d req-d1269fce-1428-442e-b7c0-0f557a192e27 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:22.556836 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-d709e769-8b7e-4c91-bff4-6cec3e6fe43d req-d1269fce-1428-442e-b7c0-0f557a192e27 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:22.568845 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-d709e769-8b7e-4c91-bff4-6cec3e6fe43d req-d1269fce-1428-442e-b7c0-0f557a192e27 service nova] Creating event network-vif-plugged:bc269076-b07f-4f39-8923-ce383f25f265 for instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 on hv-cinder-82549 Jul 14 10:23:22.574545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-d709e769-8b7e-4c91-bff4-6cec3e6fe43d req-d1269fce-1428-442e-b7c0-0f557a192e27 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100325 Jul 14 10:23:22.575137 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1541/3073] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:23:23.414771 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-f98dea0a-f9bb-4023-a196-10cee17f2190 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:23.415409 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-f98dea0a-f9bb-4023-a196-10cee17f2190 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:23.421910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f98dea0a-f9bb-4023-a196-10cee17f2190 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:23.422388 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f98dea0a-f9bb-4023-a196-10cee17f2190 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:23.423139 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f98dea0a-f9bb-4023-a196-10cee17f2190 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:23.423568 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-f98dea0a-f9bb-4023-a196-10cee17f2190 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:23.553767 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-f98dea0a-f9bb-4023-a196-10cee17f2190 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:23.561330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-f98dea0a-f9bb-4023-a196-10cee17f2190 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.150442 Jul 14 10:23:23.561894 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1533/3074] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:23 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:24.581255 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c5c849f0-7427-4224-ac14-f307105de08d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:24.581952 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c5c849f0-7427-4224-ac14-f307105de08d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:24.588812 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5c849f0-7427-4224-ac14-f307105de08d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:24.589263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5c849f0-7427-4224-ac14-f307105de08d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:24.590032 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5c849f0-7427-4224-ac14-f307105de08d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:24.590507 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c5c849f0-7427-4224-ac14-f307105de08d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:24.728113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c5c849f0-7427-4224-ac14-f307105de08d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:24.736058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c5c849f0-7427-4224-ac14-f307105de08d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1266 microversion: 2.1 time: 0.158922 Jul 14 10:23:24.737547 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1542/3075] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:24 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:25.752841 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-c3004032-ecd7-4c21-b6df-268c2d49add1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:25.753439 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-c3004032-ecd7-4c21-b6df-268c2d49add1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:25.759870 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3004032-ecd7-4c21-b6df-268c2d49add1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:25.760308 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3004032-ecd7-4c21-b6df-268c2d49add1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:25.761075 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3004032-ecd7-4c21-b6df-268c2d49add1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:25.761498 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-c3004032-ecd7-4c21-b6df-268c2d49add1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:25.890011 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-c3004032-ecd7-4c21-b6df-268c2d49add1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:25.897856 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-c3004032-ecd7-4c21-b6df-268c2d49add1 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1454 microversion: 2.1 time: 0.148879 Jul 14 10:23:25.898514 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1534/3076] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:25 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:25.914033 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-81f6964b-0797-4f41-85cf-1e1d0785dd71 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:25.914676 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-81f6964b-0797-4f41-85cf-1e1d0785dd71 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:25.921168 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81f6964b-0797-4f41-85cf-1e1d0785dd71 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:25.921622 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81f6964b-0797-4f41-85cf-1e1d0785dd71 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:25.922426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81f6964b-0797-4f41-85cf-1e1d0785dd71 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:25.922869 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-81f6964b-0797-4f41-85cf-1e1d0785dd71 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:26.051166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-81f6964b-0797-4f41-85cf-1e1d0785dd71 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:26.058633 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-81f6964b-0797-4f41-85cf-1e1d0785dd71 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1454 microversion: 2.1 time: 0.148430 Jul 14 10:23:26.059201 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1543/3077] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:25 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:27.587823 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-0d84d4ca-bb11-450a-bb48-eb03592b5a4b req-26432ec3-af1a-4ff5-a9cd-eb3b60d94416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb94aedd-4204-42e8-bb0f-2fdd324331b3", "tag": "bc269076-b07f-4f39-8923-ce383f25f265"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:27.596730 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-0d84d4ca-bb11-450a-bb48-eb03592b5a4b req-26432ec3-af1a-4ff5-a9cd-eb3b60d94416 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:27.597179 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-0d84d4ca-bb11-450a-bb48-eb03592b5a4b req-26432ec3-af1a-4ff5-a9cd-eb3b60d94416 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:27.608076 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-0d84d4ca-bb11-450a-bb48-eb03592b5a4b req-26432ec3-af1a-4ff5-a9cd-eb3b60d94416 service nova] Creating event network-changed:bc269076-b07f-4f39-8923-ce383f25f265 for instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 on hv-cinder-82549 Jul 14 10:23:27.614700 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-0d84d4ca-bb11-450a-bb48-eb03592b5a4b req-26432ec3-af1a-4ff5-a9cd-eb3b60d94416 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030449 Jul 14 10:23:27.615860 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1535/3078] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:25:30.922596 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=28 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:30.923341 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=64 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:30.928075 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2070339202", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1398841134", "security_groups": [{"name": "tempest-secgroup-smoke-701861612"}], "block_device_mapping_v2": [{"uuid": "5afd6489-d1f2-4009-ad17-4cb435a51e98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3e560a30-a591-433e-800b-39add59e8d51"}]}} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:25:31.036165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.network.neutron [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] validate_networks() for [('3e560a30-a591-433e-800b-39add59e8d51', None, None, None, None, None)] {{(pid=129536) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:25:31.449270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Flavor limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:25:31.449700 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Image limits 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:25:31.450237 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Flavor pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:25:31.450688 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Image pref 0:0:0 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:25:31.451104 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.virt.hardware [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:25:31.462905 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:31.463358 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:31.464154 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:31.464593 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:31.481480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Getting quotas for project c5f8922bb91240a2b1f63f306c6d09d1. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:25:31.485496 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.quota [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Getting quotas for user 5897368539ef4287bcba0c274c458491 and project c5f8922bb91240a2b1f63f306c6d09d1. Resources: {'instances', 'cores', 'ram'} {{(pid=129536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:25:31.542438 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Going to run 1 instances... {{(pid=129536) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:25:31.544545 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5afd6489-d1f2-4009-ad17-4cb435a51e98',volume_size=None,volume_type=None)] {{(pid=129536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:25:31.672373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-0a86bec0-e8b2-4b9e-b855-8ab06ebf8ee0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751573 Jul 14 10:25:31.673043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1544/3079] 10.222.0.40 () {60 vars in 1146 bytes} [Thu Jul 14 10:25:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:25:31.681144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e21697ee-567a-42d2-b54d-7facf68bf57e] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 10:25:31.681736 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:31.682491 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:31.687249 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-4e5147f2-cf0c-4e8b-8ce2-babd35d1ff4b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:31.687942 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-4e5147f2-cf0c-4e8b-8ce2-babd35d1ff4b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:31.809938 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-4e5147f2-cf0c-4e8b-8ce2-babd35d1ff4b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:31.817609 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-4e5147f2-cf0c-4e8b-8ce2-babd35d1ff4b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1095 microversion: 2.1 time: 0.138318 Jul 14 10:25:31.818155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1536/3080] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:31 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1095 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:32.834226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-dffec5dc-07dd-4510-96fd-4dbbc301facb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:32.835186 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-dffec5dc-07dd-4510-96fd-4dbbc301facb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:32.843722 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dffec5dc-07dd-4510-96fd-4dbbc301facb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:32.844178 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dffec5dc-07dd-4510-96fd-4dbbc301facb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:32.845023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dffec5dc-07dd-4510-96fd-4dbbc301facb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:32.845455 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-dffec5dc-07dd-4510-96fd-4dbbc301facb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:32.906544 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-dffec5dc-07dd-4510-96fd-4dbbc301facb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:32.914989 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-dffec5dc-07dd-4510-96fd-4dbbc301facb tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1211 microversion: 2.1 time: 0.085236 Jul 14 10:25:32.915802 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1545/3081] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:32 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:33.932336 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-aa9a1c58-78fa-41e5-b723-1cdb30b9b746 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:33.933057 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-aa9a1c58-78fa-41e5-b723-1cdb30b9b746 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:33.942620 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aa9a1c58-78fa-41e5-b723-1cdb30b9b746 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:33.943064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aa9a1c58-78fa-41e5-b723-1cdb30b9b746 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:33.944130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aa9a1c58-78fa-41e5-b723-1cdb30b9b746 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:33.944702 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-aa9a1c58-78fa-41e5-b723-1cdb30b9b746 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:33.969228 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] [e21697ee-567a-42d2-b54d-7facf68bf57e] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34812. Jul 14 10:25:34.093177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-59df0a59-813e-436c-8938-383754b92e99 req-18633cf6-10fb-44eb-a92e-c12f758fb9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6", "tag": "5a545a4b-9ed4-4729-8ab7-2809c9d82492"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:25:34.103040 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-59df0a59-813e-436c-8938-383754b92e99 req-18633cf6-10fb-44eb-a92e-c12f758fb9f0 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:34.103490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-59df0a59-813e-436c-8938-383754b92e99 req-18633cf6-10fb-44eb-a92e-c12f758fb9f0 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:34.116444 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-59df0a59-813e-436c-8938-383754b92e99 req-18633cf6-10fb-44eb-a92e-c12f758fb9f0 service nova] Creating event network-changed:5a545a4b-9ed4-4729-8ab7-2809c9d82492 for instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 on hv-cinder-82549 Jul 14 10:25:34.121383 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-aa9a1c58-78fa-41e5-b723-1cdb30b9b746 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:34.126673 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-59df0a59-813e-436c-8938-383754b92e99 req-18633cf6-10fb-44eb-a92e-c12f758fb9f0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129757 Jul 14 10:25:34.128362 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1546/3082] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:25:34.130636 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-aa9a1c58-78fa-41e5-b723-1cdb30b9b746 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.202014 Jul 14 10:25:34.134692 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1537/3083] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:33 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:35.149270 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-112dd2b0-3e93-41a3-8132-7249013a0b4f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:35.149980 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-112dd2b0-3e93-41a3-8132-7249013a0b4f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:35.156294 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-112dd2b0-3e93-41a3-8132-7249013a0b4f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:35.156751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-112dd2b0-3e93-41a3-8132-7249013a0b4f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:35.157508 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-112dd2b0-3e93-41a3-8132-7249013a0b4f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:35.157947 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-112dd2b0-3e93-41a3-8132-7249013a0b4f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:35.286249 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-112dd2b0-3e93-41a3-8132-7249013a0b4f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:35.293727 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-112dd2b0-3e93-41a3-8132-7249013a0b4f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.149764 Jul 14 10:25:35.294303 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1547/3084] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:35 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:36.310796 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-59ae85ae-0436-46cd-a08f-f7b29f834dbf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:36.311398 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-59ae85ae-0436-46cd-a08f-f7b29f834dbf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:36.318132 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59ae85ae-0436-46cd-a08f-f7b29f834dbf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:36.318607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59ae85ae-0436-46cd-a08f-f7b29f834dbf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:36.319359 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59ae85ae-0436-46cd-a08f-f7b29f834dbf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:36.319790 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-59ae85ae-0436-46cd-a08f-f7b29f834dbf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:36.448193 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-59ae85ae-0436-46cd-a08f-f7b29f834dbf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:36.455513 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-59ae85ae-0436-46cd-a08f-f7b29f834dbf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.148554 Jul 14 10:25:36.456072 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1538/3085] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:36 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:37.473112 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-74729a38-a957-4e8a-b7e8-927d4c67da96 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:37.473734 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-74729a38-a957-4e8a-b7e8-927d4c67da96 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:37.480148 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74729a38-a957-4e8a-b7e8-927d4c67da96 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:37.480592 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74729a38-a957-4e8a-b7e8-927d4c67da96 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:37.481339 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74729a38-a957-4e8a-b7e8-927d4c67da96 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:37.481770 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-74729a38-a957-4e8a-b7e8-927d4c67da96 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:37.610250 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-74729a38-a957-4e8a-b7e8-927d4c67da96 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:37.617681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-74729a38-a957-4e8a-b7e8-927d4c67da96 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.148942 Jul 14 10:25:37.618370 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1548/3086] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:37 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:38.634926 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-cc102d99-39fa-4b29-824b-5702057bd45a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:38.635526 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-cc102d99-39fa-4b29-824b-5702057bd45a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:38.641907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc102d99-39fa-4b29-824b-5702057bd45a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:38.642392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc102d99-39fa-4b29-824b-5702057bd45a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:38.643141 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc102d99-39fa-4b29-824b-5702057bd45a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:38.643564 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-cc102d99-39fa-4b29-824b-5702057bd45a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:38.768914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-cc102d99-39fa-4b29-824b-5702057bd45a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:38.776346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-cc102d99-39fa-4b29-824b-5702057bd45a tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.145217 Jul 14 10:25:38.776907 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1539/3087] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:38 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:39.794505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-23e777a8-9a56-4131-aabd-086f849edff9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:39.795113 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-23e777a8-9a56-4131-aabd-086f849edff9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:39.802014 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-23e777a8-9a56-4131-aabd-086f849edff9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:39.802481 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-23e777a8-9a56-4131-aabd-086f849edff9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:39.803228 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-23e777a8-9a56-4131-aabd-086f849edff9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:39.803658 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-23e777a8-9a56-4131-aabd-086f849edff9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:39.933414 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-23e777a8-9a56-4131-aabd-086f849edff9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:39.940751 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-23e777a8-9a56-4131-aabd-086f849edff9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.150090 Jul 14 10:25:39.942267 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1549/3088] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:39 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:40.958792 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-b04ff0e0-e4b0-4889-8af6-94293509a509 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:40.959392 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-b04ff0e0-e4b0-4889-8af6-94293509a509 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:40.965794 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b04ff0e0-e4b0-4889-8af6-94293509a509 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:40.966256 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b04ff0e0-e4b0-4889-8af6-94293509a509 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:40.966999 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b04ff0e0-e4b0-4889-8af6-94293509a509 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:40.967423 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-b04ff0e0-e4b0-4889-8af6-94293509a509 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:41.095232 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-b04ff0e0-e4b0-4889-8af6-94293509a509 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:41.103070 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-b04ff0e0-e4b0-4889-8af6-94293509a509 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.148521 Jul 14 10:25:41.103849 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1540/3089] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:40 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:42.121254 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-117e5ebf-ead6-48af-b656-434629e0ac6d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:42.121766 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-117e5ebf-ead6-48af-b656-434629e0ac6d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:42.124221 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=2 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:42.124864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell0:SELECT=6 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:42.131855 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-117e5ebf-ead6-48af-b656-434629e0ac6d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:42.132297 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-117e5ebf-ead6-48af-b656-434629e0ac6d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:42.133052 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-117e5ebf-ead6-48af-b656-434629e0ac6d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:42.133485 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-117e5ebf-ead6-48af-b656-434629e0ac6d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:42.266151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-117e5ebf-ead6-48af-b656-434629e0ac6d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:42.273632 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-117e5ebf-ead6-48af-b656-434629e0ac6d tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.156336 Jul 14 10:25:42.274195 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1550/3090] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:42 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:43.290037 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-470d85d1-8b15-4123-99c7-cc595ef5594f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:43.290679 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-470d85d1-8b15-4123-99c7-cc595ef5594f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:43.292556 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell0:SELECT=2 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:25:43.298201 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-470d85d1-8b15-4123-99c7-cc595ef5594f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:43.298647 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-470d85d1-8b15-4123-99c7-cc595ef5594f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:43.299390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-470d85d1-8b15-4123-99c7-cc595ef5594f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:43.299822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-470d85d1-8b15-4123-99c7-cc595ef5594f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:43.426683 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-470d85d1-8b15-4123-99c7-cc595ef5594f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:43.434063 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-470d85d1-8b15-4123-99c7-cc595ef5594f tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.147844 Jul 14 10:25:43.434644 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1541/3091] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:43 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:44.451417 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-2c33b0b1-7fe4-453f-bd52-e28e8b603ad9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:44.452023 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-2c33b0b1-7fe4-453f-bd52-e28e8b603ad9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:44.458556 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c33b0b1-7fe4-453f-bd52-e28e8b603ad9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:44.459080 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c33b0b1-7fe4-453f-bd52-e28e8b603ad9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:44.459828 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c33b0b1-7fe4-453f-bd52-e28e8b603ad9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:44.460253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-2c33b0b1-7fe4-453f-bd52-e28e8b603ad9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:44.592074 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-2c33b0b1-7fe4-453f-bd52-e28e8b603ad9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:44.599490 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-2c33b0b1-7fe4-453f-bd52-e28e8b603ad9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.151914 Jul 14 10:25:44.600042 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1551/3092] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:44 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:45.615903 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-ece2958c-02f3-411e-ba67-4d810053f0e7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:45.616507 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-ece2958c-02f3-411e-ba67-4d810053f0e7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:45.622961 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ece2958c-02f3-411e-ba67-4d810053f0e7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:45.623404 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ece2958c-02f3-411e-ba67-4d810053f0e7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:45.624155 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ece2958c-02f3-411e-ba67-4d810053f0e7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:45.624584 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-ece2958c-02f3-411e-ba67-4d810053f0e7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:46.022774 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-ece2958c-02f3-411e-ba67-4d810053f0e7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:46.030745 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-ece2958c-02f3-411e-ba67-4d810053f0e7 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.418664 Jul 14 10:25:46.031339 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1542/3093] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:45 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:25:47.047480 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-c8dc97ca-80a4-41f3-9da5-65fc8b5484c9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:47.048600 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-c8dc97ca-80a4-41f3-9da5-65fc8b5484c9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:47.051313 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [req-7c9f4fc8-b75e-4f88-955a-3499227bea2a req-3a6b9d67-8f34-4856-ab36-dc5f53c3bcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6", "name": "network-vif-plugged", "status": "completed", "tag": "5a545a4b-9ed4-4729-8ab7-2809c9d82492"}]} {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:25:47.055300 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8dc97ca-80a4-41f3-9da5-65fc8b5484c9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:47.055747 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8dc97ca-80a4-41f3-9da5-65fc8b5484c9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:47.056511 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8dc97ca-80a4-41f3-9da5-65fc8b5484c9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:47.056958 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-c8dc97ca-80a4-41f3-9da5-65fc8b5484c9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:47.062017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-7c9f4fc8-b75e-4f88-955a-3499227bea2a req-3a6b9d67-8f34-4856-ab36-dc5f53c3bcb9 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:47.062017 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [req-7c9f4fc8-b75e-4f88-955a-3499227bea2a req-3a6b9d67-8f34-4856-ab36-dc5f53c3bcb9 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:47.078628 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.compute.server_external_events [req-7c9f4fc8-b75e-4f88-955a-3499227bea2a req-3a6b9d67-8f34-4856-ab36-dc5f53c3bcb9 service nova] Creating event network-vif-plugged:5a545a4b-9ed4-4729-8ab7-2809c9d82492 for instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 on hv-cinder-82549 Jul 14 10:25:47.085319 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [req-7c9f4fc8-b75e-4f88-955a-3499227bea2a req-3a6b9d67-8f34-4856-ab36-dc5f53c3bcb9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037630 Jul 14 10:25:47.086074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1543/3094] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:25:47.193119 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-c8dc97ca-80a4-41f3-9da5-65fc8b5484c9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:47.201466 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-c8dc97ca-80a4-41f3-9da5-65fc8b5484c9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.157945 Jul 14 10:25:47.202035 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1552/3095] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:47 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:48.219144 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-3a6bcef5-4ee5-491b-bd5a-d296a8fa2311 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:48.219827 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-3a6bcef5-4ee5-491b-bd5a-d296a8fa2311 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:48.227188 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3a6bcef5-4ee5-491b-bd5a-d296a8fa2311 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:48.227627 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3a6bcef5-4ee5-491b-bd5a-d296a8fa2311 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:48.228363 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3a6bcef5-4ee5-491b-bd5a-d296a8fa2311 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:48.228786 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-3a6bcef5-4ee5-491b-bd5a-d296a8fa2311 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:48.358685 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-3a6bcef5-4ee5-491b-bd5a-d296a8fa2311 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:48.366393 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-3a6bcef5-4ee5-491b-bd5a-d296a8fa2311 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1266 microversion: 2.1 time: 0.151421 Jul 14 10:25:48.366941 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1544/3096] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:48 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:49.383505 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-6bc43bb8-da46-47bc-b76e-bf9d58e51984 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:49.384058 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-6bc43bb8-da46-47bc-b76e-bf9d58e51984 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:49.390477 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bc43bb8-da46-47bc-b76e-bf9d58e51984 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:49.390922 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bc43bb8-da46-47bc-b76e-bf9d58e51984 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:49.391697 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bc43bb8-da46-47bc-b76e-bf9d58e51984 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:49.392156 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-6bc43bb8-da46-47bc-b76e-bf9d58e51984 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:49.520348 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-6bc43bb8-da46-47bc-b76e-bf9d58e51984 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:49.527909 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-6bc43bb8-da46-47bc-b76e-bf9d58e51984 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1454 microversion: 2.1 time: 0.148342 Jul 14 10:25:49.528473 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1553/3097] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:49 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:49.544211 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-960b0dfd-84b1-45fd-ab86-4e66df0d0cd9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:49.544814 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-960b0dfd-84b1-45fd-ab86-4e66df0d0cd9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:49.551438 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-960b0dfd-84b1-45fd-ab86-4e66df0d0cd9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:49.551882 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-960b0dfd-84b1-45fd-ab86-4e66df0d0cd9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:49.552633 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-960b0dfd-84b1-45fd-ab86-4e66df0d0cd9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:49.553064 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-960b0dfd-84b1-45fd-ab86-4e66df0d0cd9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:49.681243 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-960b0dfd-84b1-45fd-ab86-4e66df0d0cd9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:49.688715 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-960b0dfd-84b1-45fd-ab86-4e66df0d0cd9 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1454 microversion: 2.1 time: 0.148323 Jul 14 10:25:49.689275 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1545/3098] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:49 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:25:51.443712 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-b9ae0878-9637-46ef-a6f1-05635766cdf8 req-63f45eff-1d14-44dd-9752-a6b5ac055c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6", "tag": "5a545a4b-9ed4-4729-8ab7-2809c9d82492"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:25:51.452145 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-b9ae0878-9637-46ef-a6f1-05635766cdf8 req-63f45eff-1d14-44dd-9752-a6b5ac055c6d service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:51.452589 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-b9ae0878-9637-46ef-a6f1-05635766cdf8 req-63f45eff-1d14-44dd-9752-a6b5ac055c6d service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:51.465182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-b9ae0878-9637-46ef-a6f1-05635766cdf8 req-63f45eff-1d14-44dd-9752-a6b5ac055c6d service nova] Creating event network-changed:5a545a4b-9ed4-4729-8ab7-2809c9d82492 for instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 on hv-cinder-82549 Jul 14 10:25:51.470652 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-b9ae0878-9637-46ef-a6f1-05635766cdf8 req-63f45eff-1d14-44dd-9752-a6b5ac055c6d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114233 Jul 14 10:25:51.471446 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1554/3099] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:26:18.367390 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:26:18.367896 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:26:28.587800 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:26:28.588206 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:26:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:28:02.011426 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:28:02.012242 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:28:08.306885 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:28:08.307458 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:28:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:28:08.995048 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de5f935d-60fa-4e21-924a-01eba6b6d466] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 10:28:08.995563 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:08.995866 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-eb854568-515c-491b-ad87-a15e75db19c0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:08.996282 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG dbcounter [-] [129536] Writing DB stats nova_cell1:SELECT=54 {{(pid=129536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:08.996402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eb854568-515c-491b-ad87-a15e75db19c0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:09.000172 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_api:SELECT=22 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:09.000615 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-112a121a-4374-4c82-a1ce-b72f180ff8ff req-c2a64ae1-9275-4d0a-a950-b18e8588ffdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6", "tag": "5a545a4b-9ed4-4729-8ab7-2809c9d82492"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:28:09.000807 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG dbcounter [-] [129537] Writing DB stats nova_cell1:SELECT=50 {{(pid=129537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:28:09.005354 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb854568-515c-491b-ad87-a15e75db19c0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:09.005797 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb854568-515c-491b-ad87-a15e75db19c0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:09.006596 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb854568-515c-491b-ad87-a15e75db19c0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:09.007028 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-eb854568-515c-491b-ad87-a15e75db19c0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:09.020003 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-112a121a-4374-4c82-a1ce-b72f180ff8ff req-c2a64ae1-9275-4d0a-a950-b18e8588ffdf service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:09.021272 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-112a121a-4374-4c82-a1ce-b72f180ff8ff req-c2a64ae1-9275-4d0a-a950-b18e8588ffdf service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:09.035453 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-eb854568-515c-491b-ad87-a15e75db19c0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:28:09.037138 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-112a121a-4374-4c82-a1ce-b72f180ff8ff req-c2a64ae1-9275-4d0a-a950-b18e8588ffdf service nova] Creating event network-changed:5a545a4b-9ed4-4729-8ab7-2809c9d82492 for instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 on hv-cinder-82549 Jul 14 10:28:09.042705 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-112a121a-4374-4c82-a1ce-b72f180ff8ff req-c2a64ae1-9275-4d0a-a950-b18e8588ffdf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049394 Jul 14 10:28:09.043323 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1555/3100] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:28:09.126582 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-eb854568-515c-491b-ad87-a15e75db19c0 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 204 len: 0 microversion: 2.1 time: 0.135629 Jul 14 10:28:09.131105 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1546/3101] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:28:08 2022] DELETE /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:28:09.140731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-035901c0-b4a7-4c5f-b0c1-0488290294da tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:09.142913 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-035901c0-b4a7-4c5f-b0c1-0488290294da tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:09.153992 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-035901c0-b4a7-4c5f-b0c1-0488290294da tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:09.154475 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-035901c0-b4a7-4c5f-b0c1-0488290294da tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:09.155253 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-035901c0-b4a7-4c5f-b0c1-0488290294da tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:09.155681 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-035901c0-b4a7-4c5f-b0c1-0488290294da tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:09.467857 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-035901c0-b4a7-4c5f-b0c1-0488290294da tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:28:09.475762 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-035901c0-b4a7-4c5f-b0c1-0488290294da tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1579 microversion: 2.1 time: 0.342274 Jul 14 10:28:09.476337 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1556/3102] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:09 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1579 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:28:10.494948 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-1d42ef9f-ddbb-4b30-864a-beb9313afb9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:10.495607 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-1d42ef9f-ddbb-4b30-864a-beb9313afb9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:10.502162 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d42ef9f-ddbb-4b30-864a-beb9313afb9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:10.502663 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d42ef9f-ddbb-4b30-864a-beb9313afb9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:10.503413 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d42ef9f-ddbb-4b30-864a-beb9313afb9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:10.503836 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-1d42ef9f-ddbb-4b30-864a-beb9313afb9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:10.636111 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-1d42ef9f-ddbb-4b30-864a-beb9313afb9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:28:10.643666 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-1d42ef9f-ddbb-4b30-864a-beb9313afb9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1579 microversion: 2.1 time: 0.153079 Jul 14 10:28:10.644220 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1547/3103] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:10 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:28:11.430043 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-2f28912d-e2af-4175-be2c-7269baa9e8cb req-7a190c56-aa2e-4e5a-9b93-6a0187e82e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6", "name": "network-vif-deleted", "tag": "5a545a4b-9ed4-4729-8ab7-2809c9d82492"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:28:11.440151 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-2f28912d-e2af-4175-be2c-7269baa9e8cb req-7a190c56-aa2e-4e5a-9b93-6a0187e82e93 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:11.440861 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-2f28912d-e2af-4175-be2c-7269baa9e8cb req-7a190c56-aa2e-4e5a-9b93-6a0187e82e93 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:11.453664 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-2f28912d-e2af-4175-be2c-7269baa9e8cb req-7a190c56-aa2e-4e5a-9b93-6a0187e82e93 service nova] Creating event network-vif-deleted:5a545a4b-9ed4-4729-8ab7-2809c9d82492 for instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 on hv-cinder-82549 Jul 14 10:28:11.459263 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-2f28912d-e2af-4175-be2c-7269baa9e8cb req-7a190c56-aa2e-4e5a-9b93-6a0187e82e93 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033394 Jul 14 10:28:11.459957 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1557/3104] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:28:11.660914 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-d289c734-8c2b-4d6c-8000-bd251738f200 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:11.662013 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-d289c734-8c2b-4d6c-8000-bd251738f200 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:11.668734 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d289c734-8c2b-4d6c-8000-bd251738f200 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:11.669183 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d289c734-8c2b-4d6c-8000-bd251738f200 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:11.669945 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d289c734-8c2b-4d6c-8000-bd251738f200 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:11.670415 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-d289c734-8c2b-4d6c-8000-bd251738f200 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:11.738529 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-d289c734-8c2b-4d6c-8000-bd251738f200 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:28:11.747215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-d289c734-8c2b-4d6c-8000-bd251738f200 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 200 len: 1226 microversion: 2.1 time: 0.090158 Jul 14 10:28:11.747987 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1548/3105] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:11 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:28:12.764177 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:12.764864 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:12.769373 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] [de5f935d-60fa-4e21-924a-01eba6b6d466] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 34930. Jul 14 10:28:12.775501 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:12.775927 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:12.776691 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:12.777122 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:12.792070 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] HTTP exception thrown: Instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 could not be found. Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Request method failure captured: Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 HTTP/1.1 Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-3MKujh6UzQVvoOquE6Ivgz9BwmOxCpiCPXHFfB_wkxR02xBJ5wFGoAe2hGk2DsNR2_aEr4qkbb1vd1-_UzRqQQWxbRXYCud1daHCRyDrPOpE8veKK-UcDugueLMMvlvj65K9_jYwdurgKM8GnDJefvVRG6jSgPDaNW2bkI0d1Veog Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:28:12.793736 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 5897368539ef4287bcba0c274c458491 Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 could not be found. Jul 14 10:28:12.795191 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': 'b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6'} Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 could not be found. Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:28:12.796008 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 could not be found. Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 could not be found. Jul 14 10:28:12.797111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:12.798073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Returning 404 to user: Instance b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:28:12.798073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-59ee84ec-14f1-4498-9deb-d6783595693b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6" status: 404 len: 111 microversion: 2.1 time: 0.035264 Jul 14 10:28:12.798073 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1558/3106] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:12 2022] GET /compute/v2.1/servers/b2368cb0-eb1d-4af7-9d36-4d3eed79d3e6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 10:28:16.097419 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-04b09481-f669-4048-961d-63f52ffa4112 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:16.097931 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-04b09481-f669-4048-961d-63f52ffa4112 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:16.100165 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-1c53be78-83c3-4790-b23b-97faed78bbda req-6ea65158-19e6-4122-a353-038f8691f7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb94aedd-4204-42e8-bb0f-2fdd324331b3", "tag": "bc269076-b07f-4f39-8923-ce383f25f265"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:28:16.104910 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04b09481-f669-4048-961d-63f52ffa4112 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:16.105356 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04b09481-f669-4048-961d-63f52ffa4112 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:16.106118 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04b09481-f669-4048-961d-63f52ffa4112 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:16.106822 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-04b09481-f669-4048-961d-63f52ffa4112 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:16.108999 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-1c53be78-83c3-4790-b23b-97faed78bbda req-6ea65158-19e6-4122-a353-038f8691f7b2 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:16.109524 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-1c53be78-83c3-4790-b23b-97faed78bbda req-6ea65158-19e6-4122-a353-038f8691f7b2 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:16.121607 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-1c53be78-83c3-4790-b23b-97faed78bbda req-6ea65158-19e6-4122-a353-038f8691f7b2 service nova] Creating event network-changed:bc269076-b07f-4f39-8923-ce383f25f265 for instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 on hv-cinder-82549 Jul 14 10:28:16.127034 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-1c53be78-83c3-4790-b23b-97faed78bbda req-6ea65158-19e6-4122-a353-038f8691f7b2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031452 Jul 14 10:28:16.128111 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1559/3107] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:28:16.137049 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-04b09481-f669-4048-961d-63f52ffa4112 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Going to try to terminate instance {{(pid=129537) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:28:16.226495 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-04b09481-f669-4048-961d-63f52ffa4112 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "DELETE /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 204 len: 0 microversion: 2.1 time: 0.133315 Jul 14 10:28:16.230755 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1549/3108] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:28:16 2022] DELETE /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:28:16.237950 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-391798ca-6294-45c1-8626-f90d36e11a27 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:16.238731 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-391798ca-6294-45c1-8626-f90d36e11a27 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:16.249584 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-391798ca-6294-45c1-8626-f90d36e11a27 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:16.250226 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-391798ca-6294-45c1-8626-f90d36e11a27 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:16.251192 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-391798ca-6294-45c1-8626-f90d36e11a27 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:16.251930 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-391798ca-6294-45c1-8626-f90d36e11a27 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:16.430832 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.policy [None req-391798ca-6294-45c1-8626-f90d36e11a27 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129536) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:28:16.438401 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-391798ca-6294-45c1-8626-f90d36e11a27 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1579 microversion: 2.1 time: 0.204725 Jul 14 10:28:16.438963 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1560/3109] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:16 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1579 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:28:17.457280 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-e46777ae-3ea0-47a5-bde4-b781b552a0ff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:17.458537 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-e46777ae-3ea0-47a5-bde4-b781b552a0ff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:17.464934 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e46777ae-3ea0-47a5-bde4-b781b552a0ff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:17.465378 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e46777ae-3ea0-47a5-bde4-b781b552a0ff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:17.466130 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e46777ae-3ea0-47a5-bde4-b781b552a0ff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:17.466581 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-e46777ae-3ea0-47a5-bde4-b781b552a0ff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:17.632177 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-e46777ae-3ea0-47a5-bde4-b781b552a0ff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:28:17.641638 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-e46777ae-3ea0-47a5-bde4-b781b552a0ff tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1579 microversion: 2.1 time: 0.188610 Jul 14 10:28:17.642215 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1550/3110] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:17 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1579 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:28:18.639252 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [req-1ebdd0cc-14c7-485d-b895-385c29e540c0 req-1bcfe0e5-fcaa-4b2d-882f-d4b575939571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb94aedd-4204-42e8-bb0f-2fdd324331b3", "name": "network-vif-deleted", "tag": "bc269076-b07f-4f39-8923-ce383f25f265"}]} {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:28:18.648937 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-1ebdd0cc-14c7-485d-b895-385c29e540c0 req-1bcfe0e5-fcaa-4b2d-882f-d4b575939571 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:18.649379 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [req-1ebdd0cc-14c7-485d-b895-385c29e540c0 req-1bcfe0e5-fcaa-4b2d-882f-d4b575939571 service nova] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:18.659576 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-67e094ce-2cc5-4341-bdcf-c88bc2e78daf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:18.661795 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-67e094ce-2cc5-4341-bdcf-c88bc2e78daf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:18.662519 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.compute.server_external_events [req-1ebdd0cc-14c7-485d-b895-385c29e540c0 req-1bcfe0e5-fcaa-4b2d-882f-d4b575939571 service nova] Creating event network-vif-deleted:bc269076-b07f-4f39-8923-ce383f25f265 for instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 on hv-cinder-82549 Jul 14 10:28:18.667521 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [req-1ebdd0cc-14c7-485d-b895-385c29e540c0 req-1bcfe0e5-fcaa-4b2d-882f-d4b575939571 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 Jul 14 10:28:18.668432 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1561/3111] 10.222.0.40 () {64 vars in 1317 bytes} [Thu Jul 14 10:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:28:18.668810 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67e094ce-2cc5-4341-bdcf-c88bc2e78daf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:18.669402 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67e094ce-2cc5-4341-bdcf-c88bc2e78daf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:18.670260 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67e094ce-2cc5-4341-bdcf-c88bc2e78daf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:18.671250 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-67e094ce-2cc5-4341-bdcf-c88bc2e78daf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:18.732902 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.policy [None req-67e094ce-2cc5-4341-bdcf-c88bc2e78daf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5897368539ef4287bcba0c274c458491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f8922bb91240a2b1f63f306c6d09d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129537) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:28:18.740770 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-67e094ce-2cc5-4341-bdcf-c88bc2e78daf tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 200 len: 1226 microversion: 2.1 time: 0.085135 Jul 14 10:28:18.741330 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1551/3112] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:18 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:28:19.759126 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:19.759820 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: bb94aedd-4204-42e8-bb0f-2fdd324331b3] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:19.765959 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:19.766435 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:19.767182 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:19.767614 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:19.781150 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] HTTP exception thrown: Instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 could not be found. Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Request method failure captured: Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 HTTP/1.1 Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-3MKujh6UzQVvoOquE6Ivgz9BwmOxCpiCPXHFfB_wkxR02xBJ5wFGoAe2hGk2DsNR2_aEr4qkbb1vd1-_UzRqQQWxbRXYCud1daHCRyDrPOpE8veKK-UcDugueLMMvlvj65K9_jYwdurgKM8GnDJefvVRG6jSgPDaNW2bkI0d1Veog Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:28:19.782750 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 5897368539ef4287bcba0c274c458491 Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 could not be found. Jul 14 10:28:19.784166 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': 'bb94aedd-4204-42e8-bb0f-2fdd324331b3'} Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 could not be found. Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:28:19.784935 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 could not be found. Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 could not be found. Jul 14 10:28:19.786318 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:19.787583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Returning 404 to user: Instance bb94aedd-4204-42e8-bb0f-2fdd324331b3 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:28:19.787583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-9a301273-c4df-447d-a2ac-2f21aed08584 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3" status: 404 len: 111 microversion: 2.1 time: 0.030323 Jul 14 10:28:19.787583 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1562/3113] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:19 2022] GET /compute/v2.1/servers/bb94aedd-4204-42e8-bb0f-2fdd324331b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:28:20.223850 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:20.224346 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.compute.api [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129537) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:20.230988 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:20.231430 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:20.232176 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:20.232604 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG oslo_concurrency.lockutils [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:20.246034 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.wsgi [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] HTTP exception thrown: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Request method failure captured: Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: request: DELETE /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 HTTP/1.1 Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept: application/json Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Accept-Encoding: identity Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Connection: close Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Length: 0 Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Content-Type: application/json Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Host: 10.222.0.40 Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Openstack-System-Scope: None Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: User-Agent: python-urllib3/1.26.9 Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Auth-Token: gAAAAABiz-3MKujh6UzQVvoOquE6Ivgz9BwmOxCpiCPXHFfB_wkxR02xBJ5wFGoAe2hGk2DsNR2_aEr4qkbb1vd1-_UzRqQQWxbRXYCud1daHCRyDrPOpE8veKK-UcDugueLMMvlvj65K9_jYwdurgKM8GnDJefvVRG6jSgPDaNW2bkI0d1Veog Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Id: None Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Domain-Name: None Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Identity-Status: Confirmed Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Is-Admin-Project: True Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Id: default Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Domain-Name: Default Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Project-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Role: reader,member Jul 14 10:28:20.247716 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Roles: reader,member Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Id: default Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Domain-Name: Default Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Id: 5897368539ef4287bcba0c274c458491 Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: X-User-Name: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: method: > Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: exception: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.248872 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: action_args: {'id': '2648f6c0-3376-4548-88b9-d127f3885a75'} Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:28:20.249586 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.250707 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.252026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Returning 404 to user: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. {{(pid=129537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:28:20.252026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-7c8b382b-cc00-4c67-8c17-e89199268777 tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "DELETE /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 404 len: 111 microversion: 2.1 time: 0.029124 Jul 14 10:28:20.252026 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1552/3114] 10.222.0.40 () {58 vars in 1238 bytes} [Thu Jul 14 10:28:20 2022] DELETE /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:28:20.258219 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '>' {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:20.258838 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.compute.api [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] [instance: 2648f6c0-3376-4548-88b9-d127f3885a75] Fetching instance by UUID {{(pid=129536) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:28:20.265308 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:20.265756 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:20.266551 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:28:20.266988 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG oslo_concurrency.lockutils [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Lock "11929b56-3cfc-42c6-a919-563dcd828b94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:28:20.280107 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.wsgi [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] HTTP exception thrown: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Request method failure captured: Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: request: GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 HTTP/1.1 Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept: application/json Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Accept-Encoding: identity Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Connection: close Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Length: 0 Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Content-Type: application/json Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Host: 10.222.0.40 Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Openstack-System-Scope: None Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: User-Agent: python-urllib3/1.26.9 Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Auth-Token: gAAAAABiz-3MKujh6UzQVvoOquE6Ivgz9BwmOxCpiCPXHFfB_wkxR02xBJ5wFGoAe2hGk2DsNR2_aEr4qkbb1vd1-_UzRqQQWxbRXYCud1daHCRyDrPOpE8veKK-UcDugueLMMvlvj65K9_jYwdurgKM8GnDJefvVRG6jSgPDaNW2bkI0d1Veog Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Id: None Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Domain-Name: None Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Identity-Status: Confirmed Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Is-Admin-Project: True Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Id: default Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Domain-Name: Default Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Project-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Role: reader,member Jul 14 10:28:20.281625 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Roles: reader,member Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.40:8080", "publicURL": "http://10.222.0.40:8080/v1/AUTH_c5f8922bb91240a2b1f63f306c6d09d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}] Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Id: c5f8922bb91240a2b1f63f306c6d09d1 Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-Tenant-Name: tempest-TestVolumeBootPattern-1248810004 Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Id: default Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Domain-Name: Default Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Id: 5897368539ef4287bcba0c274c458491 Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: X-User-Name: tempest-TestVolumeBootPattern-1248810004-project Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: method: > Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: exception: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.283091 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: action_args: {'id': '2648f6c0-3376-4548-88b9-d127f3885a75'} Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: {{(pid=129536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:28:20.283848 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. Jul 14 10:28:20.285124 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: ERROR nova.api.openstack.wsgi Jul 14 10:28:20.286406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: DEBUG nova.api.openstack.wsgi [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Returning 404 to user: Instance 2648f6c0-3376-4548-88b9-d127f3885a75 could not be found. {{(pid=129536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:28:20.286406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO nova.api.openstack.requestlog [None req-374c4834-f4d6-4d58-ad16-fa61a5085d9b tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75" status: 404 len: 111 microversion: 2.1 time: 0.029198 Jul 14 10:28:20.286406 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: [pid: 129536|app: 0|req: 1563/3115] 10.222.0.40 () {58 vars in 1235 bytes} [Thu Jul 14 10:28:20 2022] GET /compute/v2.1/servers/2648f6c0-3376-4548-88b9-d127f3885a75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:28:21.570680 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: DEBUG nova.api.openstack.wsgi [None req-00425016-1ff1-43fb-b797-6f87a29320ed tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] Calling method '.version_select at 0x7f7da1d96670>' {{(pid=129537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:28:21.594142 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO nova.api.openstack.requestlog [None req-00425016-1ff1-43fb-b797-6f87a29320ed tempest-TestVolumeBootPattern-1248810004 tempest-TestVolumeBootPattern-1248810004-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1398841134" status: 202 len: 0 microversion: 2.1 time: 0.028128 Jul 14 10:28:21.605618 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: [pid: 129537|app: 0|req: 1553/3116] 10.222.0.40 () {58 vars in 1262 bytes} [Thu Jul 14 10:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1398841134 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:29:48.596224 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:29:48.596696 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:29:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:31:18.377355 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:31:18.377878 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:31:22.019492 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:31:22.020019 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:31:28.315504 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:31:28.316074 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:31:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:33:08.604944 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:33:08.605442 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:33:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:33:30.644280 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:33:30.644964 dv-cinder-825492-26-iscsi devstack@n-api.service[129536]: Thu Jul 14 10:33:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:33:36.094158 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:33:36.094845 dv-cinder-825492-26-iscsi devstack@n-api.service[129537]: Thu Jul 14 10:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!